Why is relying on reflection inadvisable?

Lots of websites and books I have read have stated that:

relying on reflection in Java is a bad idea and you should seek other ways of testing/interfacing with encapsulated objects.

However, I can't find any actual reasons for this, is it to do with security managers being different from JVM to JVM? Or are there other reasons on top of this?