One could argue that it’s only indirectly harmful. It’s not jumping out of the window that hurts you. It’s the sudden stop before you reach the ground. Or more realistically, you could argue that even taking a little falling damage, you’re in a way better position than fighting for your life, so on the net it’s not harmful.

Or you could just use it on a Monk.