So I wasted some energy today joining some random parties today.

The screen goes black, the mini map in the upper right corner says I'm still in haven, yet on the left side, it displays the party member icons and health bars.

Basically my question is.. what's up? Why is this happening? Can I have my energy back? Can you fix this issue?