I think I fixed the Goblins.
I ended up adding 2 extra States, one for entering a object and one for leaving.
That didn't actually fix it, it just made things easier and better.
The fix was adding an exit to the wander state.
