That's exactly what teleport to waypoint does.
You set a waypoint on the map near some location(DO NOT put waypoint ON a location, always near it), press the button(default to numpad comma) and you're there.
No need for eagle.
hmm I did that twice, first time talked to the other guy first, second time I went directly to the arena to fight and worked fine?(second time being a new playthrough)