Damnit I’ve said this exact thing.

Or after the short dance I’ll just point a direction and be like “I’ll go that way”

Those are literally the only two options. Super polite and wordy, or awkward and asocial.