I'd always avoid sexual encounters from co-workers, neighbours, business associates, anyone you are likely to have ongoing regular contact with.

The inability to avoid them if things go wrong with the relationship can really mess your mind later.