I have found that the "lingering smells" are often just remnants in your nasal passages. Even after a shower, they don't go away. You can smell it, but other people can't.

Splashing some water up your nostrils, or some nasal sprays, will get rid of it.