First impressions

"I am but mad north-north-west:  when the wind is southerly I know a hawk from a handsaw."  ~Shakespeare

Apparently, I am the master of lousy first impressions. I can't count the number of times I've been told "you know, Tyler, when I first met you, you seemed a little [snooty/hoity-toity/odd/neurotic]." Is that an insult, or just an underhanded complement?