I think that the reason why people (like myself) are getting fed up with genre labels is because a) lots of music is getting too similar, and/or b) people's assumptions.
For example, if I tell people, "I like metal", they usually assume I like all this new stuff which mostly sounds the same to me. I find it kind of boring because lots of it is too similar. What I actually do like, is a few "old" bands who all have their own style. So if I say "I like Metal", I want it to mean that I have a choice of countless bands with all different sounds that still fall underneath the umbrella of that genre.
So if you say "I like pop music", people seem to think you like everything that's popular on the charts. But you may love one type of pop and hate another. You may love Britney and hate Christina. Or love Kelly Clarkson and not Gwen Stefani. Or be a Vanessa Carlton fan and hate James Blunt.
I don't really like classifying Nessa as "pop" because people assume she belongs with Britney Spears, Jessica Simpson, etc. But it should be that they all fit in pop because the genre is so diverse and therefore there shouldn't be any negative connotations attached to the word "pop". That's what sub-genres are for. But at the end of the day, music is music.
Am I making sense?