I know perfectly well what "beauty lies in the eye of the beholder" means. Who said I can't insult Coach?!
You can insult coach all you want... but "beholder" means basically "person seeing it."
So having very few beholders does not mean something is ugly. It just means very few people saw it.
So saying "if beauty is in the eye of the beholder, then you must not have many beholders" is just paraphrased to "if the people seeing it decide if it's pretty or not, than not many people must have seen it!"
Which... isn't insulting at all. In fact, it's kinda random and non-sensical.
But you got rid of it, so it doesn't really matter anymore.