Well if the artist is some fat, bald bloke and I don't much like the cut of his jib, I can simply take my glasses off. The only problem is remembering to put them on again at the end. I often fall over the person next to me trying to get out.
There again if the artist is some shapely wench, well I don't mind the odd grimace one bit. In fact it might add some welcome piquancy.
No it's not girning artists that bother me at concerts. Fellow members of the audience though can be a right pain. Last year at the ENO the woman next to us' mobile phone rang. Bad enough you might think. But then bugger me - she actually answered it! Of course there's the usual problem with sweetie wrappers during quiet bits and those who feel the need to keep up a running commentary on the proceedings. "ooh that wera nice bit, wonit?... Alf, Alf – wake-up for gawld sake!" It might be OK during very loud bits, but if the music suddenly stops… Someone told me that at some concert in the Albert Hall, during one such unexpected silence someone was quite clearly heard to say "Personally I always wrap mine in newspaper".
The audience can upset the artists too. There's a story that Paul Tortelier once called out "Au revoir, Madame!" to some woman who decided to take her leave while he was mid phrase.