Question On Colored Vinyl

I was once told by a reliable record dealer in Detroit to avoid colored vinyl other than white and red. I have a few great sounding white records so I’m starting to believe some truth in it. Has anyone else heard this? The more I play my colored/clear records, the more I notice how much worse they sound than black, white and red.