Polarization filters on retinal photoreceptor won’t make light wavelength (color) be perceived different, it just changes the conditions in which it’s detected. If those polarized cells would cover unique colors compared to the rest, it would kinda resemble the highlight effect in Mirror’s Edge, where something with a different angle than the surroundings stand out (sudden color gradient)