Firstly, note that "eye color" is actually iris color.
The person with a lighter iris will have more straylight compared to person with brown iris:
The graph represents Intraocular straylight of the age-matched groups. Participants with light-blue-colored iris showed significantly higher values for intraocular straylight than those of the other groups.
Persons with light-blue-colored eyes have significant higher IOSL
values than persons with darker-colored irises (blue-grey,
green-hazel, and brown). Light-blue-colored eyes had 0.07 to 0.08 log
units higher IOSL values, which is an increase by a factor of 1.2. In
regard to CS (contrast sensitivity), subjects with light-blue iris color showed also lower CS
values than subjects with other iris color.
Edit: The study concluded that in people with blue irises, IOSL was significantly higher. Although IOSL did not affect best-corrected visual acuity (e.g. visual function based on a standard letter chart test at the optometrist), it did affect contrast acuity, meaning that folks with blue eyes had more difficulty assessing contrast differences (e.g., telling apart two grays with a slightly different brightness).
Christian Nischler & al. Iris color and visual functions. Graefes Arch Clin Exp Ophthalmol (2013) 251:195–202.