Not likely, especially if you are only using 1/255. The output isn't much more than a laser pointer and worst case you get a fraction reflected which would be diffused and less likely to cause any damage.
The typical damage from a laser diode isn't poor vision but rather a "blank" spot on the retina, over time your brain will compensate and you wouldn't even notice it unless tested or examined.
I have the 3-wire fan. Yellow gets 12V as soon as the 12V supply is switched on (button in) and runs the fan. Red wire is PWM to the laser. M3 S1000 sets full 5V to laser, M5 turns it off. Lower S numbers reduce the power level of the laser.