Only - you're wrong.

Living your life is fine. How you live your life is the critical question. If you are doing nothing to counter oppression, you are complicit by omission.

This is oversimplified.

No neutrality isn't inherently evil. But it does allow evil to stand unopposed. What then is the difference?

I want to also point out that "colorblindness" *actively harms* people of color.