Is or was Affirmative Action right?

so now and then, when I look at a fellow co-worker from a good school, I have to wonder, "Yes, you are very smart now, but .... did you get more $$ financial aid than I, " OR" will your kids go to a better school" just because you are black or Hispanic, as opposed to white or asian?