From 2015:
"We investigate the impact of seller race in a field experiment involving
baseball card auctions on eBay. Photographs showed the cards held by either a darkskinned/African-American hand or a light-skinned/Caucasian hand. Cards held by
African-American sellers sold for approximately 20% ($0.90) less than cards held by
Caucasian sellers, and the race effect was more pronounced in sales of minority player
cards. "
It's almost as though bias-making machinery is embedded in the texts these things are trained on.
It's wild to see quantitative researchers catching even just a glimpse of what culture/media/literary theorists have been swimming in for decades.
From 2015: "We investigate the impact of seller race in a field experiment involving baseball card auctions on eBay. Photographs showed the cards held by either a darkskinned/African-American hand or a light-skinned/Caucasian hand. Cards held by African-American sellers sold for approximately 20% ($0.90) less than cards held by Caucasian sellers, and the race effect was more pronounced in sales of minority player cards. "
I used to despise this kind of thing but it sheds light on the enormous generalization problems that aren't even close to being solved.