BlackEco@lemmy.blackeco.com to Technology@lemmy.worldEnglish · 1 month agoLLMs have a strong bias against use of African American Englisharstechnica.comexternal-linkmessage-square29fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkLLMs have a strong bias against use of African American Englisharstechnica.comBlackEco@lemmy.blackeco.com to Technology@lemmy.worldEnglish · 1 month agomessage-square29fedilink
minus-squarebionicjoey@lemmy.calinkfedilinkEnglisharrow-up0·1 month agoMakes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It’s pretty rare for people to write in an AAVE style in those contexts.
minus-squaregivesomefucks@lemmy.worldlinkfedilinkEnglisharrow-up0·1 month agoExcept it has no difficulty reading and understanding AAVE, because people use it online frequently… Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn’t understand it…
minus-squarebionicjoey@lemmy.calinkfedilinkEnglisharrow-up0·1 month agoI never said it can’t understand it. I am agreeing with the notion that it has a bias against using it.
minus-squaregivesomefucks@lemmy.worldlinkfedilinkEnglisharrow-up0·1 month agoYou said it’s rarely used online, which just isn’t true. But like even this: I am agreeing with the notion that it has a bias against using it I’m not sure if you understand the bias is against users who use AAVE, or if you’re saying a LLM doesn’t want to use AAVE. Maybe you did understand everything, and you’re just being vague. But almost everything you said could be interpreted multiple ways.
Makes sense. AAVE is mostly a spoken thing, LLMs are mostly trained on the corpus of written text on the internet and in books. It’s pretty rare for people to write in an AAVE style in those contexts.
Except it has no difficulty reading and understanding AAVE, because people use it online frequently…
Like, the article makes that abundantly clear, but everyone commenting just read the headline and assumed what it meant was it couldn’t understand it…
I never said it can’t understand it. I am agreeing with the notion that it has a bias against using it.
You said it’s rarely used online, which just isn’t true.
But like even this:
I’m not sure if you understand the bias is against users who use AAVE, or if you’re saying a LLM doesn’t want to use AAVE.
Maybe you did understand everything, and you’re just being vague.
But almost everything you said could be interpreted multiple ways.