Welcome to DU!
The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards.
Join the community:
Create a free account
Support DU (and get rid of ads!):
Become a Star Member
Latest Breaking News
General Discussion
The DU Lounge
All Forums
Issue Forums
Culture Forums
Alliance Forums
Region Forums
Support Forums
Help & Search
General Discussion
Related: Editorials & Other Articles, Issue Forums, Alliance Forums, Region ForumsRacist Algorithms, Crime, And The Ethical Use Of Data Prediction In The Criminal Justice System
http://skepchick.org/2016/05/racist-algorithms-crime-and-the-ethical-use-of-data-prediction/"ProPublica came out with an excellent piece this week by Julia Angwin, Jeff Larson, Surya Mattu and Lauren Kircher looking at the algorithms used by the US justice system to predict the recidivism rate of people at different stages within the justice system. These predictive scores, called risk assessment scores, are then used to determine things like sentencing and bail amounts, with those who have a high probability of committing future crimes getting higher sentences than those with lower scores. Low and behold, these scores are also correlated with race, so if a black man and white man commit the same crime, the black man is more likely to have a higher risk assessment score which could result in a tougher prison sentence or a higher bail.
As someone who builds predictive models for a living, I am dismayed at the misuse of predictive algorithms for the purposes of discrimination, though I dont think its the algorithm itself that is the problem, or at least not for the reasons that others seem to think.
Why do some predictive models give racist results?
In 2016 in the United States we are living under a white supremacist society where black men and women face institutionalized racism that leads to less opportunities for jobs and credit and greater risk of arrest and violence. Because of institutionalized racism, there are many undesirable things that correlate with being black, such as lower income, likelihood of participating in certain types of crimes, increased likelihood of being arrested for said crimes, and increased recidivism rates for those who have served their term and are released from jail. This is a classic case of causation does not equal correlation. Being black is correlated with these things not because there is something innate about black people that causes them to commit crimes but because we live in a society where external hardships are imposed on black people because they are black and those hardships themselves are correlated with crime.
...
The problem with the actual risk assessment model that ProPublica looked into, created by the company Northpointe, isnt just that it gives higher scores to people who are black. In fact, the model overestimates the recidivism rate of black individuals and underestimates it for white individuals. The model results dont match reality in ways that really are racist against black people.
..."
-------------------------------------
InfoView thread info, including edit history
TrashPut this thread in your Trash Can (My DU » Trash Can)
BookmarkAdd this thread to your Bookmarks (My DU » Bookmarks)
2 replies, 546 views
ShareGet links to this post and/or share on social media
AlertAlert this post for a rule violation
PowersThere are no powers you can use on this post
EditCannot edit other people's posts
ReplyReply to this post
EditCannot edit other people's posts
Rec (1)
ReplyReply to this post
2 replies
= new reply since forum marked as read
Highlight:
NoneDon't highlight anything
5 newestHighlight 5 most recent replies
Racist Algorithms, Crime, And The Ethical Use Of Data Prediction In The Criminal Justice System (Original Post)
HuckleB
May 2016
OP
1StrongBlackMan
(31,849 posts)1. Good read.
HuckleB
(35,773 posts)2. Thanks!
I thought so, too!