AVID-2023-V024

Vulnerability from avid – Published: 2023-03-30 – Updated: 2023-03-30 AIID Incident
Summary
An algorithm developed by Northpointe and used in the penal system is two times more likely to incorrectly label a black person as a high-risk re-offender and is two times more likely to incorrectly label a white person as low-risk for reoffense according to a ProPublica review.
Risk domain
Performance
SEP view
E0101: Group fairness, P0403: Socioeconomic safety
Lifecycle
L06: Deployment
Organisations
Northpointe (deployer), Northpointe (developer)
References
URL Label
https://incidentdatabase.ai/cite/11 Incident 11: Northpointe Risk Models

{
  "affects": {
    "artifacts": [
      {
        "name": "",
        "type": "System"
      }
    ],
    "deployer": [
      "Northpointe"
    ],
    "developer": [
      "Northpointe"
    ]
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Sean McGregor, AIID"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.2",
  "description": {
    "lang": "eng",
    "value": "An algorithm developed by Northpointe and used in the penal system is two times more likely to incorrectly label a black person as a high-risk re-offender and is two times more likely to incorrectly label a white person as low-risk for reoffense according to a ProPublica review."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L06: Deployment"
      ],
      "risk_domain": [
        "Performance"
      ],
      "sep_view": [
        "E0101: Group fairness",
        "P0403: Socioeconomic safety"
      ],
      "taxonomy_version": "0.2"
    }
  },
  "last_modified_date": "2023-03-30",
  "metadata": {
    "vuln_id": "AVID-2023-V024"
  },
  "problemtype": {
    "classof": "AIID Incident",
    "description": {
      "lang": "eng",
      "value": "Northpointe Risk Models"
    }
  },
  "published_date": "2023-03-30",
  "references": [
    {
      "label": "Incident 11: Northpointe Risk Models",
      "url": "https://incidentdatabase.ai/cite/11"
    }
  ],
  "reports": []
}



Log in or create an account to share your comment.




Tags
Taxonomy of the tags.


Loading…

Loading…

Loading…

Forecast uses a logistic model when the trend is rising, or an exponential decay model when the trend is falling. Fitted via linearized least squares.

Sightings

Author Source Type Date Other

Nomenclature

  • Seen: The vulnerability was mentioned, discussed, or observed by the user.
  • Confirmed: The vulnerability has been validated from an analyst's perspective.
  • Published Proof of Concept: A public proof of concept is available for this vulnerability.
  • Exploited: The vulnerability was observed as exploited by the user who reported the sighting.
  • Patched: The vulnerability was observed as successfully patched by the user who reported the sighting.
  • Not exploited: The vulnerability was not observed as exploited by the user who reported the sighting.
  • Not confirmed: The user expressed doubt about the validity of the vulnerability.
  • Not patched: The vulnerability was not observed as successfully patched by the user who reported the sighting.

Loading…

Loading…

Loading…

Related by attack behaviour

Vulnerabilities whose description is nearest to this one in the vector space of the CIRCL/vulnerability-attack-technique-biencoder model. This is a similarity search over the bi-encoder space (plain cosine), not a classification, and it has no measured accuracy.


Loading…