AVID-2022-V006

Vulnerability from avid – Published: 2022-12-23 – Updated: 2022-12-23 AIID Incident
Summary
Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube's content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos.
Risk domain
Performance
SEP view
P0401: Psychological Safety, P0402: Physical safety
Lifecycle
L06: Deployment
Organisations
YouTube (deployer), YouTube (developer)
References
URL Label
https://incidentdatabase.ai/cite/281 Incident 281: YouTube's Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm
To clipboard 

{
  "affects": {
    "artifacts": [
      {
        "name": "",
        "type": "System"
      }
    ],
    "deployer": [
      "YouTube"
    ],
    "developer": [
      "YouTube"
    ]
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Khoa Lam, AIID"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.1",
  "description": {
    "lang": "eng",
    "value": "Terms-of-service-violating videos related to suicide and self-harm reportedly bypassed YouTube\u0027s content moderation algorithms, allegedly resulting in exposure of graphic content to young users via recommended videos."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L06: Deployment"
      ],
      "risk_domain": [
        "Performance"
      ],
      "sep_view": [
        "P0401: Psychological Safety",
        "P0402: Physical safety"
      ],
      "taxonomy_version": "0.1"
    }
  },
  "last_modified_date": "2022-12-23",
  "metadata": {
    "vuln_id": "AVID-2022-V006"
  },
  "problemtype": {
    "classof": "AIID Incident",
    "description": {
      "lang": "eng",
      "value": "YouTube\u0027s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm"
    }
  },
  "published_date": "2022-12-23",
  "references": [
    {
      "label": "Incident 281: YouTube\u0027s Algorithms Failed to Remove Violating Content Related to Suicide and Self-Harm",
      "url": "https://incidentdatabase.ai/cite/281"
    }
  ],
  "reports": []
}



Log in or create an account to share your comment.




Tags
Taxonomy of the tags.





Forecast uses a logistic model when the trend is rising, or an exponential decay model when the trend is falling. Fitted via linearized least squares.

Sightings

Author Source Type Date Other

Nomenclature

  • Seen: The vulnerability was mentioned, discussed, or observed by the user.
  • Confirmed: The vulnerability has been validated from an analyst's perspective.
  • Published Proof of Concept: A public proof of concept is available for this vulnerability.
  • Exploited: The vulnerability was observed as exploited by the user who reported the sighting.
  • Patched: The vulnerability was observed as successfully patched by the user who reported the sighting.
  • Not exploited: The vulnerability was not observed as exploited by the user who reported the sighting.
  • Not confirmed: The user expressed doubt about the validity of the vulnerability.
  • Not patched: The vulnerability was not observed as successfully patched by the user who reported the sighting.



Related by attack behaviour

Vulnerabilities whose description is nearest to this one in the vector space of the CIRCL/vulnerability-attack-technique-biencoder model. This is a similarity search over the bi-encoder space (plain cosine), not a classification, and it has no measured accuracy.