AVID-2022-V004

Vulnerability from avid – Published: 2022-12-23 – Updated: 2022-12-23 AIID Incident
Summary
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them", leading to the arrest of a Palestinian man in Beitar Illit, Israel.
Risk domain
Performance
SEP view
P0401: Psychological Safety, P0402: Physical safety
Lifecycle
L06: Deployment
Organisations
Facebook (deployer), Facebook (developer)
References
URL Label
https://incidentdatabase.ai/cite/72 Incident 72: Facebook translates 'good morning' into 'attack them', leading to arrest
To clipboard 

{
  "affects": {
    "artifacts": [
      {
        "name": "",
        "type": "System"
      }
    ],
    "deployer": [
      "Facebook"
    ],
    "developer": [
      "Facebook"
    ]
  },
  "credit": [
    {
      "lang": "eng",
      "value": "Sean McGregor, Khoa Lam, AIID"
    }
  ],
  "data_type": "AVID",
  "data_version": "0.1",
  "description": {
    "lang": "eng",
    "value": "Facebook\u0027s automatic language translation software incorrectly translated an Arabic post saying \"Good morning\" into Hebrew saying \"hurt them\", leading to the arrest of a Palestinian man in Beitar Illit, Israel."
  },
  "impact": {
    "avid": {
      "lifecycle_view": [
        "L06: Deployment"
      ],
      "risk_domain": [
        "Performance"
      ],
      "sep_view": [
        "P0401: Psychological Safety",
        "P0402: Physical safety"
      ],
      "taxonomy_version": "0.1"
    }
  },
  "last_modified_date": "2022-12-23",
  "metadata": {
    "vuln_id": "AVID-2022-V004"
  },
  "problemtype": {
    "classof": "AIID Incident",
    "description": {
      "lang": "eng",
      "value": "Facebook translates \u0027good morning\u0027 into \u0027attack them\u0027, leading to arrest"
    }
  },
  "published_date": "2022-12-23",
  "references": [
    {
      "label": "Incident 72: Facebook translates \u0027good morning\u0027 into \u0027attack them\u0027, leading to arrest",
      "url": "https://incidentdatabase.ai/cite/72"
    }
  ],
  "reports": []
}



Log in or create an account to share your comment.




Tags
Taxonomy of the tags.





Forecast uses a logistic model when the trend is rising, or an exponential decay model when the trend is falling. Fitted via linearized least squares.

Sightings

Author Source Type Date Other

Nomenclature

  • Seen: The vulnerability was mentioned, discussed, or observed by the user.
  • Confirmed: The vulnerability has been validated from an analyst's perspective.
  • Published Proof of Concept: A public proof of concept is available for this vulnerability.
  • Exploited: The vulnerability was observed as exploited by the user who reported the sighting.
  • Patched: The vulnerability was observed as successfully patched by the user who reported the sighting.
  • Not exploited: The vulnerability was not observed as exploited by the user who reported the sighting.
  • Not confirmed: The user expressed doubt about the validity of the vulnerability.
  • Not patched: The vulnerability was not observed as successfully patched by the user who reported the sighting.



Related by attack behaviour

Vulnerabilities whose description is nearest to this one in the vector space of the CIRCL/vulnerability-attack-technique-biencoder model. This is a similarity search over the bi-encoder space (plain cosine), not a classification, and it has no measured accuracy.