Bias

Noun · AI & Machine Learning

Definitions

  1. Systematic errors in an AI model's outputs that reflect prejudices in training data, algorithm design, or deployment context. An AI trained on biased data doesn't remove bias — it automates and scales it.

    In plain English: When an AI system produces unfair or prejudiced results because the data it learned from contained those same prejudices — the AI inherits society's biases.

  2. In statistics and machine learning, bias also refers to a systematic error in a model's predictions — underfitting due to overly simplistic assumptions. This technical bias (bias-variance tradeoff) is distinct from the ethical/social bias, though both cause models to be wrong.

    Example: 'The model has high bias — it's too simple to capture the patterns in our data. We need more features or a more complex architecture.'

    Source: statistical / ML technical

Etymology

1960s
Statistical bias (systematic error) is well-established; cognitive bias enters psychology through Kahneman and Tversky in the 1970s
2016
ProPublica's investigation of COMPAS reveals racial bias in criminal recidivism algorithms, making AI bias front-page news
2020s
Bias auditing becomes standard practice; researchers develop frameworks for measuring and mitigating bias in language models

Related Terms