# La macchina giudica l'uomo | Francesca Bartolini | TEDxLink Campus University

Source: https://www.youtube.com/watch?v=JEUodGsYQ4Y
Recap page: https://rapidrecap.app/video/JEUodGsYQ4Y
Generated: 2025-12-03T21:04:02.513+00:00

---
## Quick Overview

Francesca Bartolini argues that the ethical dilemmas surrounding autonomous machine judgment, exemplified by the Moral Machine experiment, are currently unsolvable because the underlying cultural criteria used to train AI systems are culturally biased, leading to potentially catastrophic or unfair outcomes when deployed globally, stressing the need for human oversight and programmed values that are universally acceptable.

**Key Points:**
- The ethical challenge of autonomous machines judging humans, like in self-driving car dilemmas, is currently unsolvable due to inherent cultural bias in the training data.
- The MIT Moral Machine experiment surveyed 233 countries, revealing diverse cultural responses to ethical trade-offs (e.g., sacrificing pedestrians vs. the passenger).
- Western cultures tend to prioritize saving the young over the old, while Eastern cultures often prioritize saving the elderly.
- In credit scoring, algorithms risk perpetuating systemic errors by being trained on data reflecting past human biases, leading to potentially unfair negative evaluations.
- The speaker shared a personal anecdote of being scared in a self-driving car scenario where she could not intervene, highlighting the lack of human control.
- To mitigate harm, society must define and program clear, universally acceptable ethical criteria into AI systems, rather than relying on flawed historical data or culturally specific assumptions.

![Screenshot at 03:59: The slide illustrates the core dilemma of autonomous vehicles, posing the choice between 'KILL PEDESTRIANS' and 'KILL PASSENGER,' framing the central question: 'Come programmiamo le scelte dell'IA?' \(How do we program AI's choices?\).](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-03-59.png)

**Context:** Francesca Bartolini discusses the critical ethical and legal challenges arising from the increasing autonomy of artificial intelligence, specifically focusing on instances where machines must make life-and-death decisions or assessments that impact human lives, such as in autonomous vehicles or credit scoring systems. She grounds her discussion in the context of the MIT Moral Machine experiment, which sought to quantify cross-cultural ethical preferences.

## Detailed Analysis

Francesca Bartolini addresses the fundamental problem of programming ethical decisions into Artificial Intelligence, particularly in scenarios where AI must judge human actions or outcomes, such as in autonomous vehicles or credit risk assessment. She references the MIT Moral Machine experiment from 2018, which polled people across 233 countries on ethical dilemmas, revealing significant cultural disparities in decision-making—for instance, Western cultures often favor saving the young, while Eastern cultures might prioritize saving the elderly. Bartolini notes that these differing cultural values make creating a universally applicable ethical framework for AI nearly impossible, as algorithms trained on biased data risk encoding systemic unfairness, as seen in credit scoring where algorithms might perpetuate historical biases against certain groups. She illustrates this by recounting a personal experience of fear when riding in a self-driving car without manual override. The speaker concludes that because universally accepted ethical rules do not exist, the responsibility falls on humans to actively choose and program the values into the AI, ensuring that the system is not merely replicating flawed historical data or cultural prejudices.

### Introduction to Ethical Dilemmas

- Speaker introduces the topic by referencing an incident involving self-driving cars and the ethical decision of whether the machine should prioritize the passenger or pedestrians (0:18).
- The speaker recounts a personal anecdote of being scared in a self-driving car because she could not control it (0:51).

### The Moral Machine Experiment

- Bartolini details the MIT 2018 Moral Machine experiment across 233 countries, highlighting diverse cultural responses to ethical choices (3:59).
- Cultural differences are shown, such as Western prioritization of the young versus Eastern prioritization of the old (4:40).

### Algorithmic Judgment and Bias

- The discussion shifts to credit scoring, where algorithms embed opinions in code (Cathy O'Neil quote), leading to systemic errors if based on flawed data (5:25).
- The danger is that these systems might perpetuate historical biases, resulting in unfair evaluations of individuals (8:48).

### The Path Forward

- Bartolini emphasizes that since universal ethical criteria are absent, humans must actively choose and program the values into the AI (12:22).
- The goal is to instruct the AI on what we value, rather than letting it learn from potentially discriminatory historical data (12:39).

![Screenshot at 00:03: The opening graphic featuring the event branding 'LEX MACHINA' in white and red against a black background.](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-00-03.png)
![Screenshot at 00:23: Title slide for Francesca Bartolini's talk: 'LEX MACHINA' with the subtitle 'La macchina giudica l'uomo' \(The machine judges man\).](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-00-23.png)
![Screenshot at 03:59: Slide contrasting two choices for a self-driving car: 'KILL PEDESTRIANS' vs. 'KILL PASSENGER,' posing the question of programming AI choices.](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-03-59.png)
![Screenshot at 05:25: Slide on 'Credit scoring' stating: 'Algorithms are opinions embedded in code' by Cathy O'Neil, illustrated by a scale weighing two individuals against a brain/chip icon.](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-05-25.png)
![Screenshot at 08:48: Slide titled 'Il 'giudizio' algoritmico' \(The algorithmic 'judgment'\), showing a judge figure beside a brain chip, a gavel, and 'GUILTY'/'NOT GUILTY' stamps.](https://ss.rapidrecap.app/screens/JEUodGsYQ4Y/00-08-48.png)