A Workflow for Full Traceability of AI Decisions

Quick Overview

The proposed workflow for full AI decision traceability, exemplified by the Fung AI model, relies on two phases: training and inference, using a cryptographically secured, tamper-proof, and auditable system called DEBOMB (Decision Bill of Material) to ensure every input, process step, and output is verifiably linked to the original, untampered components, thereby resolving accountability gaps and providing crucial evidence for regulatory compliance.

Key Points: The proposed workflow divides AI decision traceability into two phases: Training and Inference. The core solution is DEBOMB (Decision Bill of Material), which creates a cryptographically secured and tamper-proof record of the entire AI process. DEBOMB documents every component, including raw model output, intermediate activations, training data, hyperparameters, and final probability scores. The system ensures that for high-stakes decisions, like medical diagnoses, the resulting artifact is verifiable against the original, untampered code and data. The Fung AI model case study showed its training phase was 157 times slower than a highly optimized baseline, illustrating the performance penalty for rigorous security. The integrity of the system is guaranteed because the hardware itself validates the process, meaning even the model owner cannot tamper with the audit trail. The ultimate goal is to provide a granular, auditable trail that connects every decision back to its source components, satisfying regulatory demands for transparency and accountability.

Context: The video introduces a complex problem facing AI deployment, particularly in high-stakes fields like medical diagnosis: the lack of transparency and accountability when an AI decision proves harmful or inaccurate. The speakers discuss the urgent need for a workflow that guarantees full traceability, ensuring that decisions are not only verifiable but also demonstrably untampered, addressing the inherent trust gap between AI systems and human auditors or regulators.