# Hugging Face: We got Claude to teach open models how to write CUDA kernels!

Source: https://www.youtube.com/watch?v=f_Foy0C87Zg
Recap page: https://rapidrecap.app/video/f_Foy0C87Zg
Generated: 2026-01-31T23:04:56.814+00:00

---
## Quick Overview

Researchers successfully adapted a large language model, Claude Opus, to teach smaller, local models how to write complex CUDA kernels, achieving a 35% performance lift over the baseline model by distilling expert knowledge.

**Key Points:**
- The research, released January 28, 2026, details a method where the large model, Claude Opus, teaches smaller models to write CUDA kernels.
- The technique involves the larger model interacting with the prompt, correcting outputs, pasting documentation bits, and guiding the smaller model through a three-step workflow.
- The smaller model, UNSLOTH GLM 4.5 Flash, running locally, achieved an 85% success rate on CUDA tasks after training, compared to a 50% baseline.
- This process resulted in a 35% performance lift for the small model compared to the baseline model running the same task.
- The method avoids fine-tuning the large model, instead treating the expert model (Opus) as a teacher that distills its knowledge into a reusable skill package.
- The success of this approach suggests a future where high-level AI performance can be ported to smaller, more accessible hardware, like the Nvidia H100.
- The authors suggest this method is more efficient than full fine-tuning and reduces the risk of vendor lock-in by creating a portable skill file.

![Screenshot at 00:06: The introductory graphic displays two podcasters with the text 'BECOME A MEMBER TODAY!' overlayed on a grid background, signaling the video's focus on sharing valuable, potentially subscription-gated, AI research.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-00-06.jpg)

**Context:** This video discusses a significant breakthrough in AI knowledge transfer, where a research team leveraged a highly capable, proprietary model (Claude Opus) to teach smaller, locally runnable models how to perform complex, low-level programming tasks, specifically writing CUDA kernels for GPUs. This process, dubbed 'Agent Skills,' aims to democratize high-level AI capabilities by distilling expert knowledge into portable skill files, bypassing the massive cost and complexity of retraining huge foundation models.

## Detailed Analysis

The video explains a new methodology for transferring specialized knowledge from large, powerful AI models to smaller, more accessible ones, focusing on the ability to write CUDA kernels. This research, released on January 28, 2026, by Ben Burtonshaw, Sean Smith, Merve, and Pedro Quinca, addresses the difficulty of high-precision programming tasks like writing CUDA kernels, which even large models like Claude Opus struggle with without specific guidance. The core idea is to create 'Agent Skills'—a set of files (like a skill.md and skill.json) that encapsulate expert knowledge. The process involves three steps: first, getting the teacher model (Claude Opus) to generate the raw material (the trace/log of the solution); second, using the skill tool to automate the process of distilling this trace into a transferable asset; and third, transferring this asset to the smaller model. When testing this method on a small, locally runnable model (UNSLOTH GLM 4.5 Flash), the performance on CUDA tasks jumped from a 50% pass rate (when simply asked) to an 85% pass rate when using the distilled skill file. This represents a 35% lift over the baseline model's performance. The key benefit is that this process is far more efficient than retraining the large model, reduces latency and cost, and prevents vendor lock-in by creating a portable file. The researchers suggest this trend points toward a future where complex AI capabilities are modular and accessible, rather than tied to massive, expensive foundation models.

### Paper Context and Goal

- Significant release from research team over at Hugging Face on January 28, 2026
- Goal is to teach open models how to write CUDA kernels
- Method is called 'Agent Skills'

### The Agent Skill Workflow

- Step 1 involves getting the teacher (Claude Opus) to generate a log/trace for an ideal problem
- Step 2 involves running the skill tool to convert this trace into a skill package (.md and .json files)
- Step 3 is the transfer to the smaller, target model

### Performance Results

- The small model (UNSLOTH GLM 4.5 Flash) jumped from 50% pass rate to 85% pass rate on CUDA tasks
- This is a 35% performance lift over the baseline model
- The teacher model (Opus) scored 100% on the same tasks

### Key Advantages

- Avoids full model retraining, which is slow and expensive for large models
- Creates a portable skill file asset, preventing vendor lock-in
- Engineer can audit the skill file logic for correctness, unlike black-box fine-tuning

### Future Implications

- Suggests a future where AI intelligence is modular and portable, moving away from dependence on raw model size

![Screenshot at 00:00: The video opens with a graphic featuring two podcasters and the call to action 'BECOME A MEMBER TODAY!' over a grid background, typical of an informational or research summary video.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-00-00.jpg)
![Screenshot at 00:13: The speakers explicitly mention the models involved, naming 'Claude' and the goal of teaching open models to write 'CUDA kernels'.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-00-13.jpg)
![Screenshot at 00:36: A visual of the three-step workflow is implied as the speakers discuss getting the raw material \(log trace\), distilling it, and transferring it.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-00-36.jpg)
![Screenshot at 01:55: The speaker describes the extracted knowledge as 'instructions written in markdown and some code in scripts,' highlighting the human-readable nature of the skill file.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-01-55.jpg)
![Screenshot at 05:04: The speaker transitions to discussing the results, asking if the process actually worked to improve performance.](https://ss.rapidrecap.app/screens/f_Foy0C87Zg/00-05-04.jpg)