# Build Hour: AgentKit

Source: https://www.youtube.com/watch?v=sAitLFLbgDA
Recap page: https://rapidrecap.app/video/sAitLFLbgDA
Generated: 2025-10-29T20:31:48.98+00:00

---
## Quick Overview

OpenAI's AgentKit, demonstrated in the 'OpenAI Build Hours' session, is a full-stack platform designed to simplify the creation, deployment, and optimization of AI agents, offering visual workflow orchestration, built-in evaluation tools, and custom UI widgets to streamline development compared to using the Agents SDK directly.

**Key Points:**
- AgentKit transforms agent development from months of orchestration and custom code into hours, slashing iteration cycles by 70% and enabling deployment in two sprints instead of two quarters.
- The platform supports a full-stack development process including 'Build' (Agent Builder), 'Deploy' (ChatKit), and 'Optimize' (Evals).
- A 'Question Classifier Agent' was demonstrated to categorize user queries (e.g., 'qualification', 'data', or 'email') to route workflows correctly.
- The Data Analysis Agent showed the ability to connect to external data sources like Databricks via the MCP Server tool and output structured JSON.
- The workflow demonstrated conditional logic (If/Else) based on the output of the classifier agent to direct queries to the appropriate downstream agent (Data Analysis Agent for 'data' queries or an Email Agent for 'email' queries).
- AgentKit supports custom response widgets, demonstrated with a utility bill analysis example that rendered an interactive chart instead of static text.
- The evaluation framework features 'graders' that allow users to define criteria (like requiring only first-party sources) to automatically score agent performance, ensuring better alignment with desired behavior.

![Screenshot at 0:05: The introductory slide clearly labels the session as 'OpenAI Build Hours' focusing on the 'AgentKit' product, introducing the key team members.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-00-05.png)

**Context:** This video is an 'OpenAI Build Hours' session featuring Tasha (Product Marketing Manager) and Samarth (Applied AI Startups) from the platform team, joined by Henry Scott-Green (Product Platform) from the UK, to introduce and demonstrate OpenAI's AgentKit, a new framework for building, deploying, and optimizing AI agents.

## Detailed Analysis

The session introduces AgentKit as a full-stack development platform aimed at streamlining the creation of AI agents, contrasting it with the more granular Agents SDK. The workflow of AgentKit involves three main phases: Build (using the Agent Builder), Deploy (using ChatKit for hosting), and Optimize (using Evals). The presenters demonstrated building a multi-step agent workflow in AgentKit's visual builder environment. This workflow started with a 'Question Classifier Agent' to categorize incoming user queries into three types: 'qualification', 'data', or 'email'. Based on this classification, the workflow branched: data-related queries were routed to a 'Data Analysis Agent' which connected to an external MCP (Multi-Cloud Platform) server (Databricks) using secure authentication, while email-related queries went to an 'Email Agent'. The demonstration highlighted the ability to define structured JSON output for agents, which feeds into subsequent nodes, making the entire workflow deterministic where necessary. Furthermore, AgentKit supports custom response widgets, exemplified by a utility bill analysis that rendered an interactive chart instead of plain text. The evaluation (Evals) system was also detailed, showing how custom graders can be defined and applied to traces to ensure agents meet specific criteria, such as only using first-party data sources, which significantly accelerates the iteration and testing process for building robust, production-ready agents. Testimonials from partners like Rippling and HubSpot highlighted significant efficiency gains (up to 70% reduction in iteration cycles) achieved by using AgentKit.

### AgentKit Overview

- AgentKit offers a full-stack approach (Build, Deploy, Optimize)
- Simplifies agent development compared to SDK
- Agents are deployed via ChatKit or self-hosted.

### Agent Workflow Demonstration

- Workflow used a Classifier Agent to route queries to specialized agents (Data Analysis Agent, Email Agent)
- Conditional logic (If/Else) based on classification output
- Agents can utilize external tools like Databricks via MCP Server.

### Agent Customization and Evaluation

- Agents support structured JSON output and custom widgets (e.g., charts) for richer user experiences
- Evals framework allows defining custom graders to evaluate agent performance against specific criteria (e.g., source verification).

### Customer Success Stories

- Rippling achieved a 40% cut in cycle time from idea to validated agent using the Agent Builder + Eval loop
- HubSpot saved weeks of front-end work prototyping UI enhancements for their agents.

![Screenshot at 0:05: The introductory slide labeling the session as 'OpenAI Build Hours' about 'AgentKit' and introducing the speakers.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-00-05.png)
![Screenshot at 0:19: The initial slide outlining the goal to empower builders with best practices, tools, and AI expertise using OpenAI APIs and models.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-00-19.png)
![Screenshot at 1:02: The 'Before' slide detailing the difficulties of building agents without AgentKit: complex orchestration, custom code for tools, slow prompt optimization, and slow UI development.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-01-02.png)
![Screenshot at 1:49: The 'After' slide summarizing AgentKit's benefits: visual, versioned workflow orchestration, admin center, built-in Evals, automated prompt optimization, and custom UI.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-01-49.png)
![Screenshot at 2:31: The AgentKit stack overview: Build \(Agent Builder\), Deploy \(ChatKit\), Optimize \(Evals\), illustrating the end-to-end nature of the platform.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-02-31.png)
![Screenshot at 4:48: Henry transitions to demonstrating a complex workflow in Agent Builder, showing multiple interconnected agent nodes.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-04-48.png)
![Screenshot at 6:55: Demonstration of setting structured JSON output for the 'Question Classifier Agent' to ensure deterministic output for downstream nodes.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-06-55.png)
![Screenshot at 11:48: A complex workflow diagram is visible, showing branching logic originating from an 'If Else' node, leading to different specialized agents.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-11-48.png)
![Screenshot at 21:41: Switch to the ChatKit Studio Playground showing a visual widget output \(a bar chart comparing energy usage\) generated by an agent.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-21-41.png)
![Screenshot at 37:36: A slide summarizing testimonials, highlighting that Agent Builder cut the idea-to-validated-agent cycle by 40% for Rippling.](https://ss.rapidrecap.app/screens/sAitLFLbgDA/00-37-36.png)