I Tested This Week’s AI Tools (And Broke Them)

Quick Overview

This week's new AI tools, including ChatGPT's agent mode, InVideo's AI Twin, Hume AI's personality cloning, Runway's Act-Two motion capture, Decart's MirageLSD, Google's AI business calling, Mistral's deep research and audio models, and Amazon's Kiro IDE, demonstrate impressive capabilities but often exhibit significant bugs, slowness, or incomplete functionality upon release, indicating they are not yet fully polished for practical, complex tasks.

Key Points: ChatGPT's new agent mode, designed for complex multi-step tasks, failed to complete a detailed date night planning request after 16 minutes and produced a basic, outdated presentation for a website. InVideo's AI Twin feature successfully created a digital avatar of the presenter and integrated it into a product advertisement, demonstrating its utility for quick video creation and reshoots. Hume AI's personality cloning, which aims to mimic speaking style, resulted in an AI that talked excessively and did not perfectly replicate the user's voice, despite its quick cloning process. Runway's Act-Two motion capture model showed impressive facial animation but struggled with full-body tracking, leading to visual glitches like extra limbs on animated characters. Decart's MirageLSD is a novel live-stream diffusion AI model that reskins live video in real-time based on text prompts, offering various stylistic transformations, though it still exhibits visual artifacts. Google's new AI-powered business-calling feature, designed to make calls on users' behalf, was not available for the presenter to demo, indicating limited public access at launch. Mistral AI released Voxstral, an open-source audio model capable of transcribing up to 40 minutes of audio for a very low cost (0.0001 cents per minute), making it a highly affordable transcription solution.

Context: In a rapidly evolving AI landscape, new tools are constantly emerging with ambitious claims. The presenter aims to cut through the hype by personally testing these latest AI advancements, providing honest feedback on their current functionality and practical utility. This week's focus is on a diverse range of tools, from autonomous agents to voice cloning and real-time video manipulation, highlighting both their impressive potential and their current limitations.

Raw markdown version of this recap