📆 ThursdAI - Aug 21 - New DeepSeek V3.1, Cohere CMD-A Reasoning, Qwen Edit, Nano 🍌 & more AI news

Quick Overview

This episode of "ThursdAI" covers significant AI news, with the primary focus on the release of DeepSeek V3.1, a hybrid reasoning model that aims to be faster and more efficient than its predecessor, R1. Other key releases discussed include Cohere's Command R (reasoning model with open weights), ByteDance's Seed OSS (36B parameter model with a half-million token context window), and NVIDIA's Neotrons Nano 9B V2 (mixed Mamba/Transformer architecture). The hosts also touched upon advancements in image editing models from Quen, IBM/NASA's Surya model for solar weather prediction, and the potential "nerfing" of GPT-4's context window by OpenAI.

Key Points: DeepSeek released V3.1, a hybrid reasoning model that is faster and achieves similar or better results than the R1 model, with significant improvements in coding benchmarks like SWEBench Verified (66 vs 44) and Terminal Bench (31 vs 5.7). ByteDance launched Seed OSS, a 36 billion parameter model with Apache 2 license and a half-million token context window, showing impressive performance, including 82.7% on MMLU Pro for the instruct version. Cohere released Command R, a reasoning model with open weights (non-commercial/research license), demonstrating strong performance on function calling (70% on BFCL) and tool use benchmarks. NVIDIA released Neotrons Nano 9B V2, a 9 billion parameter model with a mixed Mamba/Transformer architecture, boasting a 6x higher throughput and enabling inference over 128K tokens on a single GPU. Quen released an image editing model, a 20 billion parameter model on top of their previous image model, and the return of their Capybara mascot was noted. The hosts discussed the trend towards agentic use cases across all AI models and providers, highlighting the increasing utility and efficiency of AI for real-life applications. OpenAI confirmed a bug causing GPT-4's context window to truncate long prompts, which they are working to fix.

Context: This episode of "ThursdAI" is a weekly AI news roundup, hosted by Alex Walov, with regular contributors Wolf from and Nist, joined by Yam. The discussion centers on the latest open-source AI model releases and updates. The hosts provide commentary and analysis on the technical specifications, performance benchmarks, and licensing of these models, offering insights into the rapidly evolving AI landscape. The episode was recorded on August 21st.