EP52: The Groq Breakthrough, Google's Gemma 7B, Unlimited Context, Can 'Magic' Reason?

Show notes: https://thisdayinai.com/bookmarks/32-ep52 Groq Mixtral: https://simtheory.ai/agent/567-groq-mixtral-edition Groq Llama: https://simtheory.ai/agent/566-groq-the-speed-oriented-chat-companion SimTheory: https://simtheory.ai ==== This week we discuss Groq's LPU Chips and the implications of low cost low latency LLMs on custom hardware. We revisit our prank calling to see if Groq's low latency gives an advantage and see if we can improve Air Canada's chatbot. We discuss the launch of Google's Open Source Gamma 7B release and Magic's $148M fundraise for an AI co-worker who can reason. We also cover ChatGPT losing it's mind during the week. If you like the show, please consider subscribing. Thanks for listening. ==== Chapters: 00:00 - Groq, Groq API and Retell with Groq 32:48 - Google Gemma 7B Open Source Model 39:04 - The 'Magic' Breakthrough on Reasoning and Context 50:19 - Sounds for OpenAI Sora Thanks to ElevenLabs Sound FX 51:59 - ChatGPT Goes Haywire