Paul and Grok (an LLM) examine fundamental aspects of large language models, focusing on how tokens and context windows operate. Tokens, defined as textual units (words or word pieces), are the basis for all model processing and cost calculations. The “context window” is described as the LLM’s short-term memory, determining how much information can be […]
Understanding Tokens, Context Windows, and Local LLM Hosting Read More »
Paul and Grok (an LLM) examine fundamental aspects of large language models, focusing on how tokens and context windows operate. Tokens, defined as textual units (words or word pieces), are the basis for all model processing and cost calculations. The “context window” is described as the LLM’s short-term memory, determining how much information can be
Understanding Tokens, Context Windows, and Local LLM Hosting Read More »
The episode examines how large language models (LLMs) like ChatGPT, Grok, and Gemini handle tasks through the concept of tokens and context windows. The discussion centers on how tokenization governs memory usage, cost structure, and the technical trade-offs between local and cloud deployment. Key insights include a breakdown of what tokens are, how different prompts
Understanding Tokens, Context Windows, and Local LLM Hosting Read More »
I am talking to AI.A successful day, you don’t need to know all the answers.Just have good questions.Chatting to AI is different from normal speechand I hope you enjoy listening to the showwhilst getting ideas on how to pose your questionsto get the most out of AI.My name is Paul.The live conversations you hear are
Asking AI about flying with a young baby Read More »
In this episode of Talking to AI, host Paul dives deep into the controversial changes brought by Bitcoin Core v30, which significantly increases the OPRETURN data limit in Bitcoin transactions. With the new upgrade, the allowable data in an OPRETURN field has jumped from 80 bytes to a staggering 100,000 bytes, enabling users to embed
Choosing a baby name is always tricky—but what happens when time is running out, and indecision meets inspiration from artificial intelligence? In this episode, host Paul dives deep into the baby-naming dilemma, using Grock, an AI assistant, to generate and refine the perfect name for his newborn daughter. With a real-world deadline—needing a name for
Naming the Unnamable: Picking a Baby Name with AI (and a Deadline!) Read More »
In this episode, Paul engages in a comprehensive investigation into the safety and potential risks of artificial sweeteners, featuring in-depth insights from Grock 4.1. The discussion kicks off by outlining the main types of artificial sweeteners—saccharin, aspartame, sucralose, neotame, acesulfame potassium, and stevia—detailing their pros, cons, and suitability for different dietary needs like diabetes and
Artificial Sweeteners: Myths, Risks, and Real Science—A Deep Dive with Grock 4.1 Read More »
In this episode, host Paul offers an in-depth, unfiltered exploration of Grok’s varied AI voice personalities and customizations, providing a live demonstration of what makes Grok uniquely engaging compared to other AI platforms like ChatGPT. Throughout the episode, Paul interacts with Grok in different modes—ranging from the meditative and motivational to the playful and even
Exploring Grok’s Personalities: A Hands-On Test of AI Voice Modes Read More »
In this episode of Talking to AI, Paul shares a candid, behind-the-scenes account of his journey automating podcast production from start to (almost) finish using artificial intelligence. Drawing on several months of hands-on experimentation and coding, he breaks down both the successes and challenges in building a semi- and then fully-automated workflow. From handling audio
Automating Podcast Production with AI: Lessons Learned and Real-World Challenges Read More »
In this episode of Talking to AI, Paul and his friend Mark attempt a Dungeons & Dragons session led by ChatGPT as their AI Dungeon Master. Building upon a detailed and ambitious prompt, they strive to see if AI can live up to the challenge of running an engaging and rule-abiding tabletop adventure. Despite hopes
Rolling the Dice with AI: Dungeon Master Disappointment in D&D Adventure Read More »