Chain of Thought | AI Agents, Infrastructure & Engineering
Alle afleveringen
82 afleveringen, van nieuw naar oud
-
Architecting Reliable Agentic AI | Cisco’s Giovanna Carofiglio on the AGNTCY Collective
9 juli 2025 · 41 min
The Internet of Agents is rapidly taking shape, necessitating innovative foundational standards, protocols, and evaluation methods for its success. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/31-architecting-reliable-agentic-ai-ciscos-giovanna-carofiglio-on-the-agntcy-collective/
Recorded at Cisco's office in San Jose, we welcome Giovanna Carofiglio, Distinguished Engineer and Senior Director at Outshift by Cisco. As a leader of the AGNTCY Collective (an open-source initiative by Cisco, Galileo, LangChain, and many other participating companies), Giovanna outlines the vision for agents to collaborate seamlessly across the enterprise and the internet. She details the collective's pillars, from agent discovery and deployment using new agentic protocols like Slim, to ensuring a secure, low-latency communication transport layer. This groundbreaking work aims to make distributed agentic communication a reality.
The conversation then explores the critical role of observability and evaluation in building trustworthy agent applications, including defining an interoperable standard schema for communications. Giovanna highlights the complex challenges of scaling agents to thousands or millions, emphasizing the need for robust security (agent identity with OSF schema) and predictable agent behavior through extensive testing and characterization. She distinguishes between protocols like MCP (agent-to-tool) and A2A (agent-to-agent), advocating for open standards and underlying transport layers akin to TCP.
Chapters:
00:00 Introduction
01:00 Overview of Agent Interoperability
02:20 What is AGNTCY
03:45 Agent Discovery and Composition
04:38 Agent Protocols and Communication
05:45 Observability and Evaluation
07:00 Metrics and Standards for Agents
09:45 Challenges in Agent Evaluation
14:15 Low Latency and Active Evaluation
23:34 Synthetic Data and Ground Truth
25:07 Interoperable Agent Schema
26:37 MCP & A2A
30:17 Future of Agent Communicatio…
-
Taste Is The New Moat: Why Customer Obsession Wins in the AI Era | Bharat Vasan, Intangible
2 juli 2025 · 53 min
When AI makes creating content and code nearly free, how do you stand out? Differentiation now hinges on two things: unique taste and effective distribution. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/30-taste-is-the-new-moat-why-customer-obsession-wins-in-the-ai-era/
This week, Bharat Vasan, founder & CEO at Intangible and a "recovering VC," explains why the AI landscape compelled him to return to founding. He sees AI sparking a new creative revolution, similar to the early internet, that makes it easier than ever to bring ideas to life. The conversation delivers essential advice for founders, revealing why relentless shipping is the ultimate clarifier for a business and why resilience, not just intelligence, is the key to survival.
Drawing from his experience on both sides of the venture table, Bharat breaks down the brutally competitive VC landscape and shares Intangible's mission: to simplify 3D creative tools with AI, finally bridging the gap between human vision and machine power. Listeners will gain insights on company building, brand strategy, and why customer obsession is the ultimate moat in the AI age.
Chapters:
00:00 Introduction
00:45 From Founder to VC and Back
03:17 Human Creativity in the Age of AI
07:50 The Role of Taste and Distribution
11:49 Building a Brand in the AI Era
16:17 The Venture Capital Landscape for AI Startups
20:11 Advice for Founders in the AI Boom
23:55 Incumbents vs. Startups
27:10 The New Generation of Innovators
29:19 Pirate Mentality in Startups
30:00 Building a Brand
36:28 Shipping and Resilience
41:49 Customer Obsession
46:58 The Vision for Intangible
51:52 Conclusion
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
Connect with Bharat on LinkedIn.
Follow Bharat…
-
The Emerging AI Agent Stack | CrewAI’s João Moura
25 juni 2025 · 50 min
Unlocking AI agents for knowledge work automation and scaling intelligent, multi-agent systems within enterprises fundamentally requires measurability, reliability, and trust. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/29-the-emerging-ai-agent-stack-crewais-jo-o-moura/
João Moura, founder & CEO of CrewAI, joins Galileo’s Conor Bronsdon and Vikram Chatterji to unpack and define the emerging AI agent stack. They explore how enterprises are moving beyond initial curiosity to tackle critical questions around provisioning, authentication, and measurement for hundreds or thousands of agents in production. The discussion highlights a crucial "gold rush" among middleware providers, all racing to standardize the orchestration and frameworks needed for seamless agent deployment and interoperability. This new era demands a re-evaluation of everything from cloud choices to communication protocols as agents reshape the market.
João and Vikram then dive into the complexities of building for non-deterministic multi-agent systems, emphasizing the challenges of increased failure modes and the need for rigorous testing beyond traditional software. They detail how CrewAI is democratizing agent access with a focus on orchestration, while Galileo provides the essential reliability platform, offering advanced evaluation, observability, and automated feedback loops. From specific use cases in financial services to the re-emergence of core data science principles, discover how companies are building trustworthy, high-quality AI products and prepare for the coming agent marketplace.
Chapters:
00:00 Introduction and Guest Welcome
02:04 Defining the AI Agent Stack
03:49 Challenges in Building AI Agents
05:52 The Future of AI Agent Marketplaces
06:59 Infrastructure and Protocols
09:05 Interoperability and Flexibility
20:18 Governance and Security Concerns
24:12 Industry Adoption and Use Cases
25:57 Unlocking Faster Development with Success Metrics
28:40 Ch…
-
AMD's Challenge to NVIDIA: The Open Ecosystem Bet | Anush Elangovan & Sharon Zhou
18 juni 2025 · 49 min
How is an open ecosystem powering the next generation of AI for developers and leaders? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/28-amds-challenge-to-nvidia-the-open-ecosystem-bet-anush-elangovan-and-sharon-zhou/
Broadcasting live from the heart of the action at AMD's Advancing AI 2025, Chain of Thought host Conor Bronsdon welcomes AMD’s Anush Elangovan, VP of AI Software, and Sharon Zhou, VP of AI. They unpack AMD's groundbreaking transformation from a hardware giant to a leader in full-stack AI, committed to an open ecosystem. Discover how new MI350 GPUs deliver mind-blowing performance with advanced data types and why ROCm 7 and AMD Developer Cloud offer Day Zero support for frontier models.
Then Conor welcomes Sharon Zhou, VP of AI at AMD, to discuss making AMD's powerful software stack truly accessible and how to drive developer curiosity. Sharon explains strategies for creating a "happy path" for community contributions, fostering engagement through teaching, and listening to developers at every stage. She shares her predictions for the future, including the rise of self-improving AI, the critical role of heterogeneous compute, and the potential of "vibes based feedback" to guide models. This vision for democratizing access to high-performance AI, driven by a deep understanding of the developer journey, promises to unlock the next generation of applications.
Chapters:
00:00 Live from AMD's Advancing AI 2025 Event
00:30 Introduction to Anush Elangovan
01:38 The MI350 GPU Series Unveiled
04:57 CDNA4 Architecture Explained
07:00 The Future of AI Infrastructure
08:32 AMD's Developer Cloud and ROCm 7
11:50 Cultural Shift at AMD
14:48 Open Source and Community Contributions
18:35 Software Longevity and Ecosystem Strategy
22:19 AI Agents and Performance Gains
27:36 AI's Role in Solving Power Challenges
28:11 Thanking Anush
28:42 Introduction to Sharon Zhou
29:45 Sharon's Focus at AMD
30:39 Engaging Developers with AMD's AI…
-
Your Key to AI Success is Hiding in Plain Sight | Cohesity's Greg Statton
11 juni 2025 · 46 min
What if the most valuable data in your enterprise—the key to your AI future—is sitting dormant in your backups, treated like an insurance policy you hope to never use? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/27-your-key-to-ai-success-is-hiding-in-plain-sight-cohesitys-greg-statton/
Join Conor Bronsdon with Greg Statton, VP of AI Solutions at Cohesity, for an inside look at how they are turning this passive data into an active asset to power generative AI applications. Greg details Cohesity’s evolution from an infinitely scalable file system built for backups into a data intelligence powerhouse, managing hundreds of exabytes of enterprise data globally. He recounts how early successes in using this data for security and anomaly detection paved the way for more advanced AI applications. This foundational work was crucial in preparing Cohesity to meet the new demands of generative AI.
Greg offers a candid look at the real-world challenges enterprises face, arguing that establishing data hygiene and a cross-functional governance model is the most critical step before building reliable AI applications. He shares the compelling story of how Cohesity's focus on generative AI was sparked by an internal RAG experiment he built to solve a "semantic divide" in team communication, which quickly grew into a company-wide initiative. He also provides essential advice for data professionals, emphasizing the need to focus on solving core business problems.
Chapters:
00:00 Introduction
00:36 The Role of Gaming in AI Development
05:43 Personal Gaming Experiences
08:26 The Intersection of AI and Gaming
12:53 Importance of Data in Game Development
19:03 User Testing and QA in Gaming
25:49 Postmortems and Telemetry
27:21 Beta Testing and Data Preparedness
29:18 Traditional AI vs Generative AI
31:31 Challenges of Implementing AI in Games
35:57 Leveraging AI for Data Analytics
39:41 Automated QA and Reinforcement Learning
42:01 AI for Localizatio…
-
Why Gamers Paved the Way for AI | Databricks' Carly Taylor
4 juni 2025 · 49 min
What if the pixels and polygons of your favorite video games were the secret architects of today's AI revolution? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/26-why-gamers-paved-the-way-for-ai-databricks-carly-taylor/
Carly Taylor, Field CTO for Gaming at Databricks and founder of ggAI, joins host Conor Bronsdon to illuminate the direct line from video game innovation to the current AI landscape. She explains how the gaming industry's relentless pursuit of better graphics and performance not only drove pivotal GPU advancements and cost reductions, but also fundamentally shaped our popular understanding of artificial intelligence by popularizing the very term "AI" through decades of in-game experiences. Carly shares her personal journey, from a childhood passion for games like Rollercoaster Tycoon ignited while playing with her mom, to becoming a data scientist for Call of Duty.
The discussion then confronts a long-standing tension in game development: how the critical need to ship titles often relegates vital game data to a secondary concern, a dynamic Carly explains is now being reshaped by AI. She details the inherent challenges game studios face in capturing and leveraging telemetry, from disparate development processes to the lengthy pipeline required for updates. Carly illuminates how modern AI, particularly generative AI, presents a massive opportunity for studios to finally unlock their vast data troves for everything from self-service analytics and community insight generation to revolutionizing QA processes. This pivotal intersection of evolving game data practices and new AI capabilities is poised to redefine how games are made, understood, and ultimately experienced.
Chapters
00:00 Introduction
00:28 The Role of Gaming in AI Development
05:35 Personal Gaming Experiences
08:18 The Intersection of AI and Gaming
12:45 Importance of Data in Game Development
18:55 User Testing and QA in Gaming
25:41 Postmortems and Telemetry
…
-
The 2025 AI Shift: From Chat to Task Completion & Reliable Action | Galileo Founders
28 mei 2025 · 45 min
AI in 2025 promises intelligent action, not just smarter chat. But are enterprises prepared for the agentic shift and the complex reliability hurdles it brings? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/25-the-2025-ai-shift-from-chat-to-task-completion-and-reliable-action-galileo-founders/
Join Conor Bronsdon on Chain of Thought with fellow co-hosts and Galileo co-founders, Vikram Chatterji (CEO) and Atindriyo Sanyal (CTO), as they explore this pivotal transformation. They discuss how generative AI is evolving from a simple tool into a powerful engine for enterprise task automation, a significant advance driving the pursuit of substantial ROI. This shift is also fueling what Vikram observes as a "gold rush" for middleware and frameworks, alongside healthy skepticism about making widespread agentic task completion a practical reality.
As these AI systems grow into highly complex, compound structures—often incorporating multimodal inputs and multi-agent designs—Vikram and Atin address the critical challenges around debugging, achieving reliability, and solving the profound measurement problem. They share Galileo's vision for an AI reliability platform designed to tame these intricate systems through robust guardrailing, advanced metric engines like Luna, and actionable developer insights. Tune in to understand how the industry is moving beyond point-in-time evaluations to continuous AI reliability, crucial for building trustworthy, high-performing AI applications at scale.
Chapters
00:00 Welcome and Introductions
01:05 Generative AI and Task Completion
02:13 Middleware and Orchestration Systems
03:17 Enterprise Adoption and Challenges
05:55 Multimodal AI and Future Plans
08:37 AI Reliability and Evaluation
11:08 Complex AI Systems and Developer Challenges
13:45 Galileo's Vision and Product Roadmap
18:59 Modern AI Evaluation Agents
20:10 Galileo's Powerful SDK and Tools
21:24 The Importance of Observability and Robust Testing
22…
-
Amplitude's AI Playbook: How Wade Chambers Builds for the Agentic Future
21 mei 2025 · 47 min
As AI redefines how products are built and customers are understood, what are the core strategies engineering leaders use to drive innovation and create lasting value? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/24-amplitudes-ai-playbook-how-wade-chambers-builds-for-the-agentic-future/
Join Conor Bronsdon as he welcomes Wade Chambers, Chief Engineering Officer at Amplitude, to explore these critical questions. Wade shares how Amplitude is leveraging AI to deepen customer understanding and enhance product experiences, transforming raw data into actionable insights across their platform. He also discusses their approach to navigating constant change while building an adaptable, high-performing engineering culture that thrives in the current AI landscape.
The conversation explores Amplitude's strategy for building a sustainable AI advantage through proprietary data, deep domain expertise, and robust feedback loops, moving beyond superficial AI applications. Wade offers insights on fostering an AI-ready engineering culture through empowerment and clear alignment, alongside exploring the exciting potential of agentic AI to create proactive, intelligent copilots for product teams. He then details Amplitude’s successful approach to integrating specialized AI talent, drawing key lessons from their acquisition of Command AI.
Chapters
00:00 Introduction and Guest Welcome
01:55 Understanding and Acting on Data with AI
06:42 Amplitude's Unique Position in the Market
08:36 Differentiation and Competitive Advantage
09:58 Incorporating Customer Feedback
12:48 Evaluating AI Outcomes
17:21 Agentic AI and Future Prospects
21:38 Acquiring and Integrating AI Talent
28:44 Building a Culture of Innovation
37:21 Advice for Leaders and Individual Contributors
43:26 The Future of AI in the Workplace
45:38 Closing Thoughts
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/C…
-
First Code, Then AGI: Software’s Event Horizon with Poolside Founders Jason Warner & Eiso Kant
14 mei 2025 · 51 min
Is the prevailing approach to Artificial General Intelligence (AGI) missing a crucial step – deep, focused specialization? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/23-first-code-then-agi-softwares-event-horizon-with-poolside-founders-jason-warner-and-eiso-k/
For the first time since co-founding Poolside, CEO Jason Warner & CTO Eiso Kant reunite on a podcast articulating their distinct vision for AI's future with our host, Conor Bronsdon. Poolside has intentionally diverged from general-purpose models, developing highly specialized AI meticulously designed for the specific, complex task of coding, viewing it as a direct and robust pathway towards achieving AGI, and revolutionizing how software is created.
Jason and Eiso dive deep into the core tenets of their strategy: an unwavering conviction in reinforcement learning through code execution feedback and the burgeoning power of synthetic data, which they believe will help expand the surface area of software by an astounding 1000x. They candidly discuss the "devil's trade" of data privacy, Poolside's commitment to enterprise-grade AI for high-consequence systems, and why true innovation requires moving beyond flashy demos to solve real-world, critical challenges.
Looking towards the horizon, they also share their insights on the evolving role of software engineers, where human agency, taste, and judgment become paramount in a landscape augmented by AI "coworkers." They also explore the profound societal implications of their work and the AI industry more generally, touching upon the "event horizon" of intelligent systems and the immense responsibility that comes with being at the forefront of this technological wave.
Chapters
00:00 Introduction and Guest Welcome
01:19 Founding of Poolside
02:56 Vision for AGI and Reinforcement Learning
05:36 Defining AGI and Its Implications
10:03 Training Models for Software Development
17:08 Scaling and Synthetic Data
20:12 Focus on High-Consequ…
-
AI's Two Extremes – Foundations & The Frontier | Databricks’ Denny Lee
7 mei 2025 · 44 min
The AI landscape often pulls us between the allure of cutting-edge models and the quiet necessity of foundational work—yet how do these extremes actually connect to deliver value? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/22-ais-two-extremes-foundations-and-the-frontier-databricks-denny-lee/
Join Conor Bronsdon as he welcomes Denny Lee, a self-proclaimed "data nerd" and Product Management Director, Developer Relations at Databricks, to unpack this very spectrum, from AI's core infrastructure to its most advanced applications. Denny explains why robust logging, tracing, and data lineage are indispensable for credible AI evaluation and feedback, ultimately making AI systems more affordable, accessible, and impactful.
The discussion ventures into strategies for democratizing AI, exploring the "GenAI ladder" from efficient inference and retrieval-augmented generation to deciding when to fine-tune or pre-train models. Denny also tackles the industry's pressing hardware bottlenecks, the critical role of open standards, and the imperative of navigating data privacy in an increasingly AI-driven world. Listen for grounded advice on moving beyond the hype and making practical, value-driven decisions in your AI journey.
Chapters
00:00 Introduction and Guest Welcome
01:31 Diving into AI Foundations
02:25 Importance of Logging and Tracing
08:40 Challenges in Data Quality and Lineage
14:49 Strategies for Cost-Effective AI
19:52 Partnerships and Collaborative Opportunities
22:10 Hardware Bottlenecks in AI
24:56 China's Power and Networking Advantage
25:26 Nvidia's Super Chip and Network Fabrics
26:39 The Growing Demand for Power in AI
29:26 Practical Advice for Data Governance
35:47 Understanding Privacy in AI
36:25 Differential Privacy and Its Challenges
41:57 Conclusion
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.l…
-
Why Enterprises Need a Different Approach to AI Agents | Lyzr’s Siva Surendira
30 april 2025 · 39 min
Agentic AI exploded in 2025, but how do businesses move beyond prototypes to deploy reliable, valuable agents at scale? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/21-why-enterprises-need-a-different-approach-to-ai-agents-lyzrs-siva-surendira/
Join host Conor Bronsdon and Lyzr AI CEO Siva Surendira as they discuss the complexities of building and managing AI agents for enterprises. Siva shares his journey creating Lyzr, focusing on making powerful agent frameworks accessible and trustworthy for enterprise developers. They discuss the critical hurdles businesses face, including productionization challenges, ensuring responsible AI, and bridging the gap between rapid innovation and the stringent requirements of regulated industries.
Listen as Siva explains Lyzr's approach to embedding safety guardrails natively and learn about the nuances of multi-agent orchestration, including managerial, DAG, and hybrid flows. Siva also offers insights into the limitations of "vibe coding" for enterprise use cases and stresses the crucial role of robust evaluation (evals) and choosing the right models—from local open-source options to frontier LLMs. Explore the bottlenecks hindering adoption, like custom application integration and data readiness, and learn why Siva believes the biggest opportunity for agent companies may not lie in replacing SaaS platforms but rather in automating the mundane work currently performed by humans.
Chapters
00:22 Introduction and Guest Welcome
00:52 Enterprise Agent Framework
02:48 Building Enterprise-Friendly AI Frameworks
04:56 Enterprise Concerns with Vibe Coding
09:23 Safe and Responsible AI Implementation
11:05 Multi-Agent Orchestration
14:13 Challenges in Multi-Agent Systems
14:22 Enterprise Integration Bottlenecks
17:37 The Role of Low-Code and No-Code Solutions
19:55 Inter-Agent Communication Standards
21:49 Future of AI Agents in Enterprises
29:37 Evaluating AI Agents
36:34 Conclusion and Final Thoughts
… -
Breaking the Language Barrier: Smartling's AI Translation Pipeline | Olga Beregovaya
23 april 2025 · 41 min
Are we on the verge of removing all language barriers with AI? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/20-breaking-the-language-barrier-smartlings-ai-translation-pipeline-olga-beregovaya/
Olga Beregovaya, VP of AI at Smartling, joins host Conor Bronsdon to tackle this question, discussing the evolution from rule-based NLP to today's powerful LLMs. Together, they confront the persistent challenges that stand in the way, like the English-centric nature of AI, domain-specific inaccuracies, and the unpredictability of model hallucinations. Olga unpacks the difficulties faced when striving for accurate, nuanced translation across all languages, especially under-resourced ones.
Beyond these hurdles, the conversation explores the cutting-edge opportunities and technical innovations driving progress, including RAG, the rise of purpose-built models, agentic AI workflows, and the potential of multilingual multimodality. Olga shares insights into boosting translator productivity, achieving more predictable quality, and the path toward human parity in translation, examining how technology and human expertise will shape the future of global communication.
Chapters
00:00 Introduction and Guest Welcome
01:14 Evolution of NLP: From Rule-Based to Machine Learning
02:40 Challenges in AI Translation
04:21 Biases in Language Models
05:28 Inference Time and Latency
05:44 English-Centric AI Models
08:53 Opportunities in AI Translation
09:14 Industries Benefiting from Language AI
10:36 Human-in-the-Loop Translation
12:06 Architectural Innovations in Language AI
16:20 Success with RAG Architectures
17:58 Multilingual Vectorization
19:54 Agentic AI in Translation
24:35 Data Sets and Data Privacy
28:30 Using Smaller, Purpose-Built Models
32:10 Future of AI in Translation
36:37 Conclusion and Farewell
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
…
-
Low-Code AI: From Requirements to Apps in Minutes | OutSystems' Rodrigo Coutinho
16 april 2025 · 40 min
What if you could turn a requirement document into a full enterprise application in just minutes? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/19-low-code-ai-from-requirements-to-apps-in-minutes-outsystems-rodrigo-coutinho/
Rodrigo Coutinho, co-founder and AI Product Manager at OutSystems, joins hosts Conor Bronsdon and Atin Sanyal to explore this new reality of AI-driven development. Rodrigo shares insights from OutSystems' nearly 25-year journey, detailing their early adoption of AI and the development of their AI platform, Mentor. Discover how the pairing of AI and low-code empowers developers, accelerates the creation of enterprise applications, and shortens the cycle from idea to deployment.
But this newfound speed brings its own set of challenges. The discussion addresses the hurdles of managing AI-generated code, contrasting experiences with traditional versus low-code approaches. Learn why a dev's focus pivots from syntax to strategy, pinpointing human creativity and ideation as the crucial limiter in today's development lifecycle.
Chapters
00:00 Welcoming Rodrigo Coutinho of OutSystems
01:30 OutSystems' Early AI Journey (Pre-LLM)
03:30 The LLM Revolution & OutSystems Mentor Emerges
07:30 The Critical Need for Validating AI-Generated Apps
12:00 The Shifting Role of the Modern Developer
13:30 Quality Control & Accountability in the AI Era
16:00 Low-Code's Edge in AI Validation
18:30 OutSystems Mentor: A Deeper Look
23:30 Choosing the Right AI Models (In-House vs Public)
27:30 Future Opportunities: Speed, Experimentation & Multimodal AI
37:00 The Use Case Hurdle & Final Thoughts
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
Website www.outsystems.com
OutSystems Mentor
LinkedIn Rodrigo Sousa Coutinh…
-
AI Won't Solve Your Toughest Engineering Problems | Honeycomb’s Charity Majors
9 april 2025 · 42 min
Generative AI dominates the conversation, but does it actually make it easier to build, lead, and sustain high-performing engineering teams? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/18-ai-wont-solve-your-toughest-engineering-problems-honeycombs-charity-majors/
Host Conor Bronsdon sits down with Charity Majors, co-founder and CTO of Honeycomb (.io), and the mind behind charity.wtf. Known for her sharp insights and unfiltered opinions, Charity kicks off the discussion by expanding on her popular article: 'Generative AI is not going to build your engineering team for you.' Together, they explore how AI has altered the dynamics for engineering teams and leaders.
The discussion navigates the complex dynamics of hiring in an AI-enabled era, challenging the "senior-only" trend and championing the vital role of junior engineers in creating learning organizations. Charity also explains why writing code is often the "easy part" compared to the full lifecycle of owning and operating systems, a challenge amplified by AI-generated code.
Finally, Conor and Charity discuss the risk of "cognitive decay" from over-reliance on AI tools and why fostering deep system understanding remains paramount for engineers and leaders.
Chapters
00:00 Introduction and Guest Welcome
01:51 Generative AI and Engineering Teams
02:26 The Writing Process and Inspiration
03:49 AI's Impact on Hiring and Team Building
05:30 Embracing AI and Automation
07:43 The Role of Junior Engineers
09:33 Building Effective Engineering Teams
17:01 Future of AI in Code Generation
20:07 High Performing Engineering Teams
21:48 Evolving Expectations for Engineering Managers
22:41 Cognitive Decay
25:00 Feedback Loops in Software Systems
26:56 Hiring for Potential vs. Experience
29:17 The Future of Observability
39:50 Closing Thoughts and Advice for Engineers
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https:…
-
Inside IBM's watsonx: Building Enterprise AI That Ships | Dr. Maryam Ashoori
2 april 2025 · 45 min
Building trustworthy, scalable AI isn't just about models; it's about navigating a complex ecosystem of tools and regulations. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/17-inside-ibms-watsonx-building-enterprise-ai-that-ships-dr-maryam-ashoori/
Join hosts Conor Bronsdon and Atindriyo Sanyal as they explore these challenges with Dr. Maryam Ashoori, Head of Product for watsonx AI at IBM. To meet these challenges, Maryam explains how watsonx simplifies the AI stack, automates pipelines, and empowers enterprises to scale their AI operations while optimizing costs rapidly.
Maryam also explores IBM's strategy for leveraging open-source and commercial models, enabling the potential of agentic systems. Plus, she shares insights from a recent survey of 1,000 developers, revealing key takeaways about the current landscape for enterprise AI implementation, and what results mean for both developers and the enterprises they support.
Chapters
00:00 Introducing Dr. Maryam Ashoori
01:13 Overview of IBM's AI Strategy
01:47 Enterprise AI Challenges and Solutions
04:40 IBM's Approach to AI Models and Tooling
09:52 Simplifying the AI Stack
12:20 Challenges in Agentic AI
15:55 Importance of Data Management and Lineage
21:11 IBM's Strategy for Gen AI Products
23:43 Scaling Challenges with Agents
27:40 Effective Agent Evaluation Systems
35:18 Gaps and Opportunities in AI Tooling
41:35 Success Stories with watsonx
44:00 Closing Remarks
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
watsonx.ai
Check out Galileo
Try Galileo
-
Information Symmetry: DevRev's Bet on AI-Driven Enterprise Decisions | Manoj Agarwal
26 maart 2025 · 41 min
What if everyone in your organization had equal information at all times? Would meetings even exist? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/16-information-symmetry-devrevs-bet-on-ai-driven-enterprise-decisions-manoj-agarwal/
This week, we dive into the concept of information symmetry with Manoj Agarwal, co-founder and president of DevRev. Manoj, along with hosts Conor Bronsdon and Yash Sheth, explores how DevRev is connecting data, personalizing schemas, and automating complex tasks, offering a glimpse into the next generation of AI-driven workflows. This is revolutionizing enterprise data and decision-making by breaking down the silos that create information asymmetry.
Learn how AI is reshaping business outcomes and collaboration, moving us closer to a world where everyone has the information they need.
Chapters:
00:00 Welcome to Chain of Thought
00:57 Information Symmetry in Enterprises
02:03 Challenges of Decision Making
03:41 Recency Bias and Product Management
04:58 Data Silos and Information Waste
05:23 Structured vs. Unstructured Data
06:04 Collaboration and Data Retrieval Issues
08:17 DevRev's Approach to AI and Data Integration
09:23 Building a Business-Centric Knowledge Graph
10:00 Conversational AI and Automation
12:57 Agentic Interactions and Skills Programming
20:05 Multi-Agent Systems and Future Vision
21:25 Challenges in Multi-Agent Communication
25:10 Data Cleanliness and Governance
28:14 Trust and Reliability in AI Systems
36:58 Conclusion and Future Outlook
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
devrev.ai
DevRev University
LinkedIn Manoj Agarwal
Check out Galileo
Try Galileo
-
The Agent Bubble Debate | Spot AI's Kelly Vaughn
19 maart 2025 · 35 min
Is the agentic AI bubble about to burst? Kelly Vaughn, Director of Engineering at Spot AI, questions whether the agent craze is overpromising potential and leading startups down a path of unsustainable expectations. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/15-the-agent-bubble-debate-spot-ais-kelly-vaughn/
Never one to shy away from a hot take, Kelly joins host Conor Bronsdon for a pragmatic look at AI, discussing the differences between building AI-enabled and traditional software, why replacing humans with AI teams will backfire (looking at you customer service), and the proliferation of AI tools.
Kelly also shares insights on constructing AI teams, navigating data governance, and building user trust while avoiding common startup pitfalls.
Chapters:
00:00 Introduction and Guest Welcome
01:13 Is Agentic AI a Bubble?
02:40 Startup Challenges and Market Noise
11:02 Building AI Products vs. Traditional Software
17:31 Ethical Implications and Governance
19:48 Constructing AI-Enabled Teams
22:07 AI Tooling and Productivity
26:00 Questioning Productivity Claims
32:28 Conclusion and Final Thoughts
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
Kelly’s Newsletter The Modern Leader
LinkedIn Kelly Vaughn
Check out Galileo
Try Galileo
-
Using AI to Modernize Your Legacy Applications | MongoDB’s Rachelle Palmer
12 maart 2025 · 44 min
Imagine cutting your legacy code modernization timeline from years to months. It’s no longer science fiction and this week’s guest is here to tell us how. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/14-using-ai-to-modernize-your-legacy-applications-mongodbs-rachelle-palmer/
Rachelle Palmer, Director of Product Management at MongoDB, joins hosts Conor Bronsdon and Atindriyo Sanyal, for a discussion on the groundbreaking ways AI is modernizing legacy applications.
At MongoDB, Rachelle's forward-deployed AI engineering team is tackling the challenge of transforming complex, outdated codebases, freeing developers from technical debt. She details how LLMs are automating tasks like improving documentation, test generation, and even business logic conversion, dramatically reducing modernization timelines from years to months. What once demanded teams of dozens can now be achieved with a small, highly efficient team.
Chapters:
00:00 Introduction and Host Welcome
00:58 Challenges in Modernizing Legacy Applications
02:52 Real-World Examples of Code Modernization
04:00 The Role of LLMs in Code Modernization
08:01 Measuring Success in AI-Powered Modernization
12:28 The Future of AI in Engineering
16:17 Evaluating Modernization Success
21:12 Returning to Your Startup Roots
29:07 Forward Deployed AI Engineers
35:36 Importance of Academic Research in AI
42:10 Conclusion and Farewell
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Follow Today's Guest(s)
Rachelle PalmerMongoDBApplication Modernization Factory
Check out Galileo
Try Galileo
-
How Engineering Leaders Can Future-Proof Their AI Strategy | Vikram Chatterji on Dev Interrupted
5 maart 2025 · 29 min
This week, we're sharing a special episode courtesy of 'Dev Interrupted.' Our co-host, Galileo CEO Vikram Chatterji, recently joined theDev Interrupted team for an engaging discussion on AI strategy. We were so impressed by the conversation that we wanted to share it with our audience, and they were kind enough to let us. We hope you enjoy it! Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/13-ai-in-2025-agents-and-the-rise-of-evaluation-driven-development-ft-dev-interrupted/
From Dev Interrupted:
"Vikram Chatterji joins Dev Interrupted’s Andrew Zigler to discuss how engineering leaders can future-proof their AI strategy and navigate an emerging dilemma: the pressure to adopt AI to stay competitive, while justifying AI spending and avoiding risky investments.
To accomplish this, Vikram emphasizes the importance of establishing clear evaluation frameworks, prioritizing AI use cases based on business needs and understanding your company's unique cultural context when deploying AI."
Chapters:
00:00 Introduction and Special Announcement
01:14 Welcome to Dev Interrupted
01:42 Challenges in AI Adoption
03:16 Balancing Business Needs and AI
06:15 Crawl, Walk, Run Approach
10:52 Building Trust and Prototyping
13:07 AI Agents as Smart Routers
13:50 Galileo's Role in AI Development
16:25 Evaluating AI Systems
25:36 Skills for Engineering Leaders
27:35 Conclusion
Follow Dev Interrupted
Podcast
Substack
LinkedIn
Follow Dev Interrupted Hosts
Andrew
Ben
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Check out Galileo
Try Galileo
-
The Making of Gemini 2.0: DeepMind's Approach to AI Development and Deployment | Logan Kilpatrick
12 februari 2025 · 41 min
Google’s strength in AI has often seemed to get lost in the midst of OpenAI announcements or DeepSeek fervor - yet Gemini 2.0 is more than good for many tasks; it’s the model to beat - and we have the research to back it up. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/12-the-making-of-gemini-2-0-deepminds-approach-to-ai-development-and-deployment-logan-kilpatr/
This week, Logan Kilpatrick, senior product manager at Google DeepMind, joins us to discuss Gemini’s creation story, its emergence as the premiere model in the AI race, and why the launch of Gemini 2.0 is great news for developers.
During the conversation Conor and Logan explore the exciting world of multimodal AI, Gemini's strengths in agentic use cases, and its unique approach to function calling, compositional function calling, and the seamless integration of tools like search and code execution.
They also chat about Logan’s vision for a future where AI interacts with the world more naturally, offering a view of the potential of vision-first AI agents, and why Google's hardware advantage is enabling Gemini's impressive performance and long context capabilities.
Follow along with the discussion using Galileo’s AI Agent Leaderboard:https://huggingface.co/spaces/galileo-ai/agent-leaderboard
Chapters:00:00 DeepMind's Role in Gemini's Development
03:49 Gemini 2.0 Updates and Developer Highlights
06:08 Agentic Use Cases and Function Calling
11:29 Multimodal Capabilities
16:15 Putting AI in Production
21:06 Gemini's Differentiation and Hardware
31:22 Future Vision for Gemini and G Suite Integration
35:23 Gemini for Developers
39:02 Conclusion and Farewell
Follow Logan
Twitter:@OfficialLoganK
LinkedIn:https://www.linkedin.com/in/logankilpatrick/
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/…
-
How DeepSeek Changed the AI Race Overnight
5 februari 2025 · 33 min
This week, hosts Conor Bronsdon and Atindriyo Sanyal discuss the fallout from DeepSeek's groundbreaking R1 model, its impact on the open-source AI landscape, and how its release will impact model development moving forward. They also discuss what effect (if any) export controls have had on AI innovation and whether we’re witnessing the rise of “Agents as a Service”. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/11-how-deepseek-changed-the-ai-race-overnight/
To tackle the increasing complexity of agentic systems, Conor and Atin highlight the need for robust evaluation frameworks, discussing the challenges of measuring agent performance, and how the recent launch of Galileo's agentic evaluations are empowering developers to build safer and more effective AI agents.
Chapters:00:00 Introduction
02:09 DeepSeek's Impact and Innovations
03:43 Open Source AI and Industry Implications
13:44 Export Controls and Global AI Competition
18:55 Software as a Service
19:29 Agentic Evaluations
25:14 Metrics for Success
31:34 Conclusion and Farewell
Check out Galileo
Try Galileo
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show Notes
On DeepSeek and Export Controls
Introducing Agentic Evaluations
-
AI, Open Source & Developer Safety | Block’s Rizel Scarlett
29 januari 2025 · 34 min
As DeepSeek so aptly demonstrated, AI doesn’t need to be closed source to be successful. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/10-ai-open-source-and-developer-safety-blocks-rizel-scarlett/
This week, Rizel Scarlett, a Staff Developer Advocate at Block, joins Conor Bronsdon to discuss the intersections between AI, open source, and developer advocacy. Rizel shares her journey into the world of AI, her passion for empowering developers, and her work on Block's new AI initiative, Goose, an on-machine developer agent designed to automate engineering tasks and enhance productivity.
Conor and Rizel also explore how AI can enable psychological safety, especially for junior developers. Building on this theme of community, they also dive into topics such as responsible AI development, ethical considerations in AI, and the impact of community involvement when building open source developer tools.
Chapters:00:00 Rizel's Role at Block02:41 Introducing Goose: Block's AI Agent06:30 Psychological Safety and AI for Developers11:24 AI Tools and Team Dynamics17:28 Open Source AI and Community Involvement25:29 Future of AI in Developer Communities27:47 Responsible and Ethical Use of AI31:34 Conclusion
Rizel Scarlett : https://www.linkedin.com/in/rizel-bobb-semple/Rizel's website: https://blackgirlbytes.dev/
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show Notes
Learn more about Goose: https://block.github.io/goose/
-
AI in 2025: Agents & The Rise of Evaluation-Driven Development | Galileo's Yash Sheth & Atindriyo Sanyal
15 januari 2025 · 33 min
"In the next three to five years, every piece of software that is built on this planet will have some sort of AI baked into it." - Atin Sanyal Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/9-ai-in-2025-agents-and-the-rise-of-evaluation-driven-development/
Chain of Thought is back for its second season, and this episode dives headfirst into the possibilities AI holds for 2025 and beyond. Join Conor Bronsdon as he chats with Galileo co-founders Yash Sheth (COO) and Atindriyo Sanyal (CTO) about major trends to look for this year. These include AI finding its product "tool stack" fit, generation latency decreasing, AI agents, their potential to revolutionize code generation and other industries, and the crucial role of robust evaluation tools in ensuring the responsible and effective deployment of these agents.
Yash and Atin also highlight Galileo's focus on building trust and security in AI applications through scalable evaluation intelligence. They emphasize the importance of quantifying application behavior, enforcing metrics in production, and adapting to the evolving needs of AI development.
Finally, they discuss Galileo's vision for the future and their active pursuit of partnerships in 2025 to contribute to a more reliable and trustworthy AI ecosystem.
Chapters:00:00 AI Trends and Predictions for 2025
02:55 Advancements in LLMs and Code Generation
05:16 Challenges and Opportunities in AI Development
10:40 Evaluating AI Agents and Applications
16:07 Building Evaluation Intelligence
23:41 Research Opportunities
29:50 Advice for Leveraging AI in 2025
32:00 Closing Remarks
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show Notes:
Check out Galileo
Follow Yash
Follow Atin
-
AI Infrastructure & the Evolution of RAG | Weaviate's Bob van Luijt
8 januari 2025 · 35 min
"This is the time. This is the time to start building... I can't say that often enough. This is the time." - Bob van Luijt Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/8-ai-infrastructure-and-the-evolution-of-rag-weaviates-bob-van-luijt/
Join Bob van Luijt, CEO and co-founder of Weaviate as he sits down with our host Conor Bronsdon for the Season 2 premiere of Chain of Thought. Together, they explore the ever-evolving world of AI infrastructure and the evolution of Retrieval-Augmented Generation (RAG) architecture.
Bob's journey with Weaviate offers a compelling example of how to adapt to rapid changes in the AI landscape. He discusses the importance of understanding developer needs and building AI-native solutions, emphasizing the potential of generative feedback loops and agent architectures to revolutionize data management.
Chapters:00:00 Welcome to Season 2
1:43 The Evolution of AI Infrastructure
04:13 Navigating Rapid Changes in AI
07:39 Generative Feedback Loops and AI Native Databases
13:26 Challenges and Opportunities in AI Production
19:03 The Importance of Documentation and Developer Experience
27:13 Future Predictions and Paradigm Shifts in AI
31:17 Final Thoughts and Encouragement to Build
Follow:
Bob van Luijt: https://www.linkedin.com/in/bobvanluijt/
Weaviate: https://www.linkedin.com/company/weaviate-io/
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show notes:Learn more about Weaviate: https://weaviate.io/
-
Beyond Chatbots: How Twilio Uses AI to Strengthen Human Connection | Vinnie Giarrusso
18 december 2024 · 42 min
Can AI assistants actually enhance human connection? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/7-beyond-chatbots-how-twilio-uses-ai-to-strengthen-human-connection-vinnie-giarrusso/
As Season 1 of Chain of Thought comes to a close, Conor Bronsdon and Vinnie Giarrusso (Twilio) explore the transformative potential of AI assistants in the workplace.
Discover how these assistants function as "async junior digital employees," taking on specific tasks and contributing to the organizational structure. But will AI assistants ultimately replace human connection? Vinnie argues the opposite is true, suggesting that AI can liberate employees from mundane tasks, allowing them to focus on building meaningful relationships and providing personalized experiences.
This thought-provoking conversation takes a philosophical turn as Vinnie explores how AI could revolutionize education while potentially disrupting traditional mentorship roles. He shares his vision for a future where AI democratizes information and empowers individuals to personalize their learning journey. Finally, learn how Twilio and Galileo are partnering to shape the future of AI and what this collaboration means for both companies.
Chain of Thought will be taking a break for the holidays, but we'll see you back here on January 8th for the start of Season 2!
Chapters: 00:00 Twilio's AI Agent Platform
06:34 Ensuring Accuracy and Trustworthiness
09:49 Challenges and Failure Modes
17:39 Future of Fully Autonomous Agents
22:18 Human-AI Collaboration and Mentorship
31:24 Education and Democratization of Information
32:58 Partnership with Galileo
39:54 Conclusion and Season Wrap-Up
Follow:
Vinnie Giarrusso: https://www.linkedin.com/in/vinniegiarrusso/
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@Con…
-
The Enterprise AI Deployment Playbook | ServiceTitan, Indeed & Twilio
11 december 2024 · 51 min
This week, a panel of experts (Mehmet Murat Ezbiderli, ServiceTitan; Grant Ledford, Indeed; and Vinnie Giarrusso, Twilio) join Atin Sanyal (CTO, Galileo) and Conor Bronsdon (Developer Awareness, Galileo) to explore the challenges and opportunities of deploying GenAI at enterprise scale in a conversation that's a wake-up call for any business leader looking to harness the power of AI. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/6-the-enterprise-ai-deployment-playbook-servicetitan-indeed-and-twilio/
Together, Atin & Conor break down key considerations like performance, cost, and model selection, emphasizing the need for robust evaluation frameworks and a shift in developer mindset.
Atin then sits down with our panel of AI engineering experts to discuss their firsthand experiences with enterprise AI, including the trade-offs of building AI systems, the evolving tools and frameworks available, and the impact these technologies are having on their organizations.
Chapters:
00:00 Enterprise Scale Deployment05:17 Cost, Performance, and Model Selection
08:59 Building and Integrating GenAI Systems
15:26 Emerging Enterprise Use Cases
18:12 Predictions for AI in 2025
27:28 Panel Discussion: Deploying AI at Enterprise Scale
31:19 Gen AI Solutions and Challenges
33:12 Building & Deploying Traditional Infrastructure vs GenAI Infrastructure
34:36 How to Assemble Your GenAI Stack
40:39 Today's Best GenAI Use Cases
48:15 Enterprise AI Trends for 2025
50:36 Closing Remarks and Future Outlook
Follow:
Atin Sanyal: https://www.linkedin.com/in/atinsanyal/
Mehmet Murat Ezbiderli: https://www.linkedin.com/in/mehmet-murat-ezbiderli-b894a49/
Grant Ledford: https://www.linkedin.com/in/grant-ledford-36b146a5/
Vinnie Giarrusso: https://www.linkedin.com/in/vinniegiarrusso/Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/c…
-
Practical Lessons for GenAI Evals | Chip Huyen & Vivienne Zhang
4 december 2024 · 48 min
As AI agents and multimodal models become more prevalent, understanding how to evaluate GenAI is no longer optional – it's essential. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/5-practical-lessons-for-genai-evals-chip-huyen-and-vivienne-zhang/
Generative AI introduces new complexities in assessment compared to traditional software, and this week on Chain of Thought we’re joined by Chip Huyen (Storyteller, Tép Studio), Vivienne Zhang (Senior Product Manager, Generative AI Software, Nvidia) for a discussion on AI evaluation best practices.
Before we hear from our guests, Vikram Chatterji (CEO, Galileo) and Conor Bronsdon (Developer Awareness, Galileo) give their takes on the complexities of AI evals and how to overcome them through the use of objective criteria in evaluating open-ended tasks, the role of hallucinations in AI models, and the importance of human-in-the-loop systems.
Afterwards, Chip and Vivienne sit down with Atin Sanyal (Co-Founder & CTO, Galileo) to explore common evaluation approaches, best practices for building frameworks, and implementation lessons. They also discuss the nuances of evaluating AI coding assistants and agentic systems.
Chapters:00:00 Challenges in Evaluating Generative AI
05:45 Evaluating AI Agents
13:08 Are Hallucinations Bad?
17:12 Human in the Loop Systems
20:49 Panel discussion begins
22:57 Challenges in Evaluating Intelligent Systems
24:37 User Feedback and Iterative Improvement
26:47 Post-Deployment Evaluations and Common Mistakes
28:52 Hallucinations in AI: Definitions and Challenges
34:17 Evaluating AI Coding Assistants
38:15 Agentic Systems: Use Cases and Evaluations
43:00 Trends in AI Models and Hardware
45:42 Future of AI in Enterprises
47:16 Conclusion and Final Thoughts
Follow:Vikram Chatterji: https://www.linkedin.com/in/vikram-chatterji/
Atin Sanyal: https://www.linkedin.com/in/atinsanyal/
Chip Huyen: https://www.linkedin.com/in/chiphuyen/Vivienne Zhang: https://www.linkedi…
-
Why Most Enterprise AI Projects Fail to Show ROI | HP, ServiceNow & Accenture
27 november 2024 · 41 min
The “ROI of AI” has been marketed as a panacea, a near-magical solution to all business problems. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/4-why-most-enterprise-ai-projects-fail-to-show-roi-hp-servicenow-and-accenture/
Following that promise, many companies have invested heavily in AI over the past year and are now asking themselves, “What is the return on my AI investment?”
This week on Chain of Thought, Galileo’s CEO, Vikram Chatterji joins Conor Bronsdon to discuss AI's value proposition, from the initial hype to the current search for tangible returns, offering insights into how businesses can identify the right AI use cases to maximize their investment.
Next, we’re joined by a panel of AI experts to discuss the ROI of Enterprise AI, featuring Alex Klug, Head of Product, Data Science & AI at HP; Sriram Palapudi, Sr. Dir, ML Platform Engineering at ServiceNow; and Jay Subrahmonia, Global MD for AI Research & Products at Accenture.
Together, they explore effective implementation strategies, how to measure the returns of AI adoption in the enterprise, and why AI's ROI isn't always just about the bottom line.
Chapters:
00:00 Current State of AI Investments03:59 Challenges and Solutions in AI Implementation
08:30 Identifying and Prioritizing AI Use Cases
10:53 Ensuring Trust and Explainability in AI
15:29 Measuring ROI and Efficiency Gains
21:10 Panel Discussion Begins
21:54 Trust and Risk Management at HP
23:27 Accenture's Approach to Operationalizing AI
26:06 ServiceNow's Trade-offs and Prioritization
31:17 Measuring the success of AI for customers
36:29 Frameworks and Best Practices
40:57 Conclusion and Final Thoughts
Follow:
Vikram Chatterji: https://www.linkedin.com/in/vikram-chatterji/
Alex Klug: https://www.linkedin.com/in/alex-klug-67ba3655/
Sriram Palapudi: https://www.linkedin.com/in/sriram-palapudi-11294b1/
Jay Subrahmonia: https://www.linkedin.com/in/jayashree-subrahmonia-99963a/Connect with Chain of Though…
-
GenAI Predictions for 2025 | Databricks & Cohere
20 november 2024 · 40 min
Will 2025 be the year open-source LLMs catch up with their closed-source rivals? Will an established set of best practices for evaluating AI emerge? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/3-genai-predictions-for-2025-databricks-and-cohere/
This week on Chain of Thought, we break out the crystal ball and give our biggest AI predictions for 2025. Listen as Sara Hooker, VP of Research at Cohere and Head of Cohere for AI predicts a trend towards smaller, more optimized AI models; Craig Wiley, Senior Director of Product, Mosaic AI at Databricks, dives into the future of multimodal AI; and Galileo’s CEO, Vikram Chatterji, shares his predictions, including the rise of open-source LLMs.
Chapters:
00:00 Introduction
02:01 Vikram's top 3 predictions
06:19 AI and nuclear energy
08:30 Giving power back to the people
13:46 Craig's predictions
20:46 The "era of toolification"
30:38 Sara's predictions
35:07 AI safety
Follow:
Vikram Chatterji: https://www.linkedin.com/in/vikram-chatterji/
Yash Sheth: https://www.linkedin.com/in/yash-sheth-/Sara Hooker: https://www.linkedin.com/in/sararosehooker/
Craig Wiley: https://www.linkedin.com/in/craigwiley/Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show notes:
Watch all of Productionize 2.0: https://www.galileo.ai/genai-productionize-2-0 -
Got Agents? Agentic Workflows & Architecture | Weaviate, Unstructured & CrewAI
13 november 2024 · 31 min
AI agents have quickly emerged as the next ‘hot thing’ in AI, but what constitutes an AI agent and do they live up to the hype? Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/2-got-agents-agentic-workflows-and-architecture-weaviate-unstructured-and-crewai/
Join Brian Raymond, founder & CEO at Unstructured.io, Bob van Luijt, co-founder & CEO at Weaviate, and João Moura, founder at CrewAI as they discuss the shift to agentic workflows, dissect their architecture, and tackle real-world challenges in agent deployment.
From data management tips to generative feedback loops, this episode is your essential guide to operationalizing agents effectively.
Chapters:
00:00 Defining AI Agents
01:16 Components of Agentic Architecture
02:16 Challenges and Solutions in Agent Deployment
03:58 Data Management and Quality Issues
05:23 Operationalizing Agents in Production
06:56 API and Security Considerations
09:04 Multimodal Information and Agentic Workflows
12:42 Future of Agentic Workflows
20:20 Best Practices for Agentic Strategies
25:30 Generative Feedback Loops
28:29 Agentic Evaluations
Follow:
Yash Sheth: https://www.linkedin.com/in/yash-sheth- Bob van Luijt: https://nl.linkedin.com/in/bobvanluijt
Brian Raymond: https://www.linkedin.com/in/brian-s-raymond
João Moura: https://br.linkedin.com/in/joaomdmoura
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show notes:
Watch all of Productionize 2.0: https://www.galileo.ai/genai-productionize-2-0
-
The State of AI: Open-Source Models & Enterprise Trust | May Habib
6 november 2024 · 49 min
From ChatGPT's search engine to Google's AI-powered code generation, artificial intelligence is transforming how we build and deploy technology. Lees meer
Full transcript and chapters: https://chainofthought.show/podcast/1-the-state-of-ai-open-source-models-and-enterprise-trust-may-habib/
In this inaugural episode of Chain of Thought, the co-founders of Galileo explore the state of AI, from open-source models to establishing trust in enterprise applications. Plus, tune in for a segment on the impact of the Presidential election on AI regulation. The episode culminates with an interview of May Habib, CEO of Writer, who shares practical insights on implementing generative AI at scale.
Chapters:
00:00 Introduction to Chain of Thought Podcast
01:27 Big News in AI: ChatGPT and Anthropic
06:34 Open Source vs Proprietary AI
12:17 The Importance of Trust in AI
20:12 Challenges in AI Development and Deployment
22:07 The Role of Human Input in AI Development
28:45 The Future of AI Regulation
34:41 Interview with May Habib co-founder & CEO at Writer
40:01 What’s Writer’s secret sauce?
43:31 Challenges in productionizing GenAI
48:08 Conclusion
Follow:
Vikram Chatterji: https://www.linkedin.com/in/vikram-chatterji/
Atin Sanyal: https://www.linkedin.com/in/atinsanyal/ Yash Sheth: https://www.linkedin.com/in/yash-sheth-/
May Habib: https://www.linkedin.com/in/may-habib/
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon
Show notes: Watch all of Productionize 2.0: https://www.galileo.ai/genai-productionize-2-0
-
Welcome to Chain of Thought
29 oktober 2024 · 1 min
We are living in the age of AI. It's transforming everything around us, from the way we work and communicate, to how we solve global challenges. Lees meer
But for many, AI still feels like a black box.
Introducing Chain of Thought, the podcast for software engineers and leaders that demystifies artificial intelligence.
We’ll be joined by AI innovators, tech founders, and expert researchers such as Cohere’s Sara Hooker.
Join us as we unravel actionable strategies and practical techniques for building effective GenerativeAI applications.
Discover how AI is being productionized at companies like HP, Twilio and Databricks, as each week we’ll discuss the rapid-evolving AI industry, exploring its potential to create a more productive world, and build a better, trustworthy future.
Subscribe now to Chain of Thought wherever you get your podcasts.
Chain of Thought. Trace the logic of innovation.
Connect with Chain of Thought host Conor Bronsdon:
Newsletter: https://newsletter.chainofthought.show/
Twitter/X: https://x.com/ConorBronsdon
LinkedIn: https://www.linkedin.com/in/conorbronsdon/
YouTube: https://www.youtube.com/@ConorBronsdon