Alle afleveringen
388 afleveringen, van nieuw naar oud
-
Using ChatGPT As a Copilot For Your Mind
20 december 2023 · 1 uur 19 min
In this video, Nathan chats to Dan Shipper, CEO and Co-founder of Every, for the series "How I Use Chat-GPT". They discuss Nathan's prompting techniques for creative and cognitive labour, and using GPT in copilot instead of delegation mode. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
Watch the rest of the series, "How I Use ChatGPT", here: https://www.youtube.com/@EveryInc
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customi…
-
AI Deception, Interpretability, and Affordances with Apollo Research CEO Marius Hobbhahn
15 december 2023 · 1 uur 57 min
In this episode, Marius Hobbhahn, CEO of Apollo Research, sits down with Nathan Labenz to discuss Apollo’s research in AI deception, interpretability, and affordances. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
X/SOCIAL:
@labenz (Nathan)
@MariusHobbhahn (Marius)
@eriktorenberg (Erik)
@CogRev_PodcastTIMESTAMPS:
(00:00:00) - Episode Preview
(00:05:40) - … -
Balaji Srinivasan on Polytheistic AI, Human-AI Symbiosis, and Prospects for AI Control
12 december 2023 · 2 uur 16 min
Balaji Srinivasan, investor, former CTO at Coinbase and GP at a16z, and writer of The Network State, joins Nathan to discuss polytheistic AI and AI gods, human-AI symbiosis, how AI will be controlled, and much more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
X/SOCIAL:
@labenz (Nathan)
@balajis (Balaji)
@eriktorenberg (Erik)
@CogRev_PodcastTIMESTAMPS:
(00:00) - Episode Preview
(00:06:07) - Evolution of AI Systems
(00:09:39) - Challenges of AI Robustness
(00:29:54) - Intersection of AI and Politics
(00:52:14) - Regulation
(00:52:44) - Slippery slope of precedent setting
(00:54:00) - Role of AI in political chaos
(00:54:41) - Emergence of decentralized AI
(01:05:39) - AI's future as amplified intelligence
(01:1300) - Polytheistic … -
Hume CEO Alan Cowen on Creating Emotionally Aware AI
9 december 2023 · 1 uur 18 min
In this episode, Nathan sits down with Alan Cowen, CEO and Chief Scientist at Hume AI, an emotional intelligence startup working on creating emotionally aware AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
X/SOCIAL
@labenz (Nathan)
@AlanCowen (Alan)
@eriktorenberg (Erik)
@CogRev_PodcastLINKS:
Hume: https://hume.ai/TIMESTAMPS:
(00:00) - Episode Preview
(00:04:52) - How do you define happiness? How can AI make people happy?
(00:08:40) - The striking experience of trying the Hume demo
(00:09:16) - Building multimodal models using facial expressions, vocal signals, speech patterns
(00:12:27) - How Hume’s models have an advantage of LLMs when it comes to interpreting emotions
(00:13:23) - Assembling diverse datasets of emotional j… -
What Biological & Social Systems Can Teach us About AI with Nora Ammann, Cofounder of PIBBSS Research
7 december 2023 · 1 uur 27 min
In this episode, Nathan sits down with Nora Ammann, cofounder and CEO of PIBBSS (Principles of Intelligent Behavior in Biological and Social Systems), a research initiative focused on the principles of intelligent behavior in biological and social systems. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
X/SOCIAL
@labenz (Nathan)
@AmmannNora (Nora)
@eriktorenberg (Erik)
@CogRev_PodcastTIMESTAMPS:
(00:00:00) - Introduction to Nora Amman and PIBS
(00:03:25) - Nathan's view that society is not ready for rapid AI development
(00:05:55) - Nora's framing of AI safety, alignment, and risks
(00:09:31) - The problem of epistemic access to future AI systems
(00:12:36) - Categorizing different research approaches to AI safety
(00:15:46) - Seeki… -
Imbue CTO Josh Albrecht on Creating AI Agents for Reasoning, Reliability, and Robustness
2 december 2023 · 1 uur 22 min
In this episode, Nathan chats with Josh Albrecht, CTO of Imbue. They discuss how to create agents for reasoning, reliability, and robustness. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveOmneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
X/SOCIAL
@labenz (Nathan)
@eriktorenberg (Erik)
@CogRev_PodcastTIMESTAMPS:
(00:00:00) – Episode Preview
(00:07:14) – What does it mean to be a research company?
(00:10:25) – How is the reasoning landscape these days and how might it evolve?
(00:11:03) – Data quality is highly important
(00:21:15) – What’s the difference between good features and a good world model?
(00:27:31) – The impact of new modalities on reasoning
(00:29:15) – How much can reasoning and knowledge be separated?
(00:45:13) – Imbue demo and are they building their own LLMs or u… -
Vercel CEO Guillermo Rauch on AI-Powered Coding, Software 2.0, and the AI Open Source Question
29 november 2023 · 1 uur 15 min
In this episode, Nathan chats with Guillermo Rauch, CEO of Vercel, to discuss how AI might shape the future of code, software 2.0, and the open source question in AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveWith the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters.
Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at https://oracle.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10…
-
Sam Altman Fired from OpenAI: NEW Insider Context on the Board’s Decision
22 november 2023 · 1 uur 52 min
Nathan shares his perspective on Sam Altman’s firing from OpenAI, after being a part of the red team for GPT-4 and seeing how the board handled safety concerns. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
This is a developing story. This podcast was recorded on 11/21 at 12pm PST.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries. From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveWith the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters.
Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at https://oracle.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combine…
-
AI Discourse Deranged: Assessing LLM Generalization Takes and Polarizing Regulatory Debate
17 november 2023 · 1 uur 19 min
In this episode, Nathan and Erik discuss research out of Google Deepmind suggesting LLMs, Hemant Teneja’s responsible VC commitments, and why now is not the time for an ideological war on AI regulation. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
RECOMMENDED PODCAST:
Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future.
Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriffSPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Menti…
-
Synthetic Data with Alex Watson, Founder of Gretel AI
14 november 2023 · 1 uur 21 min
In this episode, Nathan interviews Alex Watson, founder and CPO of Gretel AI, about the company's work in synthetic data. They discuss why we need synthetic data, Gretel’s new pre trained tabular LLM that creates synthetic data on a zero shot basis, privacy techniques to prevent LLM memorization, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveORACLE:
With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters.
Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitiveNETSUITE:
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're look… -
OpenAI Invests $5M Into the Self-Driving Race with John Hayes, Cofounder of Ghost Autonomy
9 november 2023 · 1 uur 36 min
We're joined by John Hayes, CEO and Cofounder of Ghost, a self-driving car startup using multimodal LLMs to solve the autonomous driving problem, that OpenAI just invested $5 million into. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI.
Sign up for $1/month trial period: https://shopify.com/cognitiveWith the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters.
Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation pl…
-
OpenAI DevDay: Beyond the Headlines with Logan Kilpatrick, OpenAI's Dev Relations Lead
8 november 2023 · 1 uur 14 min
We’re deep diving into OpenAI DevDay with Logan Kilpatrick, Dev Relations Lead at OpenAI. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS:
SHOPIFY: https://shopify.com/cognitive for a $1/month trial period
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
X/SOCIAL:
@labenz (Nathan)
@OfficialLoganK (Logan)
@CogRev_PodcastTIMESTAMPS:
(00:00:00) - Episode Preview
(00:02:08) - How many startups did OpenAI kill?
(00:05:50) - Current employee co… -
Biden's Executive Order and AI Safety with Flo Crivello, Founder of Lindy AI
3 november 2023 · 54 min
In this episode, Flo Crivello, founder of Lindy AI, joins Nathan to chat about Biden’s executive order, and the state of AI safety. They discuss Flo’s thoughts on the executive order, building AGI kill switches, self driving cars, and more. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
SPONSORS: Netsuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
RECOMMENDED PODCAST:
Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart an… -
Hardcore AI for History with Mark Humphries, Professor of History at Wilfred Laurier University
31 oktober 2023 · 1 uur 33 min
Mark Humphries is a Professor of History at Wilfrid Laurier University, where he has published widely on various aspects of Canadian history. We invited Mark to do an episode after he reached out to tell us that hearing about how Nathan fine-tuned GPT-3.5 on GPT-4 reasoning helped him get over some hurdles in his own archival research. In addition, he chats about all the things that he'd tried that hadn't worked, and in the process proved himself to be one of the world's leading adopters of AI technology in the field of history. Lees meer
If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive.
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
TIMESTAMPS:
(00:00:00) - Episode Preview
(00:03:00) - The state of AI in history before recent advances like GPT-3
(00:06:00) - Mark's background and how he first got interested in AI
(00:09:00) - Using AI to process and search through vast amounts of archival material
(00:12:00) - The challenges of digitizing and searching handwritten historical documents
(00:15:00) - The massive scale of undiscovered archival material that could be processed by AI
(00:18:00) - How AI can help historians process more archival material than ever before
(00:20:11) - Sponsors: Netsuite | Omneky
(00:21:00) - Limitations on using commercial APIs for private archival documents
(00:24:00… -
AI Agents, VC Insights on AI, and Building in Public with Yohei Nakajima, Creator of BabyAGI
26 oktober 2023 · 1 uur 26 min
In this episode, Yohei Nakajima, creator of BabyAGI and GP at Untapped Capital, chats with Nathan about the opportunity for AI to strengthen human understanding, AI agents, and his insights on investing in AI projects. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
TIMESTAMPS:
(00:10:59) - A large part of AI is trying to map human cognitive processes onto our sof… -
RAG & Beyond: Semantic Storage and Retrieval
24 oktober 2023 · 1 uur 27 min
Anton Troynikov, cofounder of Chroma, joins Nathan Labenz to discuss the importance of keeping the retrieval-augmented generation (RAG) loop in house, what it means for Chroma to be in “wartime” mode right now, and how much of the data going into Chroma has never been in a database before. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
LINKS:
Part 1 with Anton: https://youtu.be/ogy37CdIljgX/SOCIAL:
@labenz (Nathan)
@atroyn (Anton)
@eriktorenberg (Erik)
@CogRev_PodcastTIMESTAMPS:
(00:00:00) - Introduction by Nathan, setting up the conversation with Anton
(00:02:16) - Anton articulates Chroma's mission to build a horizontally scalable system
(00:03:06) - Rise in popularity of retrieval-augmented generation (RAG)
(00:06:03) - Chroma's focus on delivering a horizontally scalable cloud service for vector search and storage
(00:08:07) - Nathan describes his experience building a RAG application for a client profiling use case
(00:10:27) - Anton advises measuring retrieval quality and maximizing relevant information returned
(00:15:05) - Sponsors: Netsuite | Omneky
(00:17:02) - Popular use of open source vs. proprietary embedding models like Anthropic's Ada
(00:19:30) - The importance of keeping the RAG loop in house and not relying solely… -
The Future of the Transformer Part 2 with Trey Kollmer
20 oktober 2023 · 1 uur 4 min
Trey Kollmer returns to discuss the latest AI research revelations with Nathan Labenz. They explore how new techniques will shave 10% off global compute needs, how analogical prompting beats few-shot prompting, and how compressive historical records can increase LLM memory and retention abilities. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. Lees meer
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
RECOMMENDED PODCAST:
Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends an… -
The Future of the Transformer Part 1 with Trey Kollmer | H100 Chips will Supercharge AI Hardware
18 oktober 2023 · 1 uur 20 min
Trey Kollmer joins Nathan Labenz for a roundup of the latest AI research! They discuss Microsoft’s Self-Taught Optimizer (STOP) research and Google’s FreshLLMs, how H100 chips will supercharge development of programs with GPT-4 level compute, LLM representation of space and time, and more! If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
TIMESTAMPS:
(00:0… -
The AI Scouting Report: Jailbreaks and Defense
13 oktober 2023 · 1 uur 15 min
Nathan Labenz synthesizes recent research in mechanistic interpretability and AI safety, how top players in the space like Anthropic and OpenAI are addressing them, and jailbreaks like the Calvin and Hobbes one you may have seen online. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
Questions or topics you want us to review for future episodes? Email TCR@turpentine.co
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible b… -
AI is Supercharging Writers with Sudowrite's Founder, James Yu
10 oktober 2023 · 1 uur 45 min
In this episode, Nathan is joined by James Yu, Founder of Sudowrite, an AI writing tool.They discuss how James started Sudowrite after using GPT-3 for his own fiction writing, how Sudowrite is able to be a supportive writing partner, and Yu's experience developing its tech stack and working through the backlash he's received. f you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actu…
-
AI Engineers, Pendants, and Competition Between OpenAI and Developers with Swyx of Latent Space
5 oktober 2023 · 1 uur 33 min
In this episode, Nathan sits down with Swyx of Latent Space to chat about AI engineers and tools to check out, competitive dynamics between OpenAI, other foundation model providers, and developers, and if Swyx would wear an AI Horcrux. We also learn that Nathan lived in the same dorm as Mark Zuckerberg back in his college days (and was a late adopter to Facebook…). If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundred…
-
Gunning for Google with Perplexity CEO Aravind Srinivas
3 oktober 2023 · 1 uur
In this episode, Aravind Srinivas of Perplexity AI returns to the show. They discuss Perplexity’s growth to millions of queries per day, CEO Aravind’s favourite Perplexity use cases, and how Perplexity ships fast in a competitive landscape against Google and major AI live players creating their own search engines. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10…
-
OpenAI, Amazon's Anthropic Investment, and the Roman Empire with Zvi Mowshowitz
30 september 2023 · 1 uur 54 min
Zvi Mowshowitz, the writer behind Don't Worry About the Vase, returns to catch up with Nathan on everything OpenAI, Amazon-Anthropic collab, and Google Deepmind. They also discuss Perplexity, deepfakes, and software bundling vs the Roman Empire. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase
(https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news.We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative gener…
-
OpenAI Fine-Tuning Update, Acceleration Debate, and Bundling AI Services
26 september 2023 · 1 uur 18 min
Nathan and Erik chat OpenAI GPT-3.5 fine tuning updates, using GPT 4 outputs to fine-tune 3.5, when to accelerate, and AI bundles. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
SPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitiveNetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
TIMESTAMPS:
(00:00) - Intro and GPT-3.5 fine tuning update
(05:50) - Using GPT-4 to generate training data for GPT-3.5
(09:54) - Potential for training models on synthetic/clean… -
Universal Jailbreaks with Zico Kolter, Andy Zou, and Asher Trockman
23 september 2023 · 2 uur 16 min
In this episode, Nathan sits down with three researchers at Carnegie Mellon studying adversarial attacks and mimetic initialization: Zico Kolter, Andy Zou, and Asher Trockman. They discuss: the motivation behind researching universal adversarial attacks on language models, how the attacks work, and the short term harms and long term risks of these jailbreaks. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
[00:00:00] - Introducing the podcast and guests Zico Kolter, Andy Zou, and Asher Trockman
[00:06:32] - Discussing the motivation and high-level strategy for the universal adversarial attack on language models
[00:09:33] - Explaining how the attacks work by adding nonsense tokens to maximize target sequence probability
[00:11:06] - Comparing to prior adversarial attacks in vision models
[00:13:47] - Details on the attack optimization process and discrete token search
[00:17:09] - The empirical notion of "mode switching" in the language models
[00:21:18] - Technical details on gradient computation across multiple models and prompts
[00:23:46] - Operating in one-hot vector space rather than continuous embeddings
[00:25:50] - Evaluating candidate substitutions across all positions to find the best update
[00:28:05] - Running the attack optimization for hundreds of steps across multiple GPUs
[00:39:14] - The difficulty of understanding the loss landscape and internal model workings
[00:43:55] - The flexibility afforded by separating the loss and optimization approach
[00:48:16] - The challenges of creating inherently robust models via adversarial training
[00:52:34] - Potential approaches to defense through filtering or inherent model robustness
[00:55:51] … -
The Future of AI Security with Adam Wenchel, CEO of Arthur.ai
19 september 2023 · 1 uur 24 min
In this episode, Nathan sits down with Adam Wenchel, CEO of Arthur.ai. Adam founded the AI security company back in 2019, before GPT-2 existed. In this episode, Adam shares his unique perspective on the AI security landscape, drawing from years building commercial AI systems. They discuss the attacks Adam set out to defend against, the changing priorities of executives in the rush to adopt LLMs, and the LLM-specific techniques Adam has developed. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00:00) Episode Preview
(00:03:45) Adam's background in AI and starting Arthur AI in 2019
(00:05:52) The release of ChatGPT as a watershed moment for generative AI
(00:07:09) Differences between traditional cybersecurity and AI security
(00:09:51) Early examples of AI security issues like boundary detection attacks in fraud systems
(00:12:39) - Mitigating risks of AI systems through observability and robust training
(00:14:40) - Financial services governance of AI models and its challenges today
(00:15:12) Sponsors: Netsuite | Omneky
(00:21:18) - Motivations for governance like staying compliant with regulations
(00:21:40) - The mix of incentives shaping earlier AI governance, like explainability
(00:28:14) - Using LMs to evaluate the security of other LMs
(00:30:03) - Dynamics between training and evaluating future LMs
(00:38:10) - The state of reasoning capabilities in large LMs
(00:44:35) - Corporate urgency around adopting generative AI technologies
(00:46:51) - Common enterprise use cases for generative AI and security concerns
(00:50:45) - Techniques for reducing hallucinations in retrieval augmented LMs
(00:53:15) - Benchmarking LMs on specific organizati… -
AI-Powered Filmmaking with Waymark's Stephen Parker and Josh Rubin
15 september 2023 · 1 uur 31 min
In this episode, Nathan sits down with Stephen Parker and Josh Rubin of Waymark, and creators of The Frost, an AI-powered 12 minute short film. In this episode, we get a behind the scenes look at their creative process, the prompting and creative techniques they used to generate and animate the DALL-E results, and an overview of the current state of AI art. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS
(00:00) Episode Preview
(00:01:00) Nathan’s introduction for Stephen Parker and Josh Rubin
(00:05:01) - The Frost is a 12-minute short film created using DALL-E 2 images.
(00:07:06) - The Frost started as an experiment to see if a narrative film could be created completely from AI imagery.
(00:10:38) - Parker started generating images with DALL-E 2 when he got access to the early preview.
(00:12:26) - Prompt technique to get consistent images by providing context about a hypothetical film.
(00:15:57) Sponsors: Netsuite | Omneky
(00:19:37) - Compositional continuity, like shot-reverse shot, was hard to achieve through prompting.
(00:22:13)- Rubin would request specific shots and the team would prompt DALL-E 2 to create them
(00:32:25) - Getting consistent facial features for characters was very difficult.
(00:39:03) - The storytelling helped cover inconsistencies that viewers might not notice.
(00:40:15) - Working with the images DALL-E provides
(00:44:53) Inpainting and compositing to refine DALL-E Images
(00:50:43) - The AI art is limited by what exists in the training data.
(01:02:05)- Animating the human characters was challenging because of missing or incorrect appendages.
(01:07:36) - The team had to find creative ways to convey emotion through the l… -
Hollywood Strike Update and AI Roundup with Trey Kollmer
13 september 2023 · 2 uur 33 min
In this episode, Trey Kollmer, WGA Writer and Co-Executive of the show Ghosts, returns to the show to discuss updates to the Hollywood Strikes, including news on SAG-AFTRA and WGA. Trey and Nathan chat why actors are joining the strikes, how AI will change acting as a profession, Trey’s views on reasoning and how he’s experimenting with GPT-4, and much, much more. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:04:01) Hollywood and AI: updates on SAG-AFTRA and the WGA
(00:15:20) Sponsors: NetSuite | Omneky
(00:18:56) Studio approach to copyright and compensation with generative AI
(00:22:17) Hollywood receptiveness to using AI and protections guild members are asking for
(00:24:56) Models implementing gradient descent in the weights
(00:29:14) How Nathan uses models to write for the podcast
(00:34:15) Generating and mining jokes in the writer’s room
(00:40:18) Untraining models
(00:44:20) AI writing tools and writer perception of them
(00:46:34) Context length and pooling layers
(00:51:11) Microsoft China
(01:00:02) Actors’ strike
(01:05:45) Using 1 million DALL-E images to create an AI short film
(01:09:11) Deepfakes
(01:12:51) The future where anyone can be a reasonable synthetic actor
(01:17:33) Trey’s take on reasoning and why Hollywood should be more open to AI
(01:25:49) A monk’s experience with Chat-GPT
(01:28:56) Outdatedness of stochastic parrot notion; reasoning and synthesis
(01:36:14) Model vs human susceptibility to adversarial attacks because of human robustness
(01:47:30) Performance jumping with abstraction
(01:49:22) Language model self-delegation
(01:51:04) NVIDIA’s margins compared to TSMC and ASML
(02:07:35) Adding an AI layer and competing with incumbents
(02:13:10) Rewind AI
(02:19:27) Big tech vs old school studios
(02:14:52) D… -
Why a16z Built a Town for AI People
7 september 2023 · 57 min
In this episode, Nathan sits down with three members of the a16z x Convex AI Town project: Yoko Li (Partner, a16z), Martin Casado (GP, a16z), and James Cowling (CTO, Convex). AI Town is a virtual town where AI agents live, interact, and socialize. They discuss how AI Town originated from Yoko’s companion app project, unpredictability as a feature in LLMs and interacting with models like they are lifeforms, and why they chose Javascript and Convex to build AI Town. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
📣 CALL FOR FEEDBACK:
To borrow from a meme… we're in the podcast arena trying stuff. Some will work. Some won't. But we're always learning.
http://bit.ly/TCRFeedback
Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co.TIMESTAMPS:
(00:00:00) - Episode Preview: Intro to AI Town and the idea of AI as companions
(00:05:29) - Overview of AI Town and the simulation framework based on the Stanford Generative Agents paper
(00:08:24) - Yoko explains how the idea for AI Town originated from the companion app project
(00:12:31) - The simplicity and elegance of the AI Town codebase
(00:15:47) - Sponsors: Netsuite | Omneky
(00:18:25) - How Convex built a server-side game engine for AI Town
(00:23:39 )- James emphasizes the power of functional programming paradigms like Convex for building AI apps
(00:25:02) - Using simple JavaScript so anyone could understand and extend AI Town
(00:30:23) - How AI coding assistants were used in building AI Town
(00:31:22) - No open source code for the Stanford paper when they started
(00:33:25) - The interplay between programmer and AI model… -
Cryptography Will Revolutionize AI Data Privacy with Daniel Kang
5 september 2023 · 1 uur 21 min
In this episode, Nathan sits down with Daniel Kang, Assistant Professor of Computer Science at the University of Illinois. Kang has done pioneering work bringing zero knowledge cryptographic proofs to AI. In this episode, they chat about the cryptographic theory behind Daniel's work, how cryptography allows us to balance the tradeoff between privacy and authenticity, and how cryptography usage is needed in a world where LLMs are increasingly embedded into our daily lives. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
CALL FOR FEEDBACK:
To borrow from a meme… we're in the podcast arena trying stuff. Some will work. Some won't. But we're always learning.
http://bit.ly/TCRFeedback
Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co.TIMESTAMPS:
(00:00) Episode Preview
(00:01:04) Nathan's Introduction
(00:07:06) Motivation for bringing zero-knowledge proofs to AI
(00:10:27) Verifying model execution without revealing model details
(00:12:42) Verifying medical AI services haven't been tampered with
(00:15:09) Sponsors: Netsuite | Omneky
(00:18:54) Cryptographic hashes for commitments
(00:22:42) Assumptions underlying cryptographic hashes
(00:25:20) Adding entropy through salting
(00:26:24) Z case snarks and the proving process
(00:31:00) Using lookup tables for nonlinearities
(00:33:35) Floating point vs fixed point calculations
(00:34:08) Quantizing models for efficiency
(00:35:55) Using polynomials to represent arbitrary computations
(00:37:26) What are finite fields?
(00:41:23) Toxic waste for cryptographic secrecy
(00:45:51) Computational costs
(00:47:39) The experienc… -
How Hugging Face raised $235M
31 augustus 2023 · 1 uur 2 min
In this episode, Nathan and Erik sit down to analyze Hugging Face in light of its recent $235M Series D round. They analyze Hugging Face’s community and defensibility through the lens of other community businesses like ProductHunt and Yelp, assess its ability to fulfill its $4.5 billion valuation, and assess competitors and other notable companies in the space like Replit, Character, and Runway. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00:57) Episode Preview
(00:01:52) Nathan’s Introduction
(00:04:57) Overview of Hugging Face and recent fundraising announcement
(00:08:13) Hugging Face’s product line
(00:16:47) Sponsors: Netsuite | Omneky
(00:18:36) Community driven businesses and HuggingFace’s moat
(00:23:23) Discovery and inference
(00:28:04) Hugging Face’s ideological nature
(00:31:31) Curation is key
(00:33:46) Keeping content fresh when AI moves so fast
(00:35:44) If Hugging Face is a $50 billion company one day, what would it look like?
(00:48:08) Hugging Face vs Replit
(00:57:19) Contrasting Hugging Face with other companies like Character and RunwayLINKS MENTIONED:
Hugging Face's LLM leaderboardX/TWITTER:
@labenz (Nathan)
@eriktorenberg
@CogRev_PodcastSPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more wit… -
E57: Google's PaLM 2 with Paige Bailey
29 augustus 2023 · 56 min
In this episode, Nathan sits down with Paige Bailey, Lead Product Manager of Generative Models at Google Deepmind. In this conversation, they discuss what it's like to be a PM for an LLM as opposed to an app, defining ideal LLM behaviour, and reasoning - how do you distinguish real abilities vs pattern matching? If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode Preview
(00:01:15) Introducing Paige Bailey
(00:04:21) Paige’s background at Google Brain and the Deepmind merger
(00:07:00) PM for a LLM vs being a PM for an app
(00:11:21) The development timeline and compute budget of PaLM-2
(00:14:30) Paige’s role in the PaLM 2 project
(00:15:30) Sponsors: Netsuite | Omneky
(00:17:26) Defining desired capabilities for PaLM-2
(00:19:17) The amount of work that went into elevating PaLM 2 from PaLM 1
(00:20:28) Has Google lost its ability to ship?
(00:24:240) Paige's "eureka" moment seeing GitHub Copilot capabilities
(00:27:47) Competing PaLM 2 with other models
(00:32:20) Grokking and the predictability of emergent capabilities
(00:37:30) Citizen scientists and the multilingual capabilities of PaLM 2
(00:39:29) Distinguishing real reasoning vs pattern matching
(00:45:51) Products using PaLM-2 that people should try
(00:50:35) Most exciting AI projects that you can try out
(00:52:29) Curriculum learning and successor to the transformerLINKS:
PaLM 2
Duet AI for developers
Avenging Polayni’s RevengeX/TWITTER:
@DynamicWebPaige (Paige)
@labenz (Nathan)
@eriktorenberg
@CogRev_PodcastSPONSORS: Shopify | NetSuite | Omneky
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce i… -
E56: OpenAI’s GPT3.5 Turbo and the State of AI in Coding, Healthcare, and Education
25 augustus 2023 · 53 min
Join Nathan Labenz and Erik Torenberg as they analyze the latest developments from OpenAI on GPT 3.5, compare GPT to other live player models like Llama2, and discuss the state of AI in coding, education, and healthcare. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsTIMESTAMPS:
(00:00) Episode Preview
(00:01:00) GPT 3.5 Turbo
(00:06:36) Llama 2 vs GPT
(00:11:24) How much inference is needed to double compute costs?
(00:13:40) OpenAI’s moat
(00:14:41) OpenAI’s privacy consideration for data
(00:16:06) Sponsor: Netsuite | Omneky
(00:17:46) Encouraging the usage of instructions during fine-tuning
(00:19:19) Live player consideration of AI safety
(00:22:35) Da Vinci: new completions fine tuneable model
(00:24:59) Chat-GPT usage in decline
(00:30:03) Getting on demand tutoring on ML papers
(00:31:00) Code, education, and healthcare
(00:31:4… -
E55: Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu
23 augustus 2023 · 1 uur 23 min
In this episode, Nathan sits down with Vivek Natarajan and Tao Tu of Google’s Med-PaLM, diving into how they used one of the world’s largest medical datasets ever compiled to develop Med-PaLM M, an AI agent specialized in medical tasks. In this episode, they discuss: Med-PaLM M's “clinically superhuman” abilities and limitations, the rigorous testing and validation that went into the model, and their vision for AI to take over repetitive clerical tasks and allow doctors to focus on patients. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode Preview
(00:00:56) Introducing Vivek Natarajan and Tao Tu
(00:04:18) The story of Google’s Medical AI research progress
(00:07:11) Multi-modal Med-PaLM
(00:10:32) Genomic data - how do you represent it?
(00:11:13) Google’s Deep Variant
(00:14:44) The successes and failures behind the incredible pace of progress
(00:15:02) Sponsors: Netsuite | Omneky
(00:21:54) Google’s research culture and assembling an interdisciplinary team
(00:31:36) Google’s Pathways
(00:33:40) Med-PaLM M's architecture
(00:37:28) Working with 3 different model sizes and what you learn
(00:46:56) Data and compute required for Med-PaLM M
(00:49:38) Med-PaLM M's cycle time
(00:54:56) Is a bridge or adapter structure worth implementing?
(01:00:09) Can we create an AI doctor?
(01:02:39) Emergent capabilities like identifying tuberculosis
(01:09:37) Reactions to these emergent capabilities
(01:11:13) Moving towards clinical trials and real-world testing
(01:13:01) Regulatory and safety considerations
(01:15:03) AI safety in the healthcare domain
(01:17:00) Potential to transform healthcare access worldwideLINKS:
Med-PaLM: https://sites.research.google/med-palm/
Med-PaLM M paper: https://arxiv.org/abs/2307.14334
Our earlier conversation … -
E54: The Presentation Revolution with Jon Noronha, Co-Founder of Gamma
17 augustus 2023 · 1 uur 1 min
In this episode, Nathan sits down with Jon Noronha, co-founder of Gamma. Gamma is a new medium for presenting ideas, allowing you to focus on your ideas and receive beautiful, engaging content without the formatting work. In this episode, Jon and Nathan discuss the journey of building Gamma, how to coax AI to do things well, and the opportunity for AI A/B testing. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00:00) - Preview
(00:01:23) - Nathan introduces Jon Noronha
(00:06:36) - Intro - Jon Noronha introduces himself and Gamma
(00:09:36) - Gamma's origin story: building the "anti-PowerPoint" pre-GPT-3
(00:13:15) - From using AI for onboarding to generating near-complete presentations.
(00:15:11) - Sponsors: Netsuite | Omneky
(00:18:01) - If Notion and Canva had a baby
(00:23:35) - Searching for the right structure for AI, landing on HTML
(00:28:16) - Degrees of freedom - developing a constrained vocabulary of semantic blocks
(00:29:30) - Choice of model(s) – weighing cost, speed, and quality tradeoffs
(00:35:18) - Editing UI - getting AI to edit slides per user command
(00:38:04) - UI for gathering training data - following Midjourney's example
(00:40:00) AI A/B Testing: a big opportunity space
(00:43:22) - Image generation models - Baseten and Gamma's deployment of it
(00:45:37) - Pacing feature development - Trying to stay ahead of innovations like 3D, video, voice etc.
(00:47:45) Image generation for slidedecks and AI involvement
(00:50:29) Gamma's main building priorities and AI generated websites
(00:52:34) - Competing with giants like Microsoft and Google
(00:55:04) - Enterprise AI shipping challenges - Startups pioneer new patterns; giants… -
E53: The AI Revolution in Education with Shawn Jansepar, Director of Engineering at Khan Academy
15 augustus 2023 · 1 uur 24 min
In this episode, Nathan sits down with Shawn Jansepar, Director of Engineering at Khan Academy, to discuss their GPT-4 powered Socratic tutor, Khanmigo. In this conversation, Shawn and Nathan chat about Khan Academy’s collaboration with OpenAI and how they helped fine-tune GPT-4, how Khan Academy leveraged GPT-4 to build Khanmigo, and the impact of providing access to an AI tutor to any student. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode Preview: Education 10 years from now
(04:42) Khan Academy’s early access partnership with OpenAI
(06:31) Khanmigo: journey from Chrome extension to AI tutor
(11:36) GPT-4’s ability to be Socratic vs 3.5
(15:05) Sponsors: Netsuite | Omneky
(16:40) Integrating Khan Academy’s Pedagogy into AI
(20:06) The future of education 10 years from now
(22:37) Khan Academy’s models
(27:20) Demo-driven development process
(31:16) Sculpting the behaviour of a Socratic tutor model
(35:59) Khan Academy’s contribution to GPT-4’s fine-tuning and RLHF
(38:41) Being data-informed vs data-driven as a practice
(42:10) Incurring tech debt to get ahead of the curve
(45:28) The boundary for what an AI can/can’t t tutor
(49:30) Identifying when the user is confused and avoiding AI hallucinations
(53:54) Khanmigo’s development patterns
(59:11) Making Khanmigo jailbreak resistant
(01:01:50) Delivering personalized education with AI
(01:04:08) How Shawn and his team are thinking about AI education
(01:05:33) Khanmigo’s future multimodal interactivity
(01:08:42) Evaluating Khanmigo’s efficacy for student learning
(01:11:41) How widely is Khanmigo deployed today and what is the future for universal public access?
(01:05:11) Distribu… -
E52: Advancements in AI: Updating the Scouting Report, Task Automation, and Google Breakthroughs
10 augustus 2023 · 39 min
Join Nathan Labenz and Erik Torenberg as they analyze the last month in AI advancements. Nathan takes us through the meaningful updates to his Scouting Report (released last month, linked below), discusses highlights from recent episodes of The Cognitive Revolution, and gives us a sneak peek at upcoming interviews with Google researchers. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(01:00) How does the AI Scouting Report hold up a few weeks later?
(03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape
(10:25) The universal LLM jailbreak and adversarial examples
(12:53) Human performance is much more variable than AI performance
(14:45) Sponsors: NetSuite | Omneky
(16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses?
(20:05) Is GPT-4 getting worse or better?
(22:00) Getting explicit about what good looks like
(24:00) Prompting best practices are very accessible
(26:35) Ghostwriting - and the art of the hook
(28:05) Live Players: Which companies have say so over how the future goes?
(31:10) Upcoming guests from Google AI
(35:40) Possible post-transformer architecturesLINKS:
SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ
SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E
SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E
3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown
Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s
Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s
Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/j… -
E51: Replit's VP of AI, Michele Catasta, on Artificial Developer Intelligence
9 augustus 2023 · 1 uur 40 min
In this episode, Nathan sits down with Replit’s VP of AI, Michele Catasta. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Michele and Nathan discuss Replit's state of AI development report, advantages when it comes to AI development, and the company's custom models. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode Preview
(00:00:57) Introduction
(04:44) What is artificial developer intelligence?
(15:05) Sponsors: Netsuite | Omneky
(16:58) Michele's background at Google & decision to join Replit
(19:16) Startups vs incumbents
(24:42) Whether Replit identifies as an e/acc company
(26:37) Staying apolitical on AI while being responsible
(30:36) The rise of LangChain and polarized reactions
(35:14) Estimates on developer productivity gains from AI assistance (2x-10x)
(38:35) Democratizing software development through easy customization
(44:02) AI generating disposable single-use software
(51:33) Optimism about humanity's ability to handle transformative AI
(55:01) The need for nuanced AI safety discussions
(56:14) Replit's data advantage from user code execution
(01:04:31) Replit's approach to training custom AI models
(01:08:51) The value of both open source and commercial models
(01:13:18) Michele’s highlights from being a Google researcher
(01:15:47) World knowledge needs in AI development
(01:20:37) Replit’s approach to AI safety
(01:24:28) The advantage of having a commercial model
(01:25:54) The costs of serving AI features to millions of users
(01:28:49) Modeling cost per user with AI workloads
(01:30:50) Pushing AI inference to the edge
(01:32:18) Ghostwriter integrating more deeply i… -
E50: The Future of Software Development with Tyler Angert of Replit
4 augustus 2023 · 1 uur 50 min
In this episode, Nathan sits down with Tyler Angert, Product Designer at Replit, to discuss the future of software development. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Tyler and Nathan discuss how Replit is leveraging AI to enhance its current product, bot-bot interactions, the design and ethical considerations around AI agents, and more. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode Preview
(01:10) Nathan’s Intro
(09:24) Tyler's role at Replit
(11:37) Replit as the "perfect substrate for AGI"
(14:55) Sponsor: Netsuite | Omneky
(15:45) Defining AGI
(19:26) How AI agents might interact with Replit
(23:20) Replit's "virtual developer" product
(31:11) Current state of Replit's AI features like Ghostwriter
(41:48) Measuring productivity boost from AI coding tools
(45:29) Potential for massive developer productivity gains from AI
(48:34) Technical gaps still remaining to achieve advanced AI agents
(51:45) Core AI breakthroughs have already occurred
(57:35) Timeline for functional AI agents interacting online
(01:01:20) Safety considerations for powerful AI agents on Replit
(01:08:47) Ethical considerations around AI and consciousness
(01:20:36) What constitutes consciousness in an AI system
(01:26:30) Should AI systems have rights and protections?
(01:30:32) Being polite to AI systems
(01:31:59) Advice for beginners looking to leverage AI
(01:36:58) Using AI with a Neuralink brain implant
(01:43:02) Hopes and fears about AI's impact on societyLINKS:
https://replit.com/X:
@tylerangert (Tyler)
@labenz (Nathan)
@eriktorenberg (Erik)
@cogrev_podcastSPONSORS: Shopify | NetSuite | Om…
-
E49: Open AI, Anthropic, and Meta | Analyzing the AI Frontier with Zvi
2 augustus 2023 · 3 uur
This isn't news, it's analysis! Nathan Labenz sits down for an with Zvi Mowshowitz, the writer behind Don't Worry About the Vase to talk about the major players in AI over the last few months. In this extended conversation, Nathan and Zvi debate if AI has attained the intelligence of a well-read college graduate (per OpenAI's Jan Leike), a live player analysis (who to count/ who not to count), and the role of independent red teaming organizations. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. Highly recommend.
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
TIMESTAMPS:
(00:00) Episode preview
(03:15) Is AI as intelligent as a college grad?
(07:45) Memories and context processing
(15:45) Sponsor: NetSuite | Omneky
(17:13) Is AI as intelligent as a college grad? cont'd
(20:47) Strengths and weaknesses of AI vs human
(31:05) OpenAI Superalignment
(37:23) The relationship between OpenAI and Anthropic
(44:31) Anthropic's security recommendations and adversarial attacks
(50:50) Is OpenAI using a constitutional AI approach?
(01:01:26) Context and stochastic parrots
(01:10) Is more context better?
(01:15:29) Should Nathan work at Anthropic?
(01:21:35) Google DeepMind's RT-2
(01:27:47) Multi-modal Med-PaLM
(01:31:50) Speculating about Gato
(01:35:10) Skepticism about Med-PaLM usage in radiology
(01:41:37) Llama 2 - what is going on at Meta??
(01:51:14) Llama 2 vs other models
(01:55:29) Who are the live players?
(02:… -
E48: Mechanizing Mechanistic Interpretability with Arthur Conmy
27 juli 2023 · 2 uur 14 min
Arthur Conmy sits down with Nathan Labenz for an accessible deep dive into the state of interpretability research online today. They discuss how pioneering researchers have painstakingly worked to isolate the sub-circuits within transformers that are responsible for different aspects of AI capabilities. Arthur also introduces us to a new ACDC approach that he and his co-authors have taken to automating some of the most time-consuming parts of this work. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsThe Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co
TIMESTAMPS:
(00:00) Episode Preview
(04:40) What attracted Arthur to mechanistic interpretability?
(07:49) LLM information processing: General Understanding vs Stochastic Parrot Paradigm
(14:00) ACDC paper: https://arxiv.org/abs/2304.14997
(14:45… -
E47: GPUMaxing with Dr. Ronen Dar of Run:ai
25 juli 2023 · 1 uur 2 min
Nathan Labenz sits down with Dr. Ronen Dar, CTO and co-founder of Run:ai, an Israel-based company that helps enterprises train and deploy AI models by optimizing GPU usage. The discussion covers how chip makers can meet the soaring demands, geopolitical fears, to the best practices companies can secure compute capacity. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsRECOMMENDATION: The AI Scouting Report
Playlist Parts 1-3: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81eeTIMESTAMPS:
(00:00) Episode Preview
(00:51) Introduction to Dr. Ronen Dar
(03:30) Run:ai's technology and what differentiates it from other solutions
(06:00) Today's market compared to when Dr. Ronen started five years ago
(13:40)Run:ai on market competitors like mosaicML
(14:55) Sponsors: NetSuite | Omneky
(22:00) The process and be… -
E46: AI Scouting Report - Part 2 of 3: Implementation Trends [Bonus YouTube Episode]
19 juli 2023 · 4 min
Head over to YouTube to watch Part 2 of The AI Scouting Report (https://www.youtube.com/watch?v=ovm4MbQ4G9E), supported by slides and visual aides. In Part 2, Nathan Labenz builds on Part 1: AI Fundamental and delves into recent trends and practical applications for AI. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90-minute installments. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsListener comments on Part 1:
"Incredible summary! I’ve watched probably 20 videos like this and I’ve always been left with unanswered questions."
"This is a really excellent overview! Enjoyed going through this and looking forward to episode 2. Thank you for sharing it on here for free!"
"Best 90 minutes this old PhD physicist has spent in a long time!"
LINKS:
Part 1: https://youtu.be/0hvtiVQ_LqQ
Part 2: https://www.youtube.com/watch?v=ovm4MbQ4G9E
Part 3 released later this week!Questions or topics you …
-
E45: The AI Copilot Revolution with Div Garg of MULTI·ON
13 juli 2023 · 1 uur 2 min
Nathan Labenz interviews Div Garg, founder of MULTI·ON, the world's first personal AI agent and life copilot. Div talks about the product strategy and roadmap for the MULTI·ON browser, their natural language approach to skills, and the steps they are taking to ensure user safety. Div explains how the platform uses a critic model to detect the success or failure of tasks, and how it can be used to book flights, order food, and more. Div also talks about the future of memory systems, such as the user profile feature, and how it can be used to improve the user experience. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsThe Cognitive Revolution is part of the Turpentine podcast network. Learn more at turpentine.co
Have your AI questions answered on an episode by emailing TCR@turpentine.co
Send your friends our 90 min AI Scouting Report with visual aides! The AI Scouting Report Part 1: The Fundamentals is on YouTube at https://www.youtube.com… -
E44: The AI Safety Debates with Zvi Mowshowitz
11 juli 2023 · 2 uur 45 min
Nathan Labenz sits down with Zvi Mowshowitz, the writer behind Don't Worry About the Vase.
Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. In this episode, we cover his AI safety worldview, an overview of the AI discourse, and who really matters in the AI debates. Lees meerWe're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsDo you have questions you want us to answer, topic requests, or guest suggestions for upcoming episodes? Email us at TCR@turpentine.co
Also, be sure to check out our recent release on YouTube: The AI Scouting Report Part 1: The Fundamentals
TIMESTAMPS:
(00:00) Episode Preview
(05:00) Zvi’s Introduction to AI
(07:04) Weekly 10,000+ words / Weekly newsletter
(12:34) Language models
(18:25) AI Worldview
(27:30) Probably of Due
(33:10) Inspirations for Content
(39:00) Audience for Writings
(45:… -
E43: AI Scouting Report – Part 1 of 3: Fundamentals [Bonus YouTube Episode]
6 juli 2023 · 7 min
Head to a special YouTube presentation with visual aides (https://youtu.be/0hvtiVQ_LqQ), where Nathan Labenz synthesizes the core fundamentals of AI as simply, clearly, and literally as possible. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. This special episode is in part brought to you by Athena. You can use Nathan’s referral link (http://athenago.me/nathan-labenz) for a free first month of Athena services for qualified customers. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsQuestions or topics you want us to review for Part 2? Email TCR@turpentine.co
The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.coTWITTER:
@CogRev_Podcast
@labenz (Nathan)
@eriktorenberg (Erik)SPONSOR:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's… -
E42: The Autonomy Revolution with Hayk Martiros of Skydio
4 juli 2023 · 1 uur 42 min
In this episode, Nathan Labenz sits down with Hayk Martiros, VP of Autonomy at Skydio. Martiros leads the autonomy team, which holds the state of the art in complex autonomous flight. Skydio is the largest drone developer in the US, and recently raised $230M to expand its US manufacturing 10-fold, bringing its valuation to $2.2 billion. In this discussion, Hayk and Nathan discuss why Skydio will not weaponize its drones, Skydio’s systems and AI approach, and the considerations of choosing an autonomous system over a human agent. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
LINKS:
SymForce: https://github.com/symforce-org/symforce
End-to-End Learning of Geometry and Context for Deep Stereo Regression (Skydio’s 2017 paper): https://arxiv.org/pdf/1703.04309TIMESTAMPS:
(00:00) Episode Preview
(01:12) Nathan’s episode intro
(07:44) Hayk’s story
(11:21) What is Skydio?
(14:59) Sponsor: Omneky
(16:56) The core driver of Skydio’s business
(20:21) Skydio’s AI approach
(23:56) Updating the voltage 30,000 times per second
(24:52) How is the Skydio system built?
(34:07) The loops in the Skydio system
(36:00) SymForce, Skydio’s open source library and Hayk’s creation
(41:06) Writing symbolic expressions as a roboticist
(42:14) Writing an expression for a toy race car
(47:58) Skydio neural networks
(51:29) Going from designed systems to end-to-end systems
(58:17) How much does a Skydio drone and dock cost to install?
(01:00:19) The cost savings of using a Skydio drone
(01:02:59) Are $1 drone missions in the consumer’s future?
(01:06:22) Vertical integration vs platform
(01:09:29) The advantages and disadvantages of drones
(01:11:17) Running LLMs on a drone
(01:14:36) Power consumption going to compute vs mechanics
(01:18:26) Hayk’s predictions for consumer autonomous systems… -
E41: [Bonus Episode - Latent.space] Building the AI x UX Scenius with Linus Lee of Notion AI
1 juli 2023 · 1 uur 16 min
[Bonus Episode] Latent.space hosts, Alessio and Swyx, sit down with Linus Lee of Notion AI to discuss Linus’ experience starting the AI/UX community, prompt engineering at Notion, and designing AI interfaces and agents.
The latent.space podcast aims to be the first place where AI engineers hear about the latest AI news and technology trends. We’ve had several guests in common – including Shreya Rajpal of Guardrails, Jonathan & Abhi from the recently acquired for $1.3B MosaicML, and also Riley Goodside from Scale AI – and also explored similar themes, including the question of which AI companies have durable business moats, and the flurry of experimentation going into AI agents right now. We recommend checking them out!
Keep up to date with Latent.space here: Lees meerWebsite: https://www.latent.space/
Spotify: https://open.spotify.com/show/2p7zZVwVF6Yk0Zsb4QmT7t?si=95fb033e3c014975
Apple Podcasts: https://podcasts.apple.com/us/podcast/latent-space-the-ai-engineer-podcast-codegen-agents/id1674008350
Youtube: https://www.youtube.com/@LatentSpace-podcast
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy th… -
E40: Meta's MEGABYTE Revolution with Lili Yu of Meta AI
29 juni 2023 · 1 uur 35 min
Nathan Labenz sits down with Lili Yu, a researcher of Meta AI to discuss the paper she authored: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers. In this conversation, they discuss the architecture and breakthroughs of their research, and the opportunity to eliminate the need for tokenization. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsThe Cognitive Revolution is a part of the Turpentine podcast network. Learn more: www.turpentine.co
LINK:
MEGABYTE Paper: https://arxiv.org/pdf/2305.07185.pdfTIMESTAMPS:
(00:00) Episode preview
(07:41) Takeaways from Lili Yu's paper: MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers
(17:00) Architecture
(24:59) Embeddings
(27:43) Different local models
(34:23) Encoder model
(36:35) Transformer Architecture
(48:10) Choosing patch size
(01:08) What happens when you scale up?
(01:19:20) Big picture for Meta AI
(01:22:57) Responsible AI
(01:27:02) China a… -
E39: Seeing is Believing with MIT’s Ziming Liu
27 juni 2023 · 1 uur 55 min
Ziming Liu is a Physics PhD student at MIT and IAIFI, advised by Prof. Max Tegmark. Ziming’s research is at the intersection of AI and physics. Today’s discussion goes in-depth on Liu’s paper “Seeing is Believing” where he presents Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable. The ability to see modules visually can complement current mechanistic interpretability strategies. Lees meer
We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com.
RECOMMENDED PODCAST:
The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord.
https://link.chtbl.com/hrhereticsThe Cognitive Revolution is a part of the Turpentine podcast network. To learn more: Turpentine.co
Watch this episode on YouTube to see research figures and graphics: https://www.youtube.com/watch?v=VKxwlxb2XWw
Links:
Seeing is Believing, authors: Ziming Liu, Eric Gan, and Max Tegmark https://arxiv.org/pdf/2305.08746.pdf
Ziming Liu: https://kindxiaoming.github.io/TIMESTAMPS:
(00:00) Episode preview
(01:16) Nathan introduces Ziming Liu and his research
(04…