E51: Replit's VP of AI Michele Catasta, on Artificial Developer Intelligence

In this episode, Nathan sits down with Replit’s VP of AI, Michele Catasta. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Michele and Nathan discuss artificial developer intelligence, Replit’s moats when it comes to Ai development, and the e/acc movement. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
TIMESTAMPS:(00:00) Episode Preview(00:00:57) Introduction(04:44) What is artificial developer intelligence?(15:05) Sponsors: Netsuite | Omneky(16:58) Michele's background at Google & decision to join Replit(19:16) Startups vs incumbents(24:42) Whether Replit identifies as an e/acc company(26:37) Staying apolitical on AI while being responsible(30:36) The rise of LangChain and polarized reactions(35:14) Estimates on developer productivity gains from AI assistance (2x-10x)(38:35) Democratizing software development through easy customization(44:02) AI generating disposable single-use software(51:33) Optimism about humanity's ability to handle transformative AI(55:01) The need for nuanced AI safety discussions(56:14) Replit's data advantage from user code execution(01:04:31) Replit's approach to training custom AI models(01:08:51) The value of both open source and commercial models(01:13:18) Michele’s highlights from being a Google researcher(01:15:47) World knowledge needs in AI development(01:20:37) Replit’s approach to AI safety(01:24:28) The advantage of having a commercial model(01:25:54) The costs of serving AI features to millions of users(01:28:49) Modeling cost per user with AI workloads(01:30:50) Pushing AI inference to the edge(01:32:18) Ghostwriter integrating more deeply into Replit's IDE(01:33:37) Replit as a potential "substrate for AGI"
LINKS:https://replit.com/
X:@pirroh (Michele)@labenz (Nathan)@eriktorenberg (Erik)@cogrev_podcast

SPONSORS: NetSuite | Omneky 
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform, head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM