System Prompt

This week on System Prompt, we had David Leibner on to talk about StupidGood AI. And yes, David had a lot to say. We may have gotten the extended founder’s cut. But in fairness, he had a lot of interesting things to say about how AI is changing the way people discover food, restaurants, and local experiences. We talked about: how AI is changing software development why restaurant discovery is stil...

The conversation delves into the challenges and complexities of enterprise AI education, training, and implementation. It highlights the need for a deep understanding of AI tools, ecosystems, and memory systems, as well as the role of the head of AI and forward deployed engineers. The importance of continued learning and the impact of AI education on business success are also emphasized. Takeaways...

In this episode, Val-Zod and Peter discuss hot topics in the AI industry, including the impact of Fable Five's removal, the adoption of open source models, and the misconception of free models. They emphasize the importance of considering alternative models and the potential for open source models to become the foundation of highly valuable proprietary products. Takeaways Consider alternative mode...

The conversation delves into the complexities of AI security, highlighting the expanding attack surfaces, vulnerabilities in enterprise software, and specific attack methods such as prompt injection, skeleton key, and crescendo jailbreak. The speakers emphasize the importance of mitigating these attacks through defense strategies and enforcement of instruction hierarchy. Additionally, they discuss...

The conversation delves into the intricacies of model routing, emphasizing the importance of routing systems, types of routing, regular expression, tracing, deterministic routing, and incremental improvements. Key aspects of routing logic, silent reroute, and output quality are also explored, culminating in a comprehensive understanding of model routing and its impact on AI experiences. Takeaways...

In this episode, Val and Peter explore the future of AI workers, focusing on the impact of hardware on AI workloads and the shift from cloud-based to device-level AI processing. They discuss the NVIDIA DGX Spark, its features, the CUDA ecosystem, and the challenges it presents. Additionally, they compare the Apple M5 and NVIDIA RTX Spark laptops, highlighting the cost trade-off and use case for mi...

The conversation delves into the challenges and impact of AI in regulated industries, emphasizing the importance of doing what's right and unlocking value while balancing innovation and compliance. It explores the ethical and legal implications of AI, the risks of overestimating AI capability, and the impact of AI on legal processes. Additionally, it discusses the training and responsibility in AI...

In this episode, Val and Peter discuss the concept of being AI native, exploring the challenges and misconceptions surrounding AI native builders and AI native products. They delve into the need for deterministic structures and processes in AI native products, the role of traditional software engineering practices, and the importance of planning and research in building AI native products. The con...

The conversation delves into the challenges and opportunities of leveraging AI in business, particularly in the context of inventory management and customer-facing chatbots. It emphasizes the importance of understanding the problem, ensuring that AI solutions provide more value than cost, and building trust and empathy in AI implementation. Takeaways Understanding the problem is crucial AI solutio...

The conversation covers the importance of prompt engineering, the role of prompting in AI model performance, the use of keyword search for refining AI outputs, and the introduction to Retrieval Augmented Generation (RAG) for further refinement. The conversation delves into the technical aspects of data storage, canonicalization, and the use of MariaDB for vector store and operational data. It emph...

The conversation covers the degradation of AI model quality, the impact of API costs, and the dynamics of competition and market trends in the AI industry. It delves into the challenges faced by companies like Anthropic and OpenAI, as well as the implications for enterprise users and the broader AI ecosystem.

The conversation delves into the ethical considerations of AI implementation, its impact on workplace productivity, and the reshaping of jobs. It also explores the role of AI in decision-making, critical thinking, and education. The need for responsible AI implementation and the importance of AI literacy and training are highlighted throughout the discussion. Takeaways Responsible AI implementatio...

The conversation delves into the rise of physical AI, exploring its applications in controlled environments, challenges in navigating novel scenarios, and the ethical considerations of human-robot interaction. It also discusses the impact of physical AI on society and the future of this technology, highlighting the limitations and costs associated with its implementation. Takeaways Physical AI ope...

The conversation delves into the concept of agentic coding, its impact on software development, the importance of planning, and the changing role of developers. It also explores the future of software development and the user experience, emphasizing the need for a shift in mindset and skill set for developers. Takeaways Agentic coding is a workflow replacement, not just a tool upgrade. The shift t...

The conversation delves into the impact of AI agents on job roles and the shift in job responsibilities. It explores the definition of AI agents, their role in software engineering, the effect of capital expenditure on job stability, task transformation, decrease in junior positions, and workforce exposure to AI. It also discusses the redefinition of roles, opportunities for small agencies, the im...

The conversation delves into the comparison between local and frontier LLM models, highlighting the impact of curation on model execution. It explores the future of local models, the implications of security and ownership, the potential of AI in home automation, and the considerations for businesses when choosing between frontier and local models. The conversation delves into the comparison betwee...

The conversation delves into the evolving landscape of AI and its impact on Software as a Service (SaaS). It explores the shift in value from software to AI, the challenges and considerations of building internal tools, and the future of SaaS in the era of AI. The complexities of AI integration, the impact on product people, and the need for innovation and adaptation are also highlighted. Takeaway...