Agentic Horizons

In this episode, we explore DOME (Dynamic Hierarchical Outlining with Memory-Enhancement) —a groundbreaking AI method transforming long-form story generation. Learn how DOME overcomes traditional AI storytelling challenges by using a Dynamic Hierarchical Outline (DHO) for adaptive plotting and a Memory-Enhancement Module (MEM) with temporal knowledge graphs for consistency. We discuss its five-sta...

This episode delves into intelligence explosion microeconomics, a framework for understanding the mechanisms driving AI progress, introduced by Eliezer Yudkowsky. It focuses on returns on cognitive reinvestment, where an AI's ability to improve its own design could trigger a self-reinforcing cycle of rapid intelligence growth. The episode contrasts scenarios where this reinvestment is minimal (int...

The episode explores a study on the metacognitive abilities of Large Language Models (LLMs), focusing on ChatGPT's capacity to predict human memory performance. The study found that while humans could reliably predict their memory performance based on sentence memorability ratings, ChatGPT's predictions did not correlate with actual human memory outcomes, highlighting its lack of metacognitive mon...

This episode explores how Generative and Agentic AI are transforming software development, leading to the rise of living software systems. It highlights the limitations of traditional software, often inflexible and full of technical debt, and describes how Generative AI can bridge the gap between human intent and computer operations. The concept of Agentic AI is introduced as a tool for translatin...

This episode explores Theory of Mind (ToM) and its potential emergence in large language models (LLMs). ToM is the human ability to understand others' beliefs and intentions, essential for empathy and social interactions. A recent study tested LLMs on "false-belief" tasks, where ChatGPT-4 achieved a 75% success rate, comparable to a 6-year-old child’s performance. Key points include: - Possible Ex...

This episode explores the importance of AI personalities in human-computer interaction (HCI). As AI agents like Siri and ChatGPT become more integrated into daily life, their personas impact user satisfaction, trust, and engagement. Key topics include: - Persona Design Elements: Voice, embodiment, and demographics influence user experience, with appealing design fostering trust and adoption. - Cha...

In this episode, we dive into FISHNET, an advanced multi-agent system transforming financial analysis. Unlike traditional approaches that fine-tune large language models, FISHNET uses a modular structure with agents specialized in swarming, sub-querying, harmonizing, planning, and neural-conditioning. This design enables it to handle complex financial queries within a hierarchical agent-table data...

This episode discusses a research paper examining how Large Language Models (LLMs) internally encode truthfulness, particularly in relation to errors or "hallucinations." The study defines hallucinations broadly, covering factual inaccuracies, biases, and reasoning failures, and seeks to understand these errors by analyzing LLMs' internal representations. Key insights include: - Truthfulness Signa...

This episode covers PDL (Prompt Declaration Language), a new language designed for working with large language models (LLMs). Unlike complex prompting frameworks, PDL provides a simple, YAML-based, declarative approach to crafting prompts, reducing errors and enhancing control. Key features include: • Versatility: Supports chatbots, retrieval-augmented generation (RAG), and agents for goal-driven...

The episode examines Long-Term Memory (LTM) in AI self-evolution, where AI models continuously adapt and improve through memory. LTM enables AI to retain past interactions, enhancing responsiveness and adaptability in changing contexts. Inspired by human memory’s depth, LTM integrates episodic, semantic, and procedural elements for flexible recall and real-time updates. Practical uses include ment...

This episode delves into “multi-value responsibility” in AI, exploring how agents are attributed responsibility for outcomes based on contributions to multiple, possibly conflicting values. Key properties for a multi-value responsibility framework are discussed: consistency (an agent is responsible only if they could achieve all values concurrently), completeness (responsibility should reflect all...

This episode discusses the advantages of API-based agents over traditional web browsing agents for task automation. Traditional agents, which rely on simulated user actions, struggle with complex, interactive websites. API-based agents, however, perform tasks by directly communicating with websites via APIs, bypassing graphical interfaces for greater efficiency. In experiments using the WebArena b...

This episode discusses GUS-Net, a novel approach for identifying social bias in text using multi-label token classification. Key points include: - Traditional bias detection methods are limited by human subjectivity and narrow perspectives, while GUS-Net addresses implicit bias through automated analysis. - GUS-Net uses generative AI and agents to create a synthetic dataset for identifying a broad...

This episode explores the Talker-Reasoner architecture, a dual-system agent framework inspired by the human cognitive model of "thinking fast and slow." The Talker, analogous to System 1, is fast and intuitive, handling user interaction, perception, and conversational responses. The Reasoner, akin to System 2, is slower and logical, focused on multi-step reasoning, planning, and maintaining belief...

This episode explores Marvin Minsky's 1974 paper, "A Framework for Representing Knowledge," where he introduces frames as a method of organizing knowledge. Unlike isolated facts, frames are structured units representing stereotyped situations like being in a living room. Each frame contains terminals with procedural, predictive, and corrective information. Key features include default assignments,...

This episode explores the challenges of handling confusing questions in Retrieval-Augmented Generation (RAG) systems, which use document databases to answer queries. It introduces RAG-ConfusionQA, a new benchmark dataset created to evaluate how well large language models (LLMs) detect and respond to confusing questions. The episode explains how the dataset was generated using guided hallucination...

This episode explores the challenges of uncertainty estimation in large language models (LLMs) for instruction-following tasks. While LLMs show promise as personal AI agents, they often struggle to accurately assess their uncertainty, leading to deviations from guidelines. The episode highlights the limitations of existing uncertainty methods, like semantic entropy, which focus on fact-based tasks...

This episode examines the societal harms of large language models (LLMs) like ChatGPT, focusing on biases resulting from uncurated training data. LLMs often amplify existing societal biases, presenting them with a sense of authority that misleads users. The episode critiques the "bigger is better" approach to LLMs, noting that larger datasets, dominated by majority perspectives (e.g., American Eng...

This episode explores the use of AI agents for resolving errors in computational notebooks, highlighting a novel approach where an AI agent interacts with the notebook environment like a human user. Integrated into the JetBrains Datalore platform and powered by GPT-4, the agent can create, edit, and execute cells to gradually expand its context and fix errors, addressing the challenges of non-line...

This episode delves into Neurosymbolic Reinforcement Learning and the SCoBots (Successive Concept Bottlenecks Agents) framework, designed to make AI agents more interpretable and trustworthy. SCoBots break down reinforcement learning tasks into interpretable steps based on object-centric relational concepts, combining neural networks with symbolic AI.Key components include the Object Extractor (id...

This episode explores a formal theory of situations, causality, and actions designed to help computer programs reason about these concepts. The theory defines a "situation" as a partial description of a state of affairs and introduces fluents—predicates or functions representing conditions like "raining" or "at(I, home)." Fluents can be interpreted using predicate calculus or modal logic. The theo...

This episode explores John McCarthy's 1959 paper, "Programs with Common Sense," which introduces the concept of an "advice taker" program capable of solving problems using logical reasoning and common sense knowledge. Key aspects include the need for programs that reason like humans, McCarthy's proposal for an advice taker that deduces solutions through formal language manipulation, and the import...

This episode explores an AI-powered simulation system designed to study large-scale societal manipulation. The system, built on the Concordia framework and integrated with a Mastodon server, allows researchers to simulate real-world social media interactions, offering insights into how manipulation tactics spread online. The researchers demonstrated the system by simulating a mayoral election in a...

This episode explores a novel approach to reducing AI hallucinations in large language models (LLMs), based on the research titled Good Parenting is all you need: Multi-agentic LLM Hallucination Mitigation. The research addresses the issue of LLMs generating fabricated information (hallucinations), which undermines trust in AI systems. The solution proposed involves using multiple AI agents, where...

This episode explores Alan Turing's 1936 paper, "On Computable Numbers, with an Application to the Entscheidungsproblem," which laid the foundation for computer science and AI. Key topics include: - Turing's concept of the Turing machine, a theoretical device that can perform any calculation a human could. - The definition of computable numbers, numbers that can be generated by a Turing machine. -...