Software Engineering Daily

The majority of enterprise data exists in heterogenous formats such as HTML, PDF, PNG, and PowerPoint. However, large language models do best when trained with clean, curated data. This presents a major data cleaning challenge. Unstructured is focused on extracting and transforming complex data to prepare it for vector databases and LLM frameworks. Crag Wolfe is Head of Engineering and Matt Robins...

Red Hat Enterprise Linux is a Linux distribution developed by Red Hat for the commercial market. The company recently announced changes to the availability of its source code. In response, CIQ, Oracle and SUSE formed the Open Enterprise Linux Association, or OpenELA, which aims to provide a consistent and secure upstream location for Enterprise Linux distribution sources. Wim Coekaerts is Executiv...

LLMs have become one of the most important technologies to emerge in recent years. Many of the most prominent LLM tools are closed source, which has led to great interest in developing open-source tools. Antonio Velasco Fernández is a Data Scientist and Jose Pablo Cabeza García is a Lead Data Engineer, both at Elastacloud. In this episode, recorded in 2023, they joined the podcast to talk about LL...

A deepfake is a synthetic media technique that uses deep learning to create or manipulate video, audio, or images to present something that didn't actually occur. Deepfakes have gained attention in part due to their potential for misuse, such as creating forged videos for political manipulation or spreading misinformation. Ryan Ofman is a Lead Engineer and Head of Science Communication at DeepMedi...

Decompilation is the process of translating a compiled program's bytecode back into a higher-level programming language, like C. There’s a vibrant and growing scene of engineers working to decompile classic video games, and some of the most prominent projects have focused on the Nintendo 64. Recent successes include Super Mario 64, The Legend of Zelda: Ocarina of Time, and Paper Mario. Ethan Rose...

CSS, or Cascading Style Sheets, is a fundamental technology in web development that defines the presentation and layout of HTML documents. It serves as a styling language that allows developers to control the appearance of web pages. Rachel Andrew is a Staff Technical Writer on the Google Chrome Team. Before that she worked for Mozilla and was also the Editor in Chief at Smashing Magazine. She is...

Security Operations, or SecOps, refers to the collaboration between security and operations teams to secure an organization's systems, applications, and data. Maxime Lamothe-Brassard is a Co-Founder of LimaCharlie which is a cloud SecOps platform. He has a background in security and has previously worked at the Canadian Intelligence service, Crowdstrike, Google, and Google X. He joins the podcast...

Microsoft Copilot is a chatbot developed by Microsoft that launched in 2023 and is based on a large language model. Justin Harris is a Principal Software Engineer at Microsoft and has an extensive background in classical machine learning and neural networks, including large language models. He joins the show to talk about Microsoft Copilot, natural language processing, ML team organization, and mo...

The interplanetary filesystem, or IPFS, is a peer-to-peer network that uses a distributed and decentralized model. Functionally, IPFS allows users to store and share files without having to rely on a single source of truth for those files. Matt Ober is the Co-Founder & CTO of Pinata. He joins the show to talk about IPFS and Pinata. This episode is hosted by Lee Atchison. Lee Atchison is a software...

Animal Well is a Metroidvania game developed as a solo project by Billy Basso over the course of seven years. It’s the first game released by publisher Bigmode, which was founded by Jason “Dunkey” Gastrow. Billy joins the show to talk about creating Animal Well’s engine from scratch, how the game handles animation, fine-tuning character movement, and more. Joe Nash is a developer, educator, and aw...

One of the most promising applications of large language models is giving non-experts the ability to easily query their own data. A potential positive side effect is reducing ad-hoc data analysis requests that often strain data teams. Sarah Nagy is the Co-founder and CEO at Seek which is using natural language processing to change how teams work with data. She joins the podcast to talk about the p...

Almost every application or system involves some sort of user onboarding. Increasingly, companies must implement know-your-customer and know-your-business compliance, or KYC and KYB, as part of that process. In addition, they often handle personal identifiable information, or PII. Footprint is a developer platform that was co-founded by Alex Grinman for handling identity, security, fraud, and auth...

Vue is a popular JavaScript frontend framework, and Nuxt is an open source meta-framework on top of Vue. Anthony Fu is a Framework Developer on the Nuxt team. He joins the show to talk about Vue, Nuxt, open source development, and more. Josh Goldberg is an independent full time open source developer in the TypeScript ecosystem. He works on projects that help developers write better TypeScript more...

The size of ML models is growing into the many billions of parameters. This poses a challenge for running inference on non-dedicated hardware like phones and laptops. Argmax is a startup focused on developing methods to run large models on commodity hardware. A key observation behind their strategy is that the largest models are getting larger, but the smallest models that are commercially relevan...

Anaconda is a popular platform for data science, machine learning, and AI. It provides trusted repositories of Python and R packages and has over 35 million users worldwide. Rob Futrick is the CTO at Anaconda, and he joins the show to talk about the platform, the concept of an OS for AI, and more. This episode is hosted by Lee Atchison. Lee Atchison is a software architect, author, and thought lea...

Panic has created games such as Firewatch and Untitled Goose Game. They recently ventured into gaming hardware with the Playdate. The console is unique for its inputs, which include a hand crank, and because Panic provides a free SDK, so anyone can develop games for it. James Moore is a DevOps Engineer and Dave Hayden is an Engineer at Panic. They join the show to talk about developing the Playdat...

Machine learning models learn patterns and relationships from data to make predictions or decisions. The quality of the data influences how well these models can represent and generalize from the data. Nihit Desai is the Co-founder and CTO at Refuel.ai. The company is using LLMs for tasks such as data labeling, cleaning, and enrichment. He joins the show to talk about the platform, and how to mana...

Kentik is a network observability platform that focuses on letting users easily ask questions and get answers about their network. Avi Freedman is the CEO of Kentik and he joins the podcast to talk about the platform, his observability philosophy, the role of AI in observability, and much more. Full Disclosure: This episode is sponsored by 10K Media (Kentik). This episode is hosted by Lee Atchison...

Solid.js is a popular JavaScript framework known for its reactive and efficient rendering system. Instead of using a Virtual DOM, it compiles its templates to real DOM nodes and updates them with fine-grained reactions. Ryan Carniato is the creator of SolidJS, and he joins the show to talk about the framework. Please click here to see the transcript of this episode. Sponsorship inquiries: sponsor@...

Sammy Steele is a Senior Staff Engineer at Figma, and the tech lead for their databases team. She previously worked at Dropbox, where she built out their petabyte-scale metadata storage and search systems. Sammy recently published a blog called “How Figma’s databases team lived to tell the scale”. The blog went viral and made it to the top of Hacker News. We invited Sammy on the podcast to learn m...

Autonomous vehicle engineering is a huge challenge and requires the integration of many different technologies. A self-driving car needs data from multiple sensors, ML models to process that data, engineering to couple software and mechanical systems, and much more. Ian Williams is a Senior Staff Software Engineer at Cruise, and before that worked at Google, Lyft, and eBay. He joins the show to ta...

Ben Huber is a security engineer who has worked at companies including Crypto.com and Blackpanda. He joins the podcast to talk about his career, penetration or "pen" testing, attack vectors, security tools, and much more. Gregor Vand is a security-focused technologist, and is the founder and CTO of Mailpass. Previously, Gregor was a CTO across cybersecurity, cyber insurance and general software en...

George Mathew is a Managing Director at Insight Partners where he invested in Weights & Biases, Jasper, and others. He has over 20 years of experience developing high-growth technology startups including most recently being CEO of Kespry. George joins the podcast to talk about his path to becoming an investor, his data-first thesis about investment, the AI business landscape, his book recommendati...

Event-driven architecture is a software design pattern where system components communicate through events that are generated by producers, and pushed to consumers. This design is often contrasted with a request-driven architecture, where components communicate with each other by sending requests and receiving responses. Hookdeck is an event gateway for receiving, processing, and delivering asynchr...

OAuth is an open standard for access delegation. It lets users grant websites or applications access to their information on other websites, but without giving away passwords. OpenID Connect is an identity layer on top of OAuth. Even if you haven't programmed using OAuth and OpenID Connect, you’ve certainly used them for authentication on Google, Facebook, Spotify, and countless other services. Au...