Open Source Archives - Software Engineering Daily

oneAPI is an open standard for a unified API to be used across different computing accelerator architectures. This including GPUs, AI accelerators, and FPGAs. The goal of oneAPI is to eliminate the need for developers to maintain separate code bases, multiple programming languages, tools, and workflows for each architecture. James Reinders is an engineer at The post Building a Unified Hardware API...

When Adam Berger was at Uber, his team was responsible for ensuring that Uber Eats merchants correctly receive and fulfill orders. This required them to think hard about engineering workflows and state management systems. Six years of experience at Uber motivated Adam to create State Backed, which is an open-source backend system written in Typescript. The post Building a State Machine Backend wit...

The open source coding philosophy has enormous appeal to many software engineers, and with good reason. Open source libraries, applications, and operating systems are now essential to the overall technology ecosystem. And the number of open source projects is only increasing. But many developers don’t know how to get involved in open source. Or, they The post Open Source Contributing with Br...

There are countless real world scenarios where a workflow or process has multiple steps, and some steps must be completed before others can be started. Think of something as simple as cooking dinner. First you look up a recipe, then you write down the ingredients you need, you go shopping, and then you cook. These The post Temporal with Max Fateev appeared first on Software Engineering Daily .

Ongoing advances in generative AI are already having a huge impact on developer productivity. Tools like GitHub Copilot and ChatGPT are increasing the velocity of code development, and more advances are on the horizon. However, an ever-growing challenge for developers is how to manage their coding resources – things like code snippets, website links, messages, The post Building Pieces.app an...

In the realm of modern software development, clear and comprehensive documentation is essential for guiding users and contributors alike. Developers often struggle to create, manage, and maintain documentation that is both user-friendly and visually appealing. In this episode, we sit down with Sebastian Lorber, the lead maintainer of Docusaurus, a widely acclaimed open-source static site The post...

Enabling authorization policies across disparate cloud-native environments such as containers, microservices and modern application delivery infrastructure is complex and can be a roadblock for software engineering teams. Open Policy Agent, or OPA, is an open, declarative, policy-as-code approach to authorization that reduces security and compliance burden for engineering teams.  Business context...

This episode is hosted by Alex DeBrie. Alex is the author of The DynamoDB Book, the comprehensive guide to data modeling with DynamoDB, as well as The DynamoDB Guide, a free guided introduction to DynamoDB. He runs a consulting company where he assists clients with DynamoDB data modeling, serverless architectures, and general AWS usage. You can find The post Open-Source Cloud Asset Management with...

InfluxDB is an open-source time-series database.  It’s maintained by InfuxData who offers a suite of products that help organizations gain insights from time-series data.  In this episode, I interview Zoe Steinkamp, Software Engineering and Developer Advocate at InfluxData.  We explore some of the common use cases for time-series databases such as IoT and some recent The post InfluxData with Zoe S...

When creating a website, there’s no shortage of choices for how to do it.  Builders must make strategic decisions about the language or framework they want to adopt.  An important first consideration for many is selecting a web application framework like React or Vue.  Motivated by a low page response time and good user experience, The post Nuxt.js with Alexander Lichter appeared first on Software...

Angular is a free and open-source web application framework.  It’s maintained by the Angular team at Google.  It’s used by millions of web applications and has a strong ecosystem of core contributors and library builders. In this episode, I interview Minko Gechev, Developer Relations Lead at Google.  We explore several aspects of open-source software development, The post Angular Dev Tools with Mi...

By most accounts, the first databases came on line in the 1960s. This class of software has continued to evolve alongside the technology it runs on and the applications it supports. In the early days, databases were typically closed source commercial products. Today, databases run in the cloud on distributed systems. Increasingly, the leading tools The post Distributed Open Source Databases with J...

ETL stands for “extract, transform, load” and refers to the process of integrating data from many different sources into one location, usually a data warehouse. This process has become especially important for companies as they use many different services to collect and manage data.  The company Grouparoo provides an open source framework that helps you The post Grouparoo Open Source Data Tools wi...

In the late 1970s a printer at MIT kept jamming, resulting in regular pileups of print jobs in the printer’s queue. To solve this problem, some computer scientists wrote a software program that alerted every user in the backed up queue “The printer is jammed, please fix it.” When a man named Richard Stallmen was The post Publishing Open Source Code with William Morgan appeared first on Software En...

The term “boilerplate code” refers to code sections that are repeated across many projects with little to no variation. Every developer is familiar with boilerplate code, whether it be pom.xml files in Java or setting up React.js applications, tweaking boilerplate code for every project is inevitable. Actually, the company Wasp believes writing boilerplate code doesn’t The post Wasp-Lang: Boilerpl...

Many startups today begin their life as an open-source project. Open source projects allow early adopters of a technology to experiment, to contribute code and feedback, and to shape the evolution of the project in its early stages. When a “community maintainer” company emerges to provide service offerings based on that project, its early customer The post Developer Community Management with Patri...

ELT, or “Extract, Load, and Transform,” is the process that modern data pipelines use to replicate data from a source and load it into a target system such as a cloud data warehouse. ELT is a more flexible evolution of the traditional “Extract, Load, Transform” workflow used in pre-cloud systems. The power of ELT relies The post Airbyte: Open Source Data Integrations with Michel Tricot and John La...

The complexity of building web applications seems to have grown exponentially in the last several years. This added complexity may bring power, but it can also make applications brittle, costly, and difficult to maintain. Suborbital is an open-source project with a goal of making web application development simple. Its flagship project is Atmo, a platform The post Suborbital: WebAssembly Infrastru...

Observability is a key feature of a well-architected application. Because building an observability system for a cloud application can be challenging, especially at scale, many organizations elect to use third-party observability platforms rather than build internal tools. But these third-party provider contracts often charge by volume of data collected, which can be unpredictable and difficult Th...

As the volume and scope of data collected by an organization grow, tasks such as data discovery and data management grow in complexity. Simply put, the more data there is, the harder it is for users such as data analysts to find what they’re looking for. A metadata hub helps manage Big Data by providing The post Datahub: Open Source Data Lake with Pardhu Gunnam and Mars Lan appeared first on Softw...

The shift to microservices architectures and distributed systems has been a challenge for systems using conventional security practices, such filtering IP addresses using network policies. In addition, the increasing intersection of development and operations exemplified by the DevOps methodology has expanded the scope responsibilities in implementing secure systems.  Part of CNCF, SPIFFE is a set...

A data warehouse is a centralized repository that an enterprise may use to store selected data from production systems. Data is transformed into a structured form that makes it easily accessible for business intelligence or other operational users. SQL-compliant databases are frequently used for data warehouses due to the popularity of SQL as a tool The post Postgres Data Warehouse with Josh Drake...

Open source software is software distributed along with its source code, using a permissive license that allows anyone to view, use, or modify it. The term “open source” also refers more broadly to a philosophy of technology development which prioritizes transparency and community development of a project. Typically, development is managed by a governing body, The post Open Source Industrializatio...

Originally published October 18, 2019 Apache Kafka was created at LinkedIn. Kafka was open sourced in 2011, when the company was eight years old. By that time, LinkedIn had developed a social network with millions of users. LinkedIn’s engineering team was building a range of externally facing products and internal tools, and many of these The post LinkedIn Kafka with Nacho Solis (Repeat) appeared...

Originally published September 17, 2019 Ever since Apache Kafka was open sourced from LinkedIn, it has been used to solve a wide variety of problems in distributed systems and data engineering. Kafka is a distributed messaging queue that is used by developers to publish messages and subscribe to topics with a certain message type. Kafka The post Kafka Applications with Tim Berglund (Repeat) appear...