Code Impact

This research paper investigates the feasibility and limitations of using Amazon S3, a cloud storage service, as a database system for web applications. The authors present protocols for managing reads, writes, and commits to S3, addressing issues of concurrency and consistency. They explore different consistency levels, including eventual consistency and stronger guarantees like atomicity and mon...

This 2003 USENIX paper challenges the prevailing belief that event-based programming is superior to thread-based programming for high-concurrency servers. The authors argue that the perceived weaknesses of threads stem from flawed implementations rather than inherent limitations. They present a high-performance user-level thread package as evidence, supporting their claim that threads offer a simp...

This Medium article by Shivam Bhadani provides a comprehensive guide to system design for beginners. It covers fundamental concepts like servers, latency, and throughput, progressing to advanced topics such as scaling strategies (vertical and horizontal), database scaling, microservices, caching, and message brokers. The author emphasises practical implementation alongside theory, using real-world...

This 1995 paper argues that threads, while powerful for achieving true CPU concurrency, are overly complex for most programming tasks. The author, John Ousterhout, contends that event-driven programming offers a simpler, more reliable alternative for applications such as GUIs and distributed systems. He highlights the difficulties of thread synchronisation, debugging, and performance optimisation,...

This paper examines SQLite, the world's most widely deployed database engine, exploring its history, architecture, and performance characteristics. The authors benchmark SQLite against DuckDB, an analytics-focused database, across various workloads (OLTP, OLAP, and blob processing). Key performance bottlenecks in SQLite's OLAP capabilities are identified and addressed through optimisation, resulti...

This research paper introduces Prequal, a novel load balancer designed to minimise latency in large-scale distributed systems like YouTube. Unlike traditional load balancers that focus on balancing CPU usage, Prequal prioritises estimated latency and requests in flight, actively probing servers for real-time load information. Extensive testing on YouTube and a controlled testbed demonstrated that...

This document presents the June 2024 RedMonk Programming Language Rankings, which are based on data extracted from GitHub and Stack Overflow. The report, authored by Stephen O'Grady, provides an analysis of the most popular programming languages and their relative popularity, highlighting trends in language adoption. The rankings offer a glimpse into the dynamic world of software development and s...

Building a reliable microservices architecture requires careful consideration of data consistency. Join us as we explore event sourcing , a powerful pattern that ensures atomic updates across your database and message broker, eliminating data inconsistencies and paving the way for a robust and scalable system. Reference: https://microservices.io/patterns/data/event-sourcing.html

This podcast explores domain events and their crucial role in modern software architecture. Join us as we discuss how domain events facilitate communication between services, support patterns like CQRS and Saga, and enable the development of robust and scalable applications. We'll also examine related concepts like DDD aggregates , transactional outboxes , and event sourcing to provide a comprehen...

In this episode, we explore the Command Query Responsibility Segregation (CQRS) pattern , a powerful technique for implementing efficient queries in microservice architectures. We break down the challenges of querying data across multiple services and explain how CQRS offers a solution through the creation of dedicated read-only databases. Tune in to discover the benefits, drawbacks, and real-worl...

Discover the API Composition pattern, its benefits, drawbacks, and practical examples using API Gateways. Learn about alternative solutions like the CQRS pattern and understand how it addresses the challenges posed by the Database per Service pattern. This podcast is your guide to efficient data management in a microservice world. Reference: https://microservices.io/patterns/data/api-composition.h...

This podcast explores the world of microservices architecture, discussing patterns, benefits, and challenges. We'll cover topics like the Command-Side Replica pattern, Database per Service, and the Saga pattern. Learn how to design, implement, and manage complex systems using microservices. Join us as we break down the complexities of modern software development and empower you to build robust and...

In the realm of microservices, where applications are split into independent services, managing transactions that span multiple services becomes a challenge. This episode explores the Saga pattern, a powerful solution for coordinating distributed transactions. Discover how Sagas break down complex operations into smaller, manageable local transactions, ensuring data consistency without relying on...

Join us as we discuss the challenges of managing data in a microservices architecture. We'll focus on the "Shared Database" pattern , analysing its potential benefits and drawbacks, and providing insights to help you make informed architectural decisions for your applications. Reference: https://microservices.io/patterns/data/shared-database.html

In the world of microservices, data management is key. This episode explores the "Database-per-Service" pattern – a powerful approach to keeping your services loosely coupled and adaptable. We'll look at the benefits, drawbacks, and how to navigate challenges like distributed transactions and complex queries. Get ready to optimise your microservice architecture! Reference: https://microservices.io...

This episode focuses on the Polling Publisher pattern, a crucial technique for publishing messages in a microservices architecture. Explore its workings, benefits, drawbacks, and alternatives like Transaction Log Tailing. Reference: https://microservices.io/patterns/data/polling-publisher.html

In this episode, we explore the Transaction Log Tailing pattern , a powerful technique for ensuring reliable message delivery in a microservices architecture. We'll discuss how this pattern works, its benefits and drawbacks, and how it compares to alternative solutions. Join us as we demystify transaction log tailing and unlock its potential for your microservices applications. References: https:/...

While event sourcing is a popular approach for managing data consistency in microservices, there are alternative patterns worth considering. This episode explores the Transactional Outbox pattern, a versatile solution for reliably sending messages and events even when distributed transactions are not an option. Uncover the inner workings of this pattern and how it guarantees message ordering and d...

In today's fast-paced business environment, agility is key. This podcast explores how microservices empower organisations to achieve rapid development cycles, adapt quickly to changing requirements, and maintain a competitive edge. Join us as we discuss the principles, practices, and real-world experiences of adopting microservices for increased agility. Reference: https://microservices.io/pattern...

Are you considering adopting microservices or looking to improve your existing architecture? This podcast is your one-stop shop for all things microservices. We discuss proven patterns, best practices, and common pitfalls to help you navigate the challenges of this architectural style. We'll cover topics such as service communication, data consistency, testing, deployment, and more, drawing on rea...

In the world of distributed systems, performance is paramount. Discover how the 'Consistent Core' pattern allows large data clusters to coordinate efficiently by leveraging a smaller, dedicated cluster for critical functions. We'll unpack the problem of quorum-based algorithms in large clusters and explain how 'Consistent Core' offers a practical alternative. Reference: https://martinfowler.com/ar...

In distributed systems, leadership can emerge organically without explicit elections. This podcast unpacks the "Emergent Leader" pattern, where the oldest node in a cluster naturally assumes the role of coordinator. We'll discuss how this approach simplifies coordination, enhances fault tolerance, and enables efficient decision-making in complex, decentralized environments. Tune in to understand t...

Imagine a world where your online shopping experience becomes a confusing mess because different parts of the system can't agree on what time it is! This is the challenge of external consistency in distributed systems, and it's the topic of today's episode. We'll explore the Clock-Bound Wait pattern – a clever solution that ensures all nodes in a system are on the same page, time-wise, before read...

Ever wonder how Netflix manages to send real-time updates to a billion devices worldwide? This podcast explores the fascinating story of Pushy, Netflix's custom-built WebSocket server. We'll hear from the engineers who built and scaled Pushy, and learn about the technical challenges they faced along the way. We'll also explore the future of Pushy, and how it will continue to evolve to meet the nee...

In this episode, we explore the fascinating world of traffic replay at Netflix. Discover how this powerful technique allows engineers to simulate real-world scenarios, test new features at scale, and identify potential issues before they impact users. We'll examine the 'Basic with Ads' launch as a case study and discuss the broader applications of traffic replay in software development. Reference:...