Software Engineering Daily

Permissions are Hard! And they are becoming harder as we move more into the Cloud-native ecosystem. If we go back in time to the point where it was just a single monolith that you were building on your own. You'll probably have a framework to manage the permissions for you. But when you are working with distributed microservices, especially if you are a polyglot, you can't use those solutions anym...

Data catalogs are one way to address the tension between wanting to use all the data for business advantage and needing to govern all the data for compliance. Today, Zeashan Pappa, a Databricks Product Specialist for the Unity Catalog, joins us to discuss how catalogs can help companies capture the full value of their data. Zeashan Pappa is a technology executive and architect who has 20+ years of...

Webhooks are used in connecting two different online applications. Webhooks allow one program to send data to another as soon as a certain event takes place. And because they are event-driven, webhooks are ideal for things like real-time notifications and data updates. The company Hookdeck helps build webhook integrations at scale. In this episode, we talk with Alexandre Bouchard, Co-founder of Ho...

Twitter is a social media platform that does some incredibly complex stuff when it comes to distributed systems engineering to keep the website up and running. Twitter has open sourced a lot of projects for others to use. Twitter created a fork of Memcached called Twemcache and also a fork of Redis to handle the caching issues. In this episode we talk to Yao Yue. Yao Yue is an expert in distribute...

Java is a write once run anywhere programming language. The way you do that is you use the javac compiler and compile the source files down to the class files. Those class files can run on any system in interpreted mode. But those class files that are run in interpreted mode, they are not machine code specific. To get that code to run fast you need to turn that into optimized machine code and that...

Although we like to think about ML workflows as straight line narratives from experiment to training to production, and then monitoring, the reality for large companies is that all the steps are happening at one time in concert with other models, with shifting data and sometimes misaligned key feature inputs.  Moreover regulated firms are required to track all the models, the changes, and the impa...

In this episode we talk with Varun Badhwar, Founder and CEO of Endor Labs.

Show Host: Jordi Mon Companys Guest: Sam Alba

As applications grow in size and complexity, and as they increasingly move to microservice architectures, it becomes harder for individual developers to perform end-to-end tests of an entire application stack. Connecting development services to production services is off limits. Test environments are limited to automated tests. Staging environments are woefully inadequate with the amount of data a...

Silicon Valley has many investors and Venture Capital firms, but most are not trying to solve hard technical problems. Engineering Capital partners with companies that are taking a technical risk. These are the companies who have some innovation where there is a doubt on whether it can even be built. Ideally, the market for this innovation exists, but nobody has bothered to build it yet, or nobody...

We do it every day. We search on the internet for some information. Many ask, why is that easy? And yet doing the same thing at my company is hard sometimes, not even possible. And when you do get the data, it's unclear where it's from or the degree you can trust it or use it. In a highly regulated firm, there's even more pressure to select the best approved version of the information. Enter the d...

Data anonymisation is an ever more important problem with many pitfalls, and the legal context requires more and more companies to find a solution to it. In this episode, we talk to John Craft from Privacy Dynamics, who offer data anonymisation as a service. Privacy Dynamics is powering a world where ethics, data insights and personalized technology can all co-exist to support business growth and...

Fintechs and traditional finance firms want to help their small business customers replace disorganized competing manual processes and multiple data sources with a single unified set of services and data. They could do that. They could more easily offer quicker decisions, better customer experience, and even get more first time customers founded in 2017. Codat wants to be that universal API that c...

OpenSSL is a free, open-source cryptographic library that provides secure communications over computer networks. It is widely used to implement the secure socket layer (SSL) and transport layer security (TLS) protocols, which are the basis for secure, encrypted connections on the internet. On Oct 25th, the OpenSSL project informed its users of a critical vulnerability that affects the 3.0 and late...

Comma is a startup aimed at solving self-driving cars. A lot of the new cars in the market have built-in stock Advanced driver assistance systems. Comma takes this system to the next level with Openpilot. Openpilot is an open-source driver assistance system. Currently, with features like Adaptive Cruise Control (ACC), Automated Lane Centering (ALC), Forward Collision Warning (FCW), and Lane Depart...

Monolithic relational databases are the traditional foundation of financial core ledger systems. Nevertheless, the process of building and operating mission critical financial ledgers on these databases, and implementing homegrown accounting models, is a journey fraught with engineering challenges. Twisp has set out to rethink the underlying technology for financial ledger systems by combining the...

Java Applications became the go-to preference of most developers because of the write-once-run-anywhere advantage it gave over other languages. And it didn't take much time for Java to become the language for the enterprise. Consequently, most enterprises are still running legacy Java Monoliths on their infrastructure. Breaking up a monolith is not an easy process–nor is it something that every co...

When Web Assembly was created it was supposed to be a compile target, where you could compile your favorite programming language and then execute it inside of a web browser. This made it possible for developers to choose a programming language like C++ for compute intensive applications. Fermyon is taking Web Assembly to the cloud. With Fermyon Cloud deploying and managing cloud-native WebAssembly...

If you are a company with a large pool of physical servers, and compute resources sitting in the data center, and you want to use them efficiently, one way to do that would be to virtualize them. Then you can use those smaller virtual compute resources to run whatever workloads you need. VMware is a company that's known for virtualization. It's also the creator of Software Defined Data Center. In...

With an increasing number of data breaches impacting customer trust, prioritizing data privacy and security is more important than ever. However, as you layer on security and privacy, the overall complexity of a system grows and the data gets harder to use. There’s a constant push and pull between securing and locking down the data but still being able to use it. Skyflow Data Privacy Vault isolate...

The complexity of the software infrastructure has been increasing as companies have migrated towards kubernetes, containers, microservices and other distributed systems. However the tools around observability and monitoring have not seen much improvement. These tools are usually managed by teams distributed across different locations and time zones, which results in siloing of knowledge of your in...