Andreas Kretz

Plumbers of Data Science

Technology EN ↓ 126 episodes

Data Engineering is the plumbing of data science. Almost invisible, but super important and a big mess when done wrong. We talk about interesting Data Engineering trends and topics. I also train Data Engineering in my Data Engineering Academy at LearnDataEngineering.com

Author

Andreas Kretz

Episodes

#077 Lambda and Kappa Architecture 27.05.2019 1:22:01

In this episode we talk about the lambda architecture with stream and batch processing as well as a alternative the Kappa Architecture that consists only of streaming. Also Data engineer vs data scientist and we discuss Andrew Ng's AI Transformation Playbook

#076 Cloud vs On Premise How To Decide 27.05.2019 1:15:56

How do you choose between Cloud vs On-Premise, pros and cons and what you have to think about. Because there are good reasons to not go cloud. Also thoughts on how to choose between the cloud providers by just comparing instance prices. Otherwise the comparison will drive you insane.

#075 Creating the Course Structure For My Data Engineering Course 27.05.2019 53:18

In this episode we go over the ideas I have for the data engineering course structure. It was your chance for you to influence what we put in there.

#074 Starting My Data Engineering Online Course 27.05.2019 1:01:19

In this video we go over some of the 100+ comments I received on LinkedIn about a data engineering training. 

#073 Data Engineering At LinkedIn Case Study 27.05.2019 1:12:21

Let's check out how LinkedIn is processing data

#072 Data Engineering At Twitter Case Study 27.05.2019 56:27

How is Twitter doing Data Engineering? Oh man, they have a lot of cool things to share these tweets. 

#071 Data Engineering At Spotify Case Study 27.05.2019 43:04

In this episode we are looking at the data engineering at Spotify, my favorite music streaming service. How do they process all that data?

#070 The Engineering Culture At Spotify 27.05.2019 54:37

In this podcast we look at the engineering culture at Spotify, my favorite music streaming service.  The process behind the development of Spotify is really awesome.

#069 Data Engineering At Pinterest Case Study 27.05.2019 1:06:56

A look into how Pinterest is doing data engineering.

#068 A Budget Data Science PC Build 27.05.2019 21:24

Configuring a sub 1000 dollar PC for data engineering and machine learning Link to the builds: 900$ build:  https://pcpartpicker.com/list/22ThcY 1500$ build:  https://pcpartpicker.com/list/hXJdV6

#067 Data Engineering At NASA Case Study 27.05.2019 1:01:43

A look into how NASA is doing data engineering.

#066 How To Do Data Science From A Data Engineers Perspective 27.05.2019 31:48

A simple introduction how to do data science in the context of the internet of things. 

#065 Data Engineering At CERN Case Study 27.05.2019 1:16:24

A look into how CERN is doing Data Engineering. They get huge amounts of data from the Large Hydron Colider. Let's check it out.

#064 Data Engineering At Booking.com Case Study 27.05.2019 59:09

A look into how booking.com is doing data engineering.

#063 Data Engineering At Airbnb Case Study 27.05.2019 1:02:59

A look into how Airbnb is doing Data Engineering.

#062 Data Engineering At Netflix Case Study 27.05.2019 49:14

How Netflix is doing Data Engineering using their Keystone platform

#061 Reworking My Cookbook For Data Engineering 27.05.2019 16:58

I decided to rework the cookbook focusing more on case studies and less on explaining tools. People keep asking me for a path to become a data engineer and, let's be honest, you will never achieve that with just knowledge of the tools. Finding out how companies do data engineering on their data science platforms is way more useful. Over the next weeks we will go over each study on my YouTube chann...

#060 What Is Hadoop And Is Hadoop Still Relevant In 2019? 27.05.2019 24:12

A Introduction into Hadoop HDFS, YARN and MapReduce.  Yes, Hadoop is still relevant in 2019 even if you look into serverless tools. 

#059 A Look Into The Siemens Mindsphere IoT Platform? | #059 27.05.2019 53:31

The Internet of things is a huge deal. There are many platforms available. But, which one is actually good? Join me on a 50 minute dive into the Siemens Mindsphere online documentation.  I have to say I was super unimpressed by what I found.  Many limitations, unclear architecture and no pricing available?  Not good!

#058 Guitars And Data Live Stream 27.05.2019 1:36:29

A stream full of mediocre guitar playing and great Q&A about Hadoop. 

#057 Introducing The Plumbers Medium Publication 27.05.2019 12:59

I have created a Medium Publication especially for us Plumbers of Data Science who work in Data Engineering and Big Data. It's called, you guessed it, Plumbers of Data Science.

#056 NoSQL Key Value Stores Explained With HBase 27.05.2019 58:16

What is the difference between SQL and NoSQL? In this episode I show you on the example of HBase how a key/value store works. 

#055 Data Warehouse vs Data Lake 27.05.2019 34:59

On this podcast I talk about data warehouses and data lakes. When do people use which? What are the pros and cons of both? Architecture examples for both and does it make sense to completely move to a data lake?

#054 How to Market Yourself in 2019 Student or Professional 27.05.2019 42:10

In this episode I talk about how you can gain a competitive edge on the job market. It's super simple, you can and should start with it TODAY by putting yourself out there. 

#053 The Data Science Depression Is Coming? What You Can Do 27.05.2019 41:53

The Data Science Hype is still strong. Where's the industry going, towards a cliff? Here's what can you do?