Gnarly Data Waves by Dremio

Watch this insightful webinar featuring Jacopo Tagliabue of Bauplan Labs as he dives into the world of data science and machine learning pipelines. In this webinar, you'll discover the rationale behind Bauplan Labs' choice of open-source technologies, such as Apache Iceberg table format and Project Nessie transactional data catalog, for their cutting-edge platform. Gain valuable insights i...

Product analytics offers a transformative opportunity for companies to elevate the customer experience and offer a way to proactively understand customer behavior. This personalized understanding allows companies to tailor their product offerings, provide targeted recommendations, and streamline customer journeys, resulting in a more engaging, satisfying, and loyalty-inducing customer experience....

Organizations who want to leverage their data lake for insights often struggle to deliver a consistent, accurate, high-quality view of their data to all of their data consumers. That challenge is often exacerbated by the need to make changes to data that impacts multiple tables. In this video, we’ll share how data teams can use Dremio Arctic, a data lakehouse management service, to simplify data m...

Imagine fast, intuitive analytics on all of your data where it lives - with the power of a data warehouse and the scale of a data lake. Dremio's open data lakehouse makes it easy to access, understand, and analyze all your data with a lightning fast SQL query engine and low-code and no-code options for all users. Learn what’s new in Dremio - including next gen Reflections SQL acceleration - an...

In the world of data acceleration and optimization, both materialized views and Dremio's Data Reflections stand out as pivotal tools. This video aims to demystify these technologies, comparing their benefits, limitations, and unique features. Dive deep into understanding the core differences between materialized views and Dremio's Reflections. Whether you're a seasoned data professiona...

In the rapidly evolving landscape of big data, Data Lakehouse is heralding a new age of unified analytics, blending the best elements of data lakes and data warehouses. Central to this convergence is the need for advanced table formats that can meet the demands of scalability, performance, and data reliability. This webinar dives deep into the world of Data Lakehouse table formats, specifically fo...

The data lakehouse is an architectural strategy that combines the flexibility and scalability of data lake storage with the data management, data governance, and data analytics capabilities of the data warehouse. As more organizations adopt this architecture, data teams need a way to deliver a consistent, accurate, and performant view of their data for all of their data consumers. In this video, w...

Watch this video for an insightful discussion titled "ELT, ETL, and the Dremio Data Lakehouse," where we explore the cutting-edge capabilities of Dremio in revolutionizing data engineering and analytics workflows. This webinar delves into the strategic use of Dremio's innovative technologies to optimize Extract, Load, Transform (ETL) and Extract, Load, Transform (ELT) patterns for en...

As data volumes grow - and more users across your organization want access to data to accelerate business decision-making - managing data governance is more important than ever. What this video in how to simplify data governance for analytics, and deliver data governance at scale with Dremio. You will learn: - Data governance on the data lakehouse - How to balance data access and control to accele...

Watch the Dremio developer advocacy and engineering teams for an installment of Apache Iceberg Office Hours. During this time we’ll have a brief Iceberg presentation on table format interoperability, going over the table format migration options, converters, and newer interoperability solutions like onetable and uniform. We’ll go through the capabilities, limitations, and considerations and then h...

Maersk is a global leader in container shipping, logistics, and energy. With an extensive network of offices in 116 countries, over 900 vessels, hundreds of warehouses, and a modern fleet of aircraft. Maersk provides comprehensive shipping services across the globe with commitments to achieve decarbonization and reach net-zero emissions. Join this live fireside chat with Mark Sear, Director of Dat...

Versioning is a technique that has helped software developers to develop many practices that allow them integrate and deploy new code continuously allowing for more rapid development of software. In a world where data is being generated faster than even, the data community needs technology that allows for rapid integration and deployment of new data. In this video, we’ll discuss: - 3 Levels of Ver...

In the rapidly evolving data landscape, organizations seek to use data assets to drive growth and competitive advantage. The problem is, the rigid warehouse-centric data architecture makes it hard to deliver faster access to data to end users without creating data copies and siloed ETL pipelines. As cloud data lakes grow, the challenge for many organizations will be providing access to that data f...

As the data mesh paradigm gains adoption across enterprises, it’s hard to ignore the increasing focus on the architectural aspects of this approach, which often overshadows the crucial socio-organizational element. The problem is, it’s hard to implement the concept of data mesh if the technology and organizational aspects are not aligned. Business units need faster access to unified data and data...

For analytical workloads, data teams today have various options to choose from in terms of data warehouses and lakehouse query engines. To enable self-service, they provide a semantic layer for end users, usually with materialized views, BI extracts, or OLAP cubes. The problem is, this process creates data copies and requires end users to understand the underlying physical data model. Join the Dre...

In the search to implement a data lakehouse many have been adopting one of the three major data lakehouse table formats. In this video, you’ll learn about how the different formats can be used with Dremio’s lakehouse platform. - What is a Table Format - What is Iceberg, Delta Lake and Hudi - Reading with Dremio - Using Multiple Formats with Dremio - Accelerating Queries with Dremio See all upcomin...

As more data consumers require access to critical customer and operational data in the data lake, data teams need solutions that enable multiple users to leverage the same view of the data for a wide range of use cases without impacting each other. In this video of Gnarly Data Waves, we will discuss how the data as code capabilities in Dremio Arctic enable data scientists to: - Create a data scien...

The Apache Iceberg project has made tremendous strides, evolving on various fronts such as usage, ecosystem adoption, community growth, and capabilities. In the past few months, the project has introduced many exciting new features and performance improvements around the core library, compute engines and standalone libraries (such as PyIceberg) that makes this lakehouse technology robust & val...

Memorial Sloan Kettering Cancer Center (MSK) is the largest private cancer center in the world and has devoted more than 135 years to exceptional patient care, innovative research, and outstanding educational programs. Today, MSK is one of 52 National Cancer Institutes designated as Comprehensive Cancer Centers, with state-of-the-art science flourishing side by side with clinical studies and treat...

Many organizations turned to HDFS to address the challenge of storing growing volumes of semi-structured and unstructured data. However, Hadoop never managed to replace the data warehouse for enterprise-grade Business Intelligence and Reporting, and most teams ended up with separate monolithic architectures including data lakes and data warehouses, with siloed data and analytic workloads That is w...

Data silos and a lack of collaboration between teams have been long-standing challenges in data management. This is where data mesh comes into play as an architectural and organizational paradigm, providing a solution by enabling decentralized teams to work collaboratively and share data in a governed manner across the enterprise. Dremio’s semantic layer provides a particular useful tool for achie...

While cloud data lakes address the need to efficiently store large volumes of structured, semi-structured, and unstructured data, they have traditionally lacked the data management and data governance capabilities that have tied enterprise data teams to data warehouse architectures. In this video, learn how Dremio Arctic, a lakehouse management service, delivers automatic data optimization feature...

As organizations strive to provide value faster to end users, data silos makes it difficult to provide insights on time. Learn how Dremio’s data lakehouse accelerates data delivery and discovery, without copies. In this video, you will get: - The fundamentals of the data lakehouse with Dremio and Apache Iceberg - Proven use cases for unifying data access on the lakehouse - Customer success stories...

Many organizations are moving to a data mesh, a decentralized approach to data architecture that emphasizes domain ownership of data products. Data as code is the practice of managing data the same way software developers manage code in application development, and in a data mesh architecture it can simplify and accelerate the process of building, managing, and sharing data products. In this video...

Most users of the Hadoop platform are fed up with its high cost of operational overhead and poor performance. With innovations around open source standards, like Apache Iceberg and Arrow, the data lakehouse has emerged as the destination for companies migrating off Hadoop. In this video of Gnarly Data Waves, you will learn about: - 5 key factors to consider as you migrate off Hadoop to the Data La...