Trino Community Broadcast

- Intro Music: 0:00 - Intro: 0:31 - Trino releases 408-410: 2:02 - Introducing the Ignite connector to Trino: 5:30 - What is Ignite?: 7:30 - Contributing the Ignite connector: 10:10 - PR of the episode: 52:20

DolphinScheduler is a popular Apache data workflow orchestrator that enables running complex data pipelines. They recently added a Trino integration and will be demonstrating how to use DolphinScheduler to enable a series of transformations on the data lakehouse with Trino. - Intro Music: 0:00 - Intro: 0:31 - Trino release 407: 13:22 - What is workflow orchestration?: 21:12 - Why do we need a work...

We're going to discuss all of the awesome sessions that happened during Trino Summit this year. Manfred, Cole, and I will be joined by Martin, Dain, Brian Zhan, and Claudius for their, perspective and what they found most interesting about the summit. We also dive into stats around the summit and some exciting topics discussed off-camera. We'll also dive into some key takeaways from the Trino Cont...

Trino's initial use case was around replacing the Apache Hive runtime. As data lakes grew into prominence, it became clear that having a faster query engine didn't solve all problems. The Hive model itself was a huge bottleneck and didn't provide features that companies needed akin to data warehouses and databases. Apache Hudi is a new table format created out of Uber that aims to address many of...

Join us for this next episode of the broadcast, where we bring back Ryan Blue, the creator of Iceberg, to discuss some of the latest happenings in the Iceberg community. We also discuss and demo a bunch of new features that have come out in the Trino Iceberg connector. We also have a new guest, Tabular Developer Advocate Sam Redai, shedding light on this incredible community as well! Since the fir...

In this episode we sit down with engineers, Steve Morgan and Edward Morgan, to discuss how they use Trino at Raft. Raft provides consulting services and is particularly skilled at DevSecOps. One particular challenge they face is dealing with fragmented government infrastructure. In this episode, we dive in to learn how Trino enables Raft to supply government sector clients with a data fabric solut...

We'll be doing a more focused look at a specific feature that's being added to Trino: polymorphic table functions. We're excited to talk about what they do, where we are so far, where we're going, and how you can leverage them to make Trino better than ever! Show Notes: https://trino.io/episodes/38.html Show Page: https://trino.io/broadcast/ YouTube Video: https://www.youtube.com/watch?v=90e5WxhwN...

This episode covers will introduce the benefits of having the Trino community around the Trino project. What is the purpose of communities in tech projects? Would the product be successful without a community or anyone to maintain it? We introduce some new faces that will be stewards in our journey to growing the adoption of our favorite query engine, what each of them does, and how their work imp...

As Trino preps to jump to Java 17, we discuss the latest features added Java 11 to Java 17, talk with Martin through a few of the potential uses of new features like the Vector API, language improvements, and G1GC speedups, and finally, we will dive into discussing some of the features that we'll be implementing in the upcoming months under a new project in Trino! - Intro song: 00:00 - Intro: 00:3...

In our Trino Community Broadcast episode 35 we are catching up on recent releases 375, 376, 377, and 378. We then talk about how Trino is packaged as tarball, rpm, and docker container, what some of the differences are, and how you can customize either of them. Beyond we also look for your feedback and input on usage of the different packages. As a next step we chat about adopting Java 17 is stand...

News from the Trino releases 372, 373, and 374, and an update on Project Tardigrade are the start. Then we dive into the details of the new Delta Lake connector contributed to Trino by Starburst. - Intro song: 00:00 - Intro: 00:37 - Releases: 2:05 - Project Tardigrade update: 9:21 - Concept of the episode: A new connector for Delta Lake object storage. 18:37 - Pull requests of the episode: Add Del...

Goldman Sachs uses Trino to reduce last-mile ETL and provide a unified way of accessing data through federated joins. Making a variety of data sets from different sources available in one spot for our data science team was a tall order. Data must be quickly accessible to data consumers and systems like Trino must be reliable for users to trust this singular access point for their data. Join us on...

- Intro Song: 00:00​ - Intro: 00:33 - News: 8:02 - Concept of the week: K8s architecture: Containers, Pods, and kubelets: 14:27 - PR of the week: PR 11 Merge contributor version of k8s charts with the community version: 55:20 - Demo: Running the Trino charts with kubectl: 57:42 Show Notes: https://trino.io/episodes/24.html Show Page: https://trino.io/broadcast/

- Intro Song: 00:00​ - Intro: 00:34​ - News: 5:18​ - Concept of the week: Row pattern matching and MATCH_RECOGNIZE: 14:26 - PR of the week: PR 8348 Document row pattern recognition in window: 52:16 - Demo: Showing MATCH_RECOGNIZE functionality by example: 57:13 - Question of the week: How do you tag a list of rows with custom periodic rules?: 1:12:51 Show Notes: https://trino.io/episodes/23.html S...

This episode will cover LinkedIn's journey to upgrade from PrestoSQL to Trino and some of the operational challenges LinkedIn's engineering team has faced at their scale. - Intro Song: 00:00​ - Intro: 00:36 - News: 7:39 - Concept of the week: Trino usage at LinkedIn: 15:55 - Concept of the week: Trino hardware and operational scale: 23:23 - Concept of the week: Challenges operating at scale: 44:09...

- Intro Song: 00:00​ - Intro: 00:35 - News: 7:42​ - Question of the week: Can dbt connect to different databases in the same project?: 18:18 - Concept of the week: What is dbt?: 21:28 - Concept of the week: dbt + Trino: 38:09 - Demo: Querying Trino from a dbt project: 47:21 - PR of the week: PR 8283 Externalised destination table cache expiry duration for BigQuery Connector: 1:21:13 Show Notes: ht...

- Intro Song: 00:00​ - Intro: 00:35 - News: 10:16​ - Concept of the week: Trino for the Trinewbie: 19:12 - Concept of the week: Marius' Journey: 21:03 - Concept of the week: Contributing to Trino: 54:55 - PR of the week: PR 8135 Set default time zone for the current session: 1:03:36 - Demo: Contributing to Trino: 1:11:49 - Question of the week: How do I search nested objects in Elasticsearch from...

- Intro Song: 00:00​ - Intro: 00:37 - News: 7:56​ - Concept of the week: Ingesting into Iceberg with Pulsar and Flink at BlueCat: 17:30 - Concept of the week: BlueCat Overview: 20:31 - Concept of the week: Single Tenant to Multi-Tenant: 21:33 - Concept of the week: Pre-Iceberg: 26:13 - Concept of the week: Iceberg: 39:29 - PR of the week: PR 1905 Add format_number function: 1:01:55 - Demo: Showing...

- Intro Song: 00:00​ - Intro: 00:34​ - News: 1:44​ - Concept of the week: Trino Views, Hive Views, and Materialized Views: 4:57 - PR of the week: PR 4832 Add Iceberg support for materialized views: 59:04 - Demo: Showing the different views in Trino: 1:01:25 - Question of the week: Are JDBC drivers backwards compatible with older Trino versions?: 1:21:02 Show Notes: https://trino.io/episodes/18.htm...

- Intro Song: 00:00​ - Intro: 00:34​ - News: 2:52​ - Concept of the week: Resurface and the Resurface connector: 8:58 - PR of the week: PR 4022 Add Soundex function: 1:08:17 - Demo: Using the soundex function: 1:10:27 - Question of the week: Question of the week: How to export query results into a file (e.g. CTAS, but into a single file)?: 1:18:46 Show Notes: https://trino.io/episodes/17.html Show...

- Intro Song: 00:00​ - Intro: 00:34​ - News: 7:28​ - Concept of the week: Apache Druid and realtime analytics: 14:51 - PR of the week:PR 3522 Add Druid connector: 33:35 - Demo: Using the Druid Web UI to create an ingestion spec querying via Trino: 1:01:29 - Question of the week: Why doesn’t the Druid connector use the native json over http calls?: 1:10:20 Show Notes: https://trino.io/episodes/16.h...

- Intro Song: 00:00​ - Intro: 00:34​ - News: 6:37​ - Concept of the week: Apache Iceberg and the Iceberg spec: 13:32 - PR of the week: PR 7233 Fix queries on tables without snapshot id: 1:07:44 - Demo: Creating tables with Iceberg and reading the data in Trino: 1:10:39 - Question of the week: What do I do to restart the test pipeline if it fails on me?: 1:23:35 Show Notes: https://trino.io/episode...

- Intro Song: 00:00​ - Intro: 00:34​ - News: 7:57​ - Concept of the week: Apache Iceberg and the table format: 17:14 - PR of the week: PR 1067 Add Iceberg connector: 59:22 - Demo: Creating tables through Iceberg and reading them through Trino: 1:04:04 - Question of the week: Why do we still depend on the Hive metastore if metadata for Iceberg saves to the filesystem?: 1:18:39 Show Notes: https://t...