41: Trino Puts On Its Hudi Trino Community Broadcast podcast

1+ y ago 1:43:00

Contenuto fornito da Brian Olsen and Trino Community. Tutti i contenuti dei podcast, inclusi episodi, grafica e descrizioni dei podcast, vengono caricati e forniti direttamente da Brian Olsen and Trino Community o dal partner della piattaforma podcast. Se ritieni che qualcuno stia utilizzando la tua opera protetta da copyright senza la tua autorizzazione, puoi seguire la procedura descritta qui https://it.player.fm/legal.

Trino's initial use case was around replacing the Apache Hive runtime. As data lakes grew into prominence, it became clear that having a faster query engine didn't solve all problems. The Hive model itself was a huge bottleneck and didn't provide features that companies needed akin to data warehouses and databases. Apache Hudi is a new table format created out of Uber that aims to address many of these issues and usher in a new generation of data lake.

Tune in as we speak to the Trino Hudi connector contributor Sagar Sumit and Grace Lu who uses Trino and Hudi at Robinhood to discuss the new Hudi connector and future plans!

- Intro Music: 0:00

- Intro: 0:32

- Releases: 14:43

- Concept of the episode: Intro to Hudi and the Hudi connector: 22:29

- Concept of the episode: Merge on read and copy on write tables: 28:28

- Concept of the episode: Hudi metadata table: 39:24

- Concept of the episode: Hudi data layout: 46:39

- Concept of the episode: Robinhood Trino and Hudi use cases: 51:12

- Concept of the episode: Current state and roadmap for the Hudi connector: 1:03:15

- Pull request of the episode: PR 14445: Fault-tolerant execution for PostgreSQL and MySQL connectors: 1:08:14

- Demo of the episode: Using the Hudi Connector: 1:13:34

Show Notes: https://trino.io/episodes/41.html

Show Page: https://trino.io/broadcast/

53 episodi