Your Data, Your Lake: How Observe Uses Iceberg and Streaming ETL for Observability
Data Engineering Podcast

Your Data, Your Lake: How Observe Uses Iceberg and Streaming ETL for Observability

January 18, 20261 hr 12 min

Summary In this episode Jacob Leverich, cofounder and CTO of Observe, talks about applying lakehouse architectures to observability workloads. Jacob discusses Observe’s decision to leverage cloud-native warehousing and open table formats for scale and cost efficiency. He digs into the core pain points teams face with fragmented tools, soaring costs, and data silos, and how a lakehouse approach - paired with streaming ingest via OpenTelemetry, Kafka-backed durability, curated/columnarized tables, and query orchestration - can deliver low-latency, interactive troubleshooting across logs, metrics, and traces at petabyte scale. He also explore the practicalities of loading and organizing telemetry by use...

Play episode

No transcript for this episode yet

You can still listen to it in the player. On episodes with a transcript, you can tap any word to see its meaning.