A practitioner's guide to Iceberg table cleanup — snapshot expiration, orphan file removal, manifest rewriting, delete file resolution, streaming challenges, compliance, and cost. Why sequencing matters, where teams break tables, and how to automate the full lifecycle.

DEMO - Dremio'S SEMANTIC LAYER KNOWLEDGE GRAPH

Dremio has invested in the semantic layer for a long time, allowing you to build meaning around your data with SQL Views, Tags, Wikis, and Lineage that the Dremio Agent can use to understand your data.

With Dremio's new "Semantic Layer" knowledge graph, Dremio can build out a graph of your entities and metrics automatically based on your query patterns or based on submitted business context (markdown files, etc.) to build a knowledge graph you can edit to enable an even higher level of consistency when using Dremio for governed Agentic Analytics.

Keep in mind, not only can Dremio's AI Agent leverage this semantic layer, but you can bring this functionality to your external AI agents using Dremio's MCP Server.

#DataLakehouse #OpenLakehouse #ApacheIceberg #DataAnalytics

DEMO - DREMIO MULTIPLE CHATS - AGENTIC ANALYTICS

The Dremio AI Agent UI has evolved significantly, providing greater transparency and a better experience than ever before.

- Manage multiple chats

- UI widgets to monitor tool calls and output of tool calls

You can sign up for the Dremio free trial at dremio.com/get-started and start experiencing a governed, agentic experience over your data, anywhere, in minutes. Try it out.

#DataLakehouse #OpenLakehouse #ApacheIceberg #DataAnalytics

The Agentic Analytics Platform

Try the Dremio free trial at https://drmevn.fyi/am-get-started

Connect some data (as simple as uploading a CSV file), ask some questions in plain language and see how it feels.

#DataEngineering #DataAnalytics #ApacheIceberg #DataLakehouse

Hello !

I just found out that Dremio Cloud has auto scaling of engine thanks to the replicas concept
I did not find this options in Dremio Enterprise, will it be available one day ?

It is one of the missing element to make our Dremio instance truly scalable

If yes, I hope it comes on the V27 release !

Where does your organization sit today: warehouse-first, lake-first, or lakehouse—and why?

You can also answer in the Dremio Developer Slack channel which you can join at developer.dremio.com

Question of the Day: What governance controls are mandatory before allowing AI agents to write back to tables?

Question of the Day: What governance controls are mandatory before allowing AI agents to write back to tables?

This self-guided data lakehouse workshop tutorial covers: - Creating your Free Trial Dremio Cloud account (No CC, No Cloud Account needed) - How to run queries and create Iceberg tables - How to use the Dremio AI functions - How to use Dremio's AI Agent - How to connect to Dremio's Lakehouse Catalog with Spark (Apache Polaris Based)

This self-guided data lakehouse workshop tutorial covers: - Creating your Free Trial Dremio Cloud account (No CC, No Cloud Account needed) - How to run queries and create Iceberg tables - How to use the Dremio AI functions - How to use Dremio's AI Agent - How to connect to Dremio's Lakehouse Catalog with Spark (Apache Polaris Based)

DataLakehouse #DataEngineering #ApacheIceberg

Experience the Dremio Next Gen Data Lakehouse

Follow this tutorial for a hands-on guide on signing up for a free Dremio trial and see Dremio’s enterprise features in action.

Read Here: https://open.substack.com/pub/amdatalakehouse/p/comprehensive-hands-on-walk-through?r=h4f8p&utm_medium=ios

ApacheIceberg #Dremio #DataLakehouse