Databricks
4 articles in the last 30 days.
-
QCon San Francisco 2026: The Future of Apache Iceberg
Daniel Weeks, Apache Iceberg co-creator, outlined the proposed V4 of the table format. It redesigns table metadata for better scalability and more frequent writes, plus new data management and schema evolution features.
-
What’s Going To Matter In 2027 For Data Engineers?
Reviews data-team trends seen across startups, SMBs and enterprises in 2026, including growing use of coding agents. It asks what the data engineering role will look like in 2027.
-
Why most of your dbt models aren't in a hurry, and what that's worth in Snowflake credits
Espresso AI's CEO argues that only dbt models on the critical path affect job runtime, so off-path queries can run on smaller warehouses to save Snowflake or Databricks credits. Espresso uses reinforcement learning to keep reassigning warehouses as the DAG changes.
-
Data Engineering Weekly #293
Roundup with Pinterest's Metrics Board for agent-ready shared metric definitions, a comparison of Snowflake, Databricks and Microsoft semantic layers with Apache Ossie, and a Nov 4 virtual summit.