https://jamesm.blog/data-engineering/ Recent content in Data Engineering on jamesm.blog https://jamesm.blog/papermod-cover.png https://jamesm.blog/papermod-cover.png Hugo en Sat, 18 Apr 2026 07:11:00 +0100 https://jamesm.blog/data-engineering/snowflake-apache-iceberg-storage/ Sat, 18 Apr 2026 07:11:00 +0100 https://jamesm.blog/data-engineering/snowflake-apache-iceberg-storage/ Snowflake Storage for Apache Iceberg is now available on AWS and Azure, enabling enterprise-grade reliability and governance for open data formats while breaking vendor lock-in. https://jamesm.blog/data-engineering/following-the-money/ Wed, 08 Apr 2026 07:40:00 +0100 https://jamesm.blog/data-engineering/following-the-money/ Deep dive into the shifting economics of the data landscape in 2026: why the choice between Snowflake and Databricks is increasingly an accounting decision, and where the open-source DIY stack saves money. https://jamesm.blog/data-engineering/modern-data-engineering-databricks-2026/ Mon, 06 Apr 2026 00:19:31 +0100 https://jamesm.blog/data-engineering/modern-data-engineering-databricks-2026/ A 2026 guide to modern data engineering on Databricks, including Unity Catalog, Lakeflow Declarative Pipelines, liquid clustering, predictive optimization, and serverless workflows. https://jamesm.blog/data-engineering/blogs/ Sun, 05 Apr 2026 20:00:00 +0100 https://jamesm.blog/data-engineering/blogs/ Curated list of Data Engineering blogs covering ETL/ELT, data warehousing, orchestration, and modern data stack best practices. https://jamesm.blog/data-engineering/lakeflow-declarative-pipelines-2026/ Sun, 05 Apr 2026 18:00:00 +0000 https://jamesm.blog/data-engineering/lakeflow-declarative-pipelines-2026/ From Delta Live Tables to Lakeflow Declarative Pipelines: how declarative ETL patterns have evolved and how to design production pipelines in 2026. https://jamesm.blog/data-engineering/unity-catalog-in-practice-2026/ Sun, 05 Apr 2026 14:00:00 +0000 https://jamesm.blog/data-engineering/unity-catalog-in-practice-2026/ Real-world lessons from implementing Unity Catalog: migrations, anti-patterns, governance design, and operational learnings. https://jamesm.blog/data-engineering/databricks-vs-snowflake-2026/ Sun, 05 Apr 2026 09:00:00 +0000 https://jamesm.blog/data-engineering/databricks-vs-snowflake-2026/ Head-to-head comparison of Databricks and Snowflake in 2026 - when you should choose each, their actual strengths and weaknesses, and the direction each is moving. https://jamesm.blog/data-engineering/data-engineering-science-courses/ Sat, 04 Apr 2026 20:51:25 +0100 https://jamesm.blog/data-engineering/data-engineering-science-courses/ Comprehensive curated list of data engineering and data science courses from Coursera, DataCamp, A Cloud Guru, Udacity, Google Cloud, and other platforms with learning paths and certifications. https://jamesm.blog/data-engineering/databricks-training-certification/ Sat, 04 Apr 2026 20:47:25 +0100 https://jamesm.blog/data-engineering/databricks-training-certification/ Complete guide to Databricks certifications with training resources, exam costs, and learning paths https://jamesm.blog/data-engineering/databricks-cheatsheet/ Sat, 04 Apr 2026 20:44:25 +0100 https://jamesm.blog/data-engineering/databricks-cheatsheet/ Quick reference guide for Databricks notebooks, SQL DDL/DML, PySpark API, and production patterns https://jamesm.blog/data-engineering/etl-tools/ Sat, 19 Apr 2025 07:30:00 +0100 https://jamesm.blog/data-engineering/etl-tools/ Comprehensive guide to ETL tools and data integration platforms across cloud providers, enterprise solutions, and modern low-code platforms.