DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
ETL vs ELT: Which One Should You Use and Why?

ETL vs ELT: Which One Should You Use and Why?

1
Comments
7 min read
Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026

Airflow vs Prefect vs Dagster: Picking the Right Orchestrator in 2026

Comments
6 min read
Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform

Your Customer Table Has Duplicates You Can't See With SQL How I Built a Cross-Platform Identity Resolution Layer for a Dark Kitchen Data Platform

3
Comments
8 min read
PostgreSQL Foreign Data Wrappers: Cross-Database Queries Explained

PostgreSQL Foreign Data Wrappers: Cross-Database Queries Explained

Comments
4 min read
What Is Apache Polaris? Why Open Data Catalogs Matter and How to Use Them with AWS

What Is Apache Polaris? Why Open Data Catalogs Matter and How to Use Them with AWS

6
Comments
11 min read
ETL vs ELT: Two Paradigms, One Goal

ETL vs ELT: Two Paradigms, One Goal

Comments
5 min read
Building Market Data Pipelines Without REST Boilerplate

Building Market Data Pipelines Without REST Boilerplate

1
Comments 1
4 min read
DataFrames & SQL in Databricks: Reading, Writing, and Transforming Data

DataFrames & SQL in Databricks: Reading, Writing, and Transforming Data

1
Comments
6 min read
From Tables to Tides: Navigating Databases, Warehouses, Marts, Lakes, and the Lakehouse Revolution

From Tables to Tides: Navigating Databases, Warehouses, Marts, Lakes, and the Lakehouse Revolution

1
Comments
7 min read
I Got a Teams Message: 'Why Do We Need a Semantic Layer?'

I Got a Teams Message: 'Why Do We Need a Semantic Layer?'

Comments
7 min read
Meta Data Engineering Interview Questions: Top Topics, Problems & Solutions

Meta Data Engineering Interview Questions: Top Topics, Problems & Solutions

Comments
36 min read
ETL vs ELT: Which One Should You Use and Why?

ETL vs ELT: Which One Should You Use and Why?

3
Comments
5 min read
Why Salesforce to Power BI Integrations Break at Scale (And How to Design Them Properly)

Why Salesforce to Power BI Integrations Break at Scale (And How to Design Them Properly)

Comments
7 min read
The Seven Engineering Problems That Make Real-Time Enterprise Sync Almost Impossible

The Seven Engineering Problems That Make Real-Time Enterprise Sync Almost Impossible

Comments
9 min read
Microsoft Fabric and OneLake: The Unified Data Platform

Microsoft Fabric and OneLake: The Unified Data Platform

Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.