DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Rethinking Data Engineering: Why ETL Pipelines Still Take Too Long — and a New Way Forward
candor_cj profile

Rethinking Data Engineering: Why ETL Pipelines Still Take Too Long — and a New Way Forward

#etlpipelines #schemamapping #vibecodingide #dataengineering
1
Comments 1
3 min read
Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻
wellallytech profile

Stop Losing Your Health Data! Build a Lifelong Electronic Health Record (EHR) System with Neo4j and GraphRAG 🏥💻

#ai #python #rag #dataengineering
Comments
3 min read
Building Your First Airflow DAG: Extracting Stock Data with Massive
nganga_njongo profile

Building Your First Airflow DAG: Extracting Stock Data with Massive

#airflow #dataengineering #python #api
2
Comments
4 min read
How I scrape and de-dupe Meta ads for 1000 brands
soumo_banerjee profile

How I scrape and de-dupe Meta ads for 1000 brands

#python #playwright #dataengineering
5
Comments
6 min read
I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP
tfearn profile

I Built a Market Intelligence Agent That Operates a Data Platform Autonomously via MCP

#ai #agents #mcp #dataengineering
1
Comments
2 min read
Building a simple data pipeline with GCS and Databricks Autoloader
tinyhero13 profile

Building a simple data pipeline with GCS and Databricks Autoloader

#cloud #dataengineering #python #tutorial
Comments
1 min read
Implementing a Centralized Metrics Layer with dbt and a Semantic Layer
beefedai profile

Implementing a Centralized Metrics Layer with dbt and a Semantic Layer

#dataengineering
Comments
9 min read
Rebuilding the national narrative with AI and Docker
b-qt profile

Rebuilding the national narrative with AI and Docker

#dataengineering #python #opensource #docker
1
Comments
3 min read
Columnar Databases (ClickHouse/Snowflake)
godofgeeks profile

Columnar Databases (ClickHouse/Snowflake)

#architecture #database #dataengineering #performance
1
Comments
8 min read
ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis
manveer_chawla_64a7283d5a profile

ClickHouse Native JSON Support in 2026: A PR-by-PR Analysis

#data #dataengineering #clickhouse #json
6
Comments 1
24 min read
Part 11 - Dimensions and Fact Table 📊
abdelrahman_adnan profile

Part 11 - Dimensions and Fact Table 📊

#database #dataengineering #sql #tutorial
Comments
2 min read
Part 8 - Staging Load into Postgres 🗃️
abdelrahman_adnan profile

Part 8 - Staging Load into Postgres 🗃️

#database #dataengineering #postgres #tutorial
Comments
2 min read
Part 7 - Spark Transform Local vs Cloud ⚡
abdelrahman_adnan profile

Part 7 - Spark Transform Local vs Cloud ⚡

#aws #cloud #dataengineering #tutorial
Comments
2 min read
Part 1 - Introduction and End-to-End Architecture
abdelrahman_adnan profile

Part 1 - Introduction and End-to-End Architecture

#architecture #data #dataengineering #tutorial
Comments
2 min read
Part 12 - Superset Seeding and Dashboards 🎛️
abdelrahman_adnan profile

Part 12 - Superset Seeding and Dashboards 🎛️

#automation #dataengineering #python #tutorial
Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.