DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Data Quality at Scale: Validating Scrapes with Pydantic
deepak_mishra_35863517037 profile

Data Quality at Scale: Validating Scrapes with Pydantic

#automation #codequality #dataengineering #python
3
Comments 2
13 min read
Building a CDC Skyscraper: How SeaTunnel Leverages Debezium Under the Hood
seatunnel profile

Building a CDC Skyscraper: How SeaTunnel Leverages Debezium Under the Hood

#dataengineering #database #opensource #architecture
Comments
3 min read
Medallion Architecture 101: Building Data Pipelines That Don't Fall Apart
aawiegel profile

Medallion Architecture 101: Building Data Pipelines That Don't Fall Apart

#dataengineering #database #python #sql
Comments
11 min read
Amazon S3 Tables Just Got Smarter: Intelligent-Tiering & Native Replication Explained
sumsuzzaman profile

Amazon S3 Tables Just Got Smarter: Intelligent-Tiering & Native Replication Explained

#aws #dataengineering #analytics #cloud
Comments
4 min read
My Friday "Sanity Savers" (Software, Data & DevOps edition) 🛠️
bhoyee profile

My Friday "Sanity Savers" (Software, Data & DevOps edition) 🛠️

#devops #dataengineering #python #productivity
Comments 1
1 min read
Pipelines, ETL, and Warehouses: The DNA of Data Engineering
qvfagundes profile

Pipelines, ETL, and Warehouses: The DNA of Data Engineering

#dataengineering #datascience #beginners #career
5
Comments 3
4 min read
Bulletproof Power Query (Part 2): A Smart, Fuzzy-Match Rename Function
essam404 profile

Bulletproof Power Query (Part 2): A Smart, Fuzzy-Match Rename Function

#powerquery #powerbi #dataengineering #excel
Comments
4 min read
System Architecture Analysis: The Data Pipeline Issues of TraderKnows
bittam profile

System Architecture Analysis: The Data Pipeline Issues of TraderKnows

#dataengineering #fintech #traderknows #webscraping
Comments
2 min read
Building an AI-Powered Customer Churn Prediction Pipeline on AWS (Step-by-Step)
wanjohichristopher profile

Building an AI-Powered Customer Churn Prediction Pipeline on AWS (Step-by-Step)

#aws #machinelearning #dataengineering #python
2
Comments
5 min read
Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms
mahendran_a3347c2dfcca93e profile

Beyond Tagging: A Blueprint for Real-Time Cost Attribution in Data Platforms

#dataengineering #finops #bigdata #costoptimization
Comments
9 min read
Introducing `everyrow.io/dedupe`: An LLM-based approach to semantic deduplication
rafael_poyiadzi_85c2eed09 profile

Introducing `everyrow.io/dedupe`: An LLM-based approach to semantic deduplication

#showdev #data #dataengineering #llm
2
Comments
6 min read
Why Your Model is Failing (Hint: It’s Not the Architecture)
nastaranai profile

Why Your Model is Failing (Hint: It’s Not the Architecture)

#machinelearning #deeplearning #pytorch #dataengineering
Comments
4 min read
Architecting for the Crash: Why 'Clean Data' is the Only Safety Net in Trading Wind-Down (TWD)
agattus profile

Architecting for the Crash: Why 'Clean Data' is the Only Safety Net in Trading Wind-Down (TWD)

#fintec #architecture #dataengineering #management
1
Comments
3 min read
How One Can Start Their Journey in Data Engineering
chaets profile

How One Can Start Their Journey in Data Engineering

#programming #dataengineering #sql #beginners
Comments 2
4 min read
The Time Our Pipeline Processed the Same Day’s Data 47 Times
pradeep_kaalluri profile

The Time Our Pipeline Processed the Same Day’s Data 47 Times

#dataengineering #airflow #python #programming
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.