Skip to content

DEV Community

# dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Benjamin Ibrulj

Dec 29 '25

Building a Realistic Banking Dummy Data Generator with Bad-Data Simulation

#dataengineering #python #opensource #sql

1 min read

maghsood esmaeili

Dec 16 '25

How to Sync Data from an Oracle Table to Elasticsearch using Kafka Connect

#database #kubernetes #dataengineering #tutorial

5 min read

Nov 24 '25

Agent Cost Optimization: A Data Engineer's Guide

#dataengineering #ai

13 min read

Pradeep Kalluri

Nov 22 '25

From Raw to Refined: Data Pipeline Architecture at Scale

#dataengineering #bigdata #python #dataquality

12 min read

Nov 24 '25

INTRODUCTION TO DBT(Data Build Tool)

#dataengineering #data #analytics

2 min read

Hammad Ahmed 🎩

Dec 27 '25

What's New in dbt 1.10

#dbt #data #datascience #dataengineering

12 min read

Karthikeyan Rajasekaran

Dec 26 '25

The Day Our Pipeline Went From 10 Minutes to 6 Seconds (Part 2 of 3)

#dataengineering #dbt #dagster #data

7 min read

Dec 26 '25

How Strategic Image Cropping Transforms Data Ingestion Pipelines

#dataengineering #machinelearning #performance

4 min read

Arvind SundaraRajan

Nov 22 '25

Taming the Data Beast: Build Pipelines That Bend, Not Break by Arvind Sundararajan

#dataengineering #datascience #architecture #data

2 min read

Shrinivas Vishnupurikar

Dec 26 '25

Snowflake + Postgres: A Small Feature That Signals a Big Shift

#snowflake #postgres #database #dataengineering

6 min read

Pradeep Kalluri

Nov 24 '25

Data Quality at Scale: Why Your Pipeline Needs More Than Green Checkmarks

#dataengineering #dataquality #bigdata #python

8 min read

Vinicius Fagundes

Dec 5 '25

Prompt Engineering Patterns: From Zero-Shot to Chain-of-Thought Reasoning

#ai #mcp #llm #dataengineering

14 min read

David Aronchick

Nov 25 '25

While We're Measuring Developer Productivity, Won't Someone Think of the Data Engineers?

#dataengineering #devrel #productivity #observability

9 min read

Dec 24 '25

Behind the Scenes of Data Ingestion: How Small Issues Cause Big Headaches

#dataingestion #medallion #dataengineering #datafactory

3 min read

Karthikeyan Rajasekaran

Dec 24 '25

Modern Data Pipelines: Why Five Layers Changed Everything (Part 1 of 3)

#dataengineering #dbt #dagster #python

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.