Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
How Linux is Used in Real-World Data Engineering
Naomi Jepkorir
Naomi Jepkorir
Naomi Jepkorir
Follow
Apr 21
How Linux is Used in Real-World Data Engineering
#
dataengineering
#
linux
#
data
#
bash
2
 reactions
Comments
Add Comment
3 min read
Building with Snowflake Cortex Analyst — What I Learned About Semantic Layers and Guardrails
Vijay Ashley Rodrigues
Vijay Ashley Rodrigues
Vijay Ashley Rodrigues
Follow
Mar 18
Building with Snowflake Cortex Analyst — What I Learned About Semantic Layers and Guardrails
#
dataengineering
#
snowflake
#
architecture
#
mcp
Comments
Add Comment
2 min read
🚀 Apache Spark Just Killed the Microbatch Barrier (And Why Flink Should Be Worried)
Siddhesh Surve
Siddhesh Surve
Siddhesh Surve
Follow
Mar 18
🚀 Apache Spark Just Killed the Microbatch Barrier (And Why Flink Should Be Worried)
#
dataengineering
#
apachespark
#
bigdata
#
cloudcomputing
1
 reaction
Comments
Add Comment
3 min read
greatCircleDistance in ClickHouse: Avoiding Full Table Scans
Mohamed Hussain S
Mohamed Hussain S
Mohamed Hussain S
Follow
Apr 20
greatCircleDistance in ClickHouse: Avoiding Full Table Scans
#
clickhouse
#
sql
#
dataengineering
#
performance
3
 reactions
Comments
Add Comment
2 min read
ETL vs ELT: Which One Should You Use and Why?
Rose1845
Rose1845
Rose1845
Follow
Apr 9
ETL vs ELT: Which One Should You Use and Why?
#
dataengineering
#
etl
#
datapipeline
4
 reactions
Comments
Add Comment
4 min read
My first Python project: Excel to SQL pipeline (feedback welcome)
Juliana Albertyn
Juliana Albertyn
Juliana Albertyn
Follow
Mar 30
My first Python project: Excel to SQL pipeline (feedback welcome)
#
python
#
codequality
#
opensource
#
dataengineering
1
 reaction
Comments
Add Comment
1 min read
# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt
ayoabass777
ayoabass777
ayoabass777
Follow
Apr 18
# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt
#
dataengineering
#
kafka
#
dbt
#
postgres
7
 reactions
Comments
Add Comment
6 min read
Snowflake Cost Optimization Starts With Workload Design, Not Auto-Suspend
Sandeep Bhatia
Sandeep Bhatia
Sandeep Bhatia
Follow
Mar 16
Snowflake Cost Optimization Starts With Workload Design, Not Auto-Suspend
#
architecture
#
database
#
dataengineering
#
performance
Comments
Add Comment
5 min read
How Bruin turns a SELECT query into 9 different materialization strategies across 14 databases
Baris Terzioglu
Baris Terzioglu
Baris Terzioglu
Follow
Mar 15
How Bruin turns a SELECT query into 9 different materialization strategies across 14 databases
#
dataengineering
#
go
#
sql
#
programming
Comments
Add Comment
10 min read
Materialization strategies: how Bruin and dbt turn SELECT queries into tables
Baris Terzioglu
Baris Terzioglu
Baris Terzioglu
Follow
Mar 15
Materialization strategies: how Bruin and dbt turn SELECT queries into tables
#
dataengineering
#
sql
#
dbt
#
datapipeline
Comments
Add Comment
11 min read
Data quality testing: how Bruin and dbt take different paths to the same goal
Baris Terzioglu
Baris Terzioglu
Baris Terzioglu
Follow
Mar 15
Data quality testing: how Bruin and dbt take different paths to the same goal
#
dataengineering
#
sql
#
dataquality
#
devops
1
 reaction
Comments
Add Comment
7 min read
SQLite, Go/Postgres, & Petabytes: Database Patterns for Builders
soy
soy
soy
Follow
Mar 28
SQLite, Go/Postgres, & Petabytes: Database Patterns for Builders
#
database
#
sql
#
dataengineering
2
 reactions
Comments
Add Comment
4 min read
Creating a Cross-platform Data Sandbox that makes Working with Data Easier and Faster
Murad Aghamirzayev
Murad Aghamirzayev
Murad Aghamirzayev
Follow
Mar 15
Creating a Cross-platform Data Sandbox that makes Working with Data Easier and Faster
#
dataengineering
#
python
#
datascience
#
sql
1
 reaction
Comments
Add Comment
3 min read
Data Engineering Interviews Are Broken (Here's Proof)
DataDriven
DataDriven
DataDriven
Follow
Apr 7
Data Engineering Interviews Are Broken (Here's Proof)
#
dataengineering
#
career
#
interview
#
python
Comments
Add Comment
6 min read
Fixing 168K Failed FHIR Conversions with Parallel AI Agents and Git Worktrees
Budi Widhiyanto
Budi Widhiyanto
Budi Widhiyanto
Follow
Apr 17
Fixing 168K Failed FHIR Conversions with Parallel AI Agents and Git Worktrees
#
healthinformatics
#
ai
#
dataengineering
#
fhir
1
 reaction
Comments
Add Comment
10 min read
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account