DEV Community

# dataengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
🦆 DuckDB: The SQLite of Analytics You Didn’t Know You Needed
sanukhandev profile

🦆 DuckDB: The SQLite of Analytics You Didn’t Know You Needed

#duckdb #sql #dataengineering #datascience
Comments
3 min read
The @dataclass Decorator In Python
m-nt-s-no profile

The @dataclass Decorator In Python

#python #programming #datascience #dataengineering
Comments
1 min read
Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #duckdb #iceberg #dataengineering
5
Comments
4 min read
Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing
andrey_s profile

Kimball vs. Inmon: High-Level Design Strategies for Data Warehousing

#datamanagement #dataengineering #database #bigdata
1
Comments
6 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena
datapenguin profile

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

#aws #iceberg #dataengineering
2
Comments
4 min read
Reading CSVs with varying column counts that pandas cannot read using DuckDB
nk_maker profile

Reading CSVs with varying column counts that pandas cannot read using DuckDB

#dataengineering #duckdb #csv #programming
1
Comments
3 min read
Building a Data Career: The Skills That Truly Matter
datalane profile

Building a Data Career: The Skills That Truly Matter

#datascience #dataengineering #career #sql
10
Comments
5 min read
You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees
andrey_s profile

You Can't Trust COUNT and SUM: Scalable Data Validation with Merkle Trees

#dataengineering #dataquality #datamonitoring #sql
2
Comments 1
8 min read
Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege
qvfagundes profile

Snowflake RBAC 101 – Episode 2: Role Hierarchies & Least Privilege

#dataengineering #dataprivacy #datawarehouse #snowflake
Comments
1 min read
Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

#aws #iceberg #dataengineering #duckdb
5
Comments 1
7 min read
PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods
datapenguin profile

PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods

#aws #iceberg #dataengineering
2
Comments
3 min read
Three Formats Walk into a Lakehouse: Iceberg, Delta and Hudi in a Local Setup You Can Run on Your Laptop
olgabraginskaya profile

Three Formats Walk into a Lakehouse: Iceberg, Delta and Hudi in a Local Setup You Can Run on Your Laptop

#dataengineering #data #tutorial #learning
10
Comments 4
16 min read
The Rise of Real-Time Data: Why Batch Might Be Fading
milcah03 profile

The Rise of Real-Time Data: Why Batch Might Be Fading

#ai #kafka #airflow #dataengineering
10
Comments
3 min read
Engineering with SOLID, DRY, KISS, YAGNI and GRASP
andrey_s profile

Engineering with SOLID, DRY, KISS, YAGNI and GRASP

#dataengineering #softwareengineering #softwaredevelopment #software
1
Comments
16 min read
Which is Best for Real Time Dashboards: Airbyte, Fivetran, or Estuary
techsourabh profile

Which is Best for Real Time Dashboards: Airbyte, Fivetran, or Estuary

#dataengineering #etl #elt
1
Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.