Sign in Get started

Publication // Intelligence

Data Engineering Central

Technology · English

Data Engineering Central publishes a mix of interviews, technical essays, and podcast episodes focused on the intersection of data engineering and artificial intelligence, specifically covering topics like LLM serving, Rust-based infrastructure, and agentic workflows. The publication targets data engineers and infrastructure practitioners by providing frontline insights into tools such as Databricks, LakeSail, and Omnigent, alongside discussions on the evolving role of coding skills in an AI-driven landscape.

Audience

24K

subscribers

Momentum

—

recent change

Sponsors detected

1

in recent articles

Recent content

Databricks LLM (APIs)/Modeling Serving. Thoughts from the Frontline.

Sponsor · Delta

The Future of Data Engineering in the Age of AI | Erfan Hesami

Back to the Basics. Threads.

Sponsor · Delta

Big Tech Laid Him Off. He Realized He Didn’t Need a Job. — Asian Dad Energy

Back to the Basics. Recursion.

Spark Isn't Going Anywhere. So They Rebuilt It in Rust. — Shehab Amin, CEO of LakeSail

Omnigent. Too afraid to ask what a meta-harness for Agents is?

Sponsor · Delta

The Polemic Against Cheap Code.

Lakesail. Replacing Spark with Rust. But with Spark.

Quasi-Agentic Pipelines with Databricks and Apache Airflow

Sponsor · Delta

Solution > Problem.

Keeping Technical Skills in the Age of the LLM

Topics

Data engineering Agentic coding LLM serving Databricks Agentic applications

Audience signals

Data engineers CTOs software engineers ML engineers Product managers Founders building AI applications AI Engineers Analytics Engineers

Sponsors

Recent guests

Founder of Pipeline to Insights discussing the future of data engineering with AI.

Founder · Pipeline to Insights · 10d

Co-founder and CEO of LakeSail, rebuilding Apache Spark in Rust.

LakeSail · 24d

Founder and CEO of Orchestra, discussing agentic data engineering

Founder and CEO · Orchestra · 66d