DS Stream logo
AI Transformation
AI TRANSFORMATION
Services
Services
SERVICES
Solutions
Solutions
SOLUTIONS
Insights
INSIGHTS
Blog
Case Studies
Webinars
About Us
ABOUT US
CONTACT
Blog
Michal Milosz
Latest blog posts by Michal Milosz
Latest blog posts
View all
BI and Big Data Consulting
Custom Software Development
DevOps Managed Services
Data Pipelines
AI Agents
AI in Retail
AI Engineering
AI Transformation
AI Sales
AI Security
Generative AI
Databricks
CSR
MLOps
Google Cloud Platform
Data Migration
Data Analysis
Data Engineering
DevOps
Quantum Computing
Augmented Reality
Internet of Things
Blockchain Technology
Cyber Security
Cloud Computing
Data Science
Artificial Intelligence
Machine Learning
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
No blog posts found.
Data Engineering
6
min read
Databricks Lakebase: The Reality of Postgres inside the Lakehouse
What Databricks Lakebase really delivers: Federation vs Lakehouse Sync, copy-on-write branching for CI/CD, cold starts, token expiry and governance.
Read more
Data Engineering
9
min read
Breaking the Last Barrier: Why We Are Building Full-Stack Web Apps Directly Inside Databricks
Databricks Apps lets data engineers build and deploy secure full-stack internal web apps inside the lakehouse, without the usual infrastructure friction.
Read more
Data Engineering
9
min read
The Orchestration Dilemma: Driving the Engine vs. Designing the Factory
Databricks Workflows or Delta Live Tables in 2026? Compare driving the engine with designing the factory, and stop hand-wiring fragile data jobs.
Read more
Data Engineering
10
min read
"SQL is the New Regex": Cleaning Messy Data with Databricks ai_query
Replace brittle regex and manual string parsing with Databricks ai_query, using SQL and PySpark AI functions to clean and standardize messy text data.
Read more
Data Engineering
9
min read
The "Shift Left" Revolution: Why Your PySpark Pipelines Need Unit Tests (and How to Do It)
Shift left on data quality: unit test PySpark pipelines with modular code, local tests and CI/CD so bugs surface before they ever reach production.
Read more
Data Engineering
6
min read
The Orchestration Dilemma: Declarative vs. Imperative Patterns in Modern Data Engineering
Declarative Delta Live Tables or imperative Databricks Workflows? How to choose an orchestration pattern that fits your data platform and your team.
Read more
Data Engineering
8
min read
Streamlining CI/CD for Databricks Workflows with DAB Templates and Azure DevOps/GitHub Actions
Automating Databricks deployments with DAB templates and CI/CD tools ensures fast, error-free pipelines - read to learn how.
Read more
Data Engineering
6
min read
Unity Catalog and Volumes in Databricks Explained
Unity Catalog and Volumes: a data engineer's guide to modern data governance in Databricks, covering access control, lineage, and managed storage.
Read more
Data Engineering
16
min read
Designing Scalable Data Pipelines: A Practical Guide
Scalable data pipelines by design: learn batch, streaming, and layered architectures, with patterns and trade-offs for building reliable data systems.
Read more
Data Engineering
10
min read
The Power of Orchestration: Managing Complex Workflows in Databricks
Master Databricks workflow orchestration – automate tasks, integrate Airflow & ADF, and optimize pipelines. Boost efficiency with dynamic scheduling!
Read more
1
Next