Stefan Kecskes

Never stop learning, because life never stops teaching

Delta Lake Evolution and Migrations

In the world of data management, we often talk about schema migrations. But what exactly is schema migrations, and why it is so crucial to have a proper plan for data management? I will show you naive approach, explore some traditional solutions. We will see Delta Lake in action, but also how we can do schema migrations with our own way.

Data Modeling

Often, we leave the intricate details of data structures and performance to the DB Admin team, assuming that upscaling servers will solve everything. I used to think data modeling was just a fancy term for database design with only one right way to do it. Let’s talk about the crucial differences between transactional and analytical data modeling, each with its own tools and techniques