Stefan Kecskes

Never stop learning, because life never stops teaching

Delta Lake Evolution and Migrations

In the world of data management, we often talk about schema migrations. But what exactly is schema migrations, and why it is so crucial to have a proper plan for data management? I will show you naive approach, explore some traditional solutions. We will see Delta Lake in action, but also how we can do schema migrations with our own way.

Posted by Stefan Kecskes on Monday, October 21, 2024

Data Modeling

Often, we leave the intricate details of data structures and performance to the DB Admin team, assuming that upscaling servers will solve everything. I used to think data modeling was just a fancy term for database design with only one right way to do it. Let’s talk about the crucial differences between transactional and analytical data modeling, each with its own tools and techniques

Posted by Stefan Kecskes on Tuesday, June 4, 2024

Using Volumes in Kubernetes

Volumes in Kubernetes are used to store data used by our applications. So that concept is very similar to volumes in docker containers. But there are some subtle differences, as always in life; nothing can be simple. :) There are many types of volumes in Kubernetes, and in this post, we will group them by properties and see some of the most common types.

Posted by Stefan Kecskes on Friday, May 10, 2024

Interviews these days...

Interviews are the dreaded part of the job search process. They can be nerve-wracking, stressful, and sometimes downright bizarre. Only software engineers will understand what I am talking about. What if I could show how conversations on interviews feel to non-software engineers?

Posted by Stefan Kecskes on Friday, May 3, 2024

Declarative Kubernetes

Imperative approach using kubectl .... is great, but we came at some point to situation where our commands became too long with many parameters or that running the same command again and again was time-consuming and more error-prone. That is where we stop using imperative approach and start to use declarative approach with Kubernetes Resource definition files.

Posted by Stefan Kecskes on Tuesday, April 30, 2024