Introduction In this article I will provide a quick introduction to Azure Functions and Terraform with a hands-on example which is quite easy to follow. There are many articles out there about Azure Functions, but most fails to explain how to automate their deployment for a real world scenario using CI/CD…

Introduction In this article, I will discuss the implications of running Spark with Cassandra compared to the most common use case which is using a deep storage system such as S3 of HDFS. The goal is to understand the internals of Spark and Cassandra so you can write your code as…

Introduction Since I got involved in DevOps and Big Data, I’ve been using two excellent but quite different programming languages: GO and Scala. Scala is an older and more mature programming language that has found its niche in areas such concurrent programming and Big Data processing. Go, in the other hand…

Introduction Big Data is complex, I have written quite a bit about the vast ecosystem and the wide range of options available. One aspect that is often ignored but critical, is managing the execution of the different steps of a big data pipeline. …

Introduction If you are not new to Kubernetes, probably you heard this a million times: “Do not run databases on Kubernetes!”; …

Introduction I’ve been using Scala for a few years now, building a wide range applications, from stream processing to data pipelines; at the same time, I’ve been hearing many good things about Rust, so recently I decided to spend time learning Rust. Both languages, although created to achieve different goals, share…

Introduction I’ve been using Go for a while now to build a wide range of applications; at the same time, I’ve been hearing many good things about Rust, so recently I decided to spend time learning Rust. Both languages, although created to achieve different goals, share many similarities. During the last…

Introduction If you are reading this article you are probably wondering what a Data Mesh is, and to be honest, I’m still wondering the same thing. I’ve read many articles and I’m still confused. How do I implement a Data Mesh? Looking at different articles, the implementation, and even some ideas…

Introduction In this article, I’m going to review my favorite GitOps tools currently available in Kubernetes. This article is based on my previous article where I reviewed more of my favorite Kubernetes tools. In my opinion, the main advantage of Kubernetes lies in its declarative nature paired together with the control…