Cloud Architecture Notepad

Notes about AWS, GCP, K8s, AI and Data

Abstract

My job has been converting technical requirements of a project into the architecture and design that will guide the final product. For many years, I’ve been creating fault-tolerant and highly available cloud solutions that are deployed worldwide and are managed by very small teams. I’m sharing my experiences and some of the solutions that I have designed and implemented.

In the last years, there have been looking at some technologies that have brought my attention, first Golang, from a very strong background in low latency Java services, this new modern language brings a new set of possibilities to write very fast services, the power of C/C++ with a much easier easy way to develop. On the other hand, software distribution has been revolutionised tools like Packer or Docker that do not require any specific version of a virtual machine or interpreter installed, this gives a more reliable way to produce software.

I see, it has been as a cycle, We knew that C/C++ was the language to produce very fast services but maintenance, learning and even compiling it wasn’t the best solution, now We are in another era in which internet and Github join forces to make software sharing easier to everyone and Go uses this to produce a binary that can be run in any supported OS.

The other tech stack is Kubernetes (K8s), for years working on Cloud environments I see that the benefits of running Kubernetes are huge, from cost savings to faster software development. I am currently on the path of a migration of a very large platform with multiple different types of workloads, APIs, UIs, batch processing and low latency services, I’ll sharing this journey.

Hopefully this blog will help someone.

Latest Posts

Kafka Auth Handler Goes Multi-Cloud
Kafka Auth Handler Goes Multi-Cloud

Back in December 2024, I wrote about gcp-kafka-auth-handler, a utility I created to bridge the authentication gap between Apache Beam Dataflow and GCP Managed Kafka. Since then, the project has evolved significantly as part of our broader multi-cloud journey. Today, I’m pleased to announce that the library has been renamed to kafka-auth-handler and now supports both GCP and AWS MSK.

Building an Open Deployment Framework with GitHub Actions
Building an Open Deployment Framework with GitHub Actions

Managing CI/CD pipelines across multiple repositories can quickly become unwieldy. Each project needs versioning, container builds, deployments, and releases—often with subtle variations that lead to duplicated workflow code. This post introduces an open deployment framework built entirely on GitHub Actions, designed to bring consistency and reusability to cloud-native deployments.

GCP Managed Kafka Authentication Handler
GCP Managed Kafka Authentication Handler

When working with Google Cloud Platform’s Managed Service for Apache Kafka, you’ll quickly discover that authentication can be surprisingly challenging, especially when using Apache Beam Dataflow pipelines. In this post, I’ll share a utility I created called gcp-kafka-auth-handler that bridges this gap.