Published inLevel Up CodingArchitecture for a data lake REST API using Delta Lake, Fugue & Spark“Hey, we need some kind of a REST API over all our data lakes to let analysts and other integrations query records on demand . Can we…Aug 15, 20233Aug 15, 20233
Published inLevel Up CodingArchitecture for generative Terragrunt & Terraform infrastructure as code (IaC)This article covers a specific scenario where despite trying to leverage as many DRY (don’t repeat yourself) principles made available to…Feb 26, 2023Feb 26, 2023
Published inLevel Up CodingFully automated Lets Encrypt TLS certs with ACME-DNS on KubernetesThis article covers fully automating DNS and the issuance of TLS certificates of Kubernetes for Ingress based workloads (both public and…Sep 8, 2022Sep 8, 2022
Published inLevel Up CodingReacting to K8s Events with k8s-watcherAs part of a recent project which needs to automatically issue new TLS certificates for hosts defined in Kubernetes Ingress objects, I…May 23, 2022May 23, 2022
Published inLevel Up CodingArchitecture for non-deterministic mass data collection: part 2: dynamic data lake schemasNote, this is the final part of a two part series about this project; article #1 is here.Feb 14, 2022Feb 14, 2022
Published inLevel Up CodingArchitecture for non-deterministic mass data collection: part 1: collection engineNote, this is part one of a two part series about this project; article #2 is here.Jan 23, 2022Jan 23, 2022
Published inLevel Up CodingServerless AWS Lambda architecture for large scale data ingestionRecently was faced with a requirement to build out an extensible data import framework that would be able to consume various file formats…Nov 29, 2021Nov 29, 2021
Published inDevOps DudesUsing private Python Azure Artifacts feeds in Alpine Docker buildsThis one will be relatively short, figured I’d post this for anyone else who was struggling with use case.Jun 3, 2021Jun 3, 2021
AWS Glue: Continuation for job JobBookmark does not existThis will be a quick post but could not find much on this error, so figured I’d post it for others.Apr 4, 20211Apr 4, 20211
Published inLevel Up CodingImmutable health check managementIf you’ve ever had to monitor an application, endpoint or website, you’ve likely come across literally hundreds of monitoring services…Aug 25, 2020Aug 25, 2020
Published inLevel Up CodingState management in Tekton pipelines with Slack interactive messagesEarlier this year I re-entered the rabbit hole which is the dizzying world of CI/CD platforms and solutions. Today’s marketplace presents…Aug 13, 2020Aug 13, 2020
Published inLevel Up CodingContinuous delivery with FluxThe acronym “CI/CD” and its respective phrases (continuous integration & continuous [delivery|deployment]) are sometimes munged together…May 22, 2020May 22, 2020
Published inThe StartupRetrying failed operationsThis is a long overdue followup to my prior article titled “Reactive re-engineering with Akka” in which I described an approach to…Apr 7, 2020Apr 7, 2020
Published inLevel Up CodingLocal CI/CD with SkaffoldThe world of software development and how apps are run in production environments has come a long way over the years. Starting with bare…Mar 13, 2020Mar 13, 2020
Published inLevel Up CodingMigrate from Helm 2 Tillerless to Helm 3If you’re like many others out there, you’ve been holding off of migrating to Helm 3 until at least version 3.1 is out. Well as of early…Mar 10, 2020Mar 10, 2020
Published inLevel Up CodingWhy doesn’t Azure DevOps git repos get any love?One team I’ve been working with utilizes Azure DevOps Git Repos, not necessarily by an act of free will, but more one due to their…Mar 6, 2020Mar 6, 2020
Published inDevOps Dudesgit2consul alternatives: key-value filesystem syncing for ConsulI’ve recently been working on a project where a set of application runtime configuration was stored in Consul by using Consul’s key-value…Feb 20, 2020Feb 20, 2020
Published inLevel Up CodingCI/CD control flow with Git commit message argumentsCI/CD systems, for all their fascinating inner workings, complexity and inordinate amounts of configurability; at the end of the day, are…Jan 4, 2020Jan 4, 2020