Published inLevel Up CodingArchitecture for a data lake REST API using Delta Lake, Fugue & Spark“Hey, we need some kind of a REST API over all our data lakes to let analysts and other integrations query records on demand . Can we…Aug 15, 20233Aug 15, 20233
Published inLevel Up CodingArchitecture for generative Terragrunt & Terraform infrastructure as code (IaC)This article covers a specific scenario where despite trying to leverage as many DRY (don’t repeat yourself) principles made available to…Feb 26, 2023Feb 26, 2023
Published inLevel Up CodingFully automated Lets Encrypt TLS certs with ACME-DNS on KubernetesThis article covers fully automating DNS and the issuance of TLS certificates of Kubernetes for Ingress based workloads (both public and…Sep 8, 2022Sep 8, 2022
Published inLevel Up CodingReacting to K8s Events with k8s-watcherAs part of a recent project which needs to automatically issue new TLS certificates for hosts defined in Kubernetes Ingress objects, I…May 23, 2022May 23, 2022
Published inLevel Up CodingArchitecture for non-deterministic mass data collection: part 2: dynamic data lake schemasNote, this is the final part of a two part series about this project; article #1 is here.Feb 14, 2022Feb 14, 2022
Published inLevel Up CodingArchitecture for non-deterministic mass data collection: part 1: collection engineNote, this is part one of a two part series about this project; article #2 is here.Jan 23, 2022Jan 23, 2022
Published inLevel Up CodingServerless AWS Lambda architecture for large scale data ingestionRecently was faced with a requirement to build out an extensible data import framework that would be able to consume various file formats…Nov 29, 2021Nov 29, 2021
Published inDevOps DudesUsing private Python Azure Artifacts feeds in Alpine Docker buildsThis one will be relatively short, figured I’d post this for anyone else who was struggling with use case.Jun 3, 2021Jun 3, 2021
AWS Glue: Continuation for job JobBookmark does not existThis will be a quick post but could not find much on this error, so figured I’d post it for others.Apr 4, 20211Apr 4, 20211
