bitsofinfoinLevel Up CodingArchitecture for a data lake REST API using Delta Lake, Fugue & Spark“Hey, we need some kind of a REST API over all our data lakes to let analysts and other integrations query records on demand . Can we…11 min read·Aug 15, 2023--3--3
bitsofinfoinLevel Up CodingArchitecture for generative Terragrunt & Terraform infrastructure as code (IaC)This article covers a specific scenario where despite trying to leverage as many DRY (don’t repeat yourself) principles made available to…9 min read·Feb 26, 2023----
bitsofinfoinLevel Up CodingFully automated Lets Encrypt TLS certs with ACME-DNS on KubernetesThis article covers fully automating DNS and the issuance of TLS certificates of Kubernetes for Ingress based workloads (both public and…7 min read·Sep 8, 2022----
bitsofinfoinLevel Up CodingReacting to K8s Events with k8s-watcherAs part of a recent project which needs to automatically issue new TLS certificates for hosts defined in Kubernetes Ingress objects, I…4 min read·May 23, 2022----
bitsofinfoinLevel Up CodingArchitecture for non-deterministic mass data collection: part 2: dynamic data lake schemasNote, this is the final part of a two part series about this project; article #1 is here.8 min read·Feb 14, 2022----
bitsofinfoinLevel Up CodingArchitecture for non-deterministic mass data collection: part 1: collection engineNote, this is part one of a two part series about this project; article #2 is here.17 min read·Jan 23, 2022----
bitsofinfoinLevel Up CodingServerless AWS Lambda architecture for large scale data ingestionRecently was faced with a requirement to build out an extensible data import framework that would be able to consume various file formats…9 min read·Nov 29, 2021----
bitsofinfoinDevOps DudesUsing private Python Azure Artifacts feeds in Alpine Docker buildsThis one will be relatively short, figured I’d post this for anyone else who was struggling with use case.2 min read·Jun 3, 2021----
bitsofinfonice! thanks a ton just needed this. Very similar to asyncio queues in python1 min read·May 8, 2021----
bitsofinfoAWS Glue: Continuation for job JobBookmark does not existThis will be a quick post but could not find much on this error, so figured I’d post it for others.2 min read·Apr 4, 2021--1--1