SMWCon 2021, Development environments using containers
SMWCon 2021 is happening as I write this post. I was invited to give a short talk as part of a MediaWiki and Docker workshop organized by Cindy Cicalese on day 2. As I am writing a month of blog posts I’m going to turn my slides into a more digestible and searchable online blog…
Using skaffold.dev with helmfile deployments on minikube
Recently I setup a small skaffold.dev development environment for a platform deployed using helmfile, deployed to a GKE cluster in production that is moving towards also having a local setup using minikube. There is an open Github issue requesting helmfile support, so my first fear was that this wouldn’t be possible. Though after a little…
WBStack Infrastructure
WBStack is a platform allowing shared scalable hosting of Wikibase and surrounding services. A year ago I made an initial post covering the state of WBStack infrastructure. Since then some things have changed, and I have also had more time to create a clear diagram. So it is time for the 2021 edition. WBStack currently…
Creating a new replica after purging binlogs with bitnami mariadb docker images
I have been using the bitnami mariadb docker images and helmfiles for just over a year now in a personal project (wbstack). I have 1 master and 1 replica setup in a cluster serving all of my SQL needs. As the project grew disk space became pressing and from an early time I has to…
Reducing Java JVM memory usage in Containers and on Kubernetes
For a while I have been running a Wikibase query service update script for WBStack, which is a Java application on a Kubernetes cluster. Part of that journey has included the updater using all available memory, hitting into the kubernetes memory limit and being OOM killed. The title of the post is a little verbose,…
WBStack Infrastructure (2020)
UPDATE: You can find an up to date 2021 version of this post here. WBStack currently runs on a Google Cloud Kubernetes cluster made up of 2 virtual machines, one e2-medium and one e2-standard-2. This adds up to a current total of 4 vCPUs and 12GB of memory. No Google specific services make up any…
From 0 to Kubernetes cluster with Ingress on custom VMs
While working on a new Mediawiki project, and trying to setup a Kubernetes cluster on Wikimedia Cloud VPS to run it on, I hit a couple of snags. These were mainly to do with ingress into the cluster through a single static IP address and some sort of load balancer, which is usually provided by…