Addshore

It's a blog

Tag: for-wmde

Grafana, Graphite and maxDataPoints confusion for totals

The title is a little wordy, but I hope you get the gist. I just spent 10 minutes staring at some data on a Grafana dashboard, comparing it with some other data, and finding the numbers didn’t add up. Here is the story in case it catches you out.

The dashboard

The dashboard in question is the Wikidata Edits dashboard hosted on the Wikimedia Grafana instance that is public for all to see. The top of the dashboard features a panel that shows the total number of edits on Wikidata in the past 7 days. The rest of the dashboard breaks these edits down further, including another general edits panel on the left of the second row. 

Continue reading

The Wikimedia Server Admin Logs

The Wikimedia Server Admin Log or SAL for short is a timestamped log of actions performed on the Wikimedia cluster by users such as roots and deployers. The log is stored on the WikiTech Wikimedia project and can be found at the following URL: https://wikitech.wikimedia.org/wiki/Server_Admin_Log

An example entry in the log could be:

As well as the main cluster SAL there are also logs for release engineering (jenkins, zuul, and other CI things) and individual logs for each project that uses Wikimedia Cloud VPS.

A tool has been created for easy SAL navigation which can be found at https://tools.wmflabs.org/sal

Each SAL can be selected at the top of the tool, with ‘Other’ providing you with a list of all Cloud VPS SALs.

The search and date filters can then be used to find entries throughout history.

Continue reading

WMDE: CI, Deploys & Config changes intro

This is an internal WMDE presentation made to introduce people to the land of Wikimedia CI, MediaWiki deployment and config changes.

This briefly covers:

  • Jenkins & Zuul
  • CI Config
  • Beta Cluster
  • SWAT
  • The MediaWiki train
  • Monitoring
  • mediawiki-config
  • The Docker & Kubernetes future?

WMDE: Event Logging intro

This is an internal WMDE presentation made to introduce people to Event Logging.

WMDE: Wikibase Docker intro

This is an internal WMDE presentation made to introduce people to Docker and the Wikibase docker images already introduced in this post.

WMDE: Metrics & Data Gatherings

Below you will find an internal WMDE presentation covering the general area of WMDE Metric & Data Gatherings from 2016.

This presentation follows on from the initial introduction to engineering analytics activities.

The presentation skims through:

  • WMDE Grafana dashboards
  • The Wikimedia Analytics landscape
  • Grafana & graphite
  • Hadoop, Kafka, Hive & Oozie
  • EventLogging, Mysql replicas & MediaWiki logs
  • Out Analytics scripts
  • How to get access

WMDE: Engineering Analytics Activities

This is an internal WMDE presentation given at the start of “metric driven development” for the WMDE & Wikidata dev teams.

The presentation is pretty bare bones but it provides a general overview of the plan and links to the current state of things.

The main area of interest from the presentation is the resources slide copied below for convenience.

Dashboards:

Project board:

© 2018 Addshore

Theme by Anders NorenUp ↑