Projects

Case studies from my data engineering work and open-source projects I build outside of work.

Case studies

Projects from my data engineering work. The code is private, so each page describes the problem, the solution and the outcome without company details.

  1. Airflow 3 platform

    A new Airflow 3.1 cluster: DAGs from Git without a deploy step, CI checks for every merge request, dbt runs through Cosmos.

    • Airflow 3
    • dbt
    • Cosmos
    • GitLab CI
    • ruff
    • Podman
    • Ansible

  2. DWH on-call monitoring

    Dashboards and alerts for the engineer on duty: failed and stuck runs, slow DAGs, stale product metrics.

    • Airflow
    • Grafana
    • VictoriaMetrics
    • statsd
    • PostgreSQL
    • Python

  3. Lakehouse pilot

    Moving raw events from HDFS to Iceberg tables in the cloud, tested in two clouds on 14 TB of real data. The move was postponed.

    • Iceberg
    • Spark
    • Trino
    • Kafka
    • S3
    • PyArrow

Open-source projects

Projects I build outside of work, with public code.

  1. InkVault

    A password manager that needs only a client and an XMPP account on any server: end-to-end encryption, a Rust core, web, Android and terminal clients.

    • Rust
    • Kotlin
    • TypeScript
    • WebAssembly
    • XMPP

  2. InkVault load test

    A test bench for Prosody with InkVault: SQLite or PostgreSQL in containers, a load generator that behaves like InkVault clients, metrics collection and a report.

    • Node.js
    • Prosody
    • SQLite
    • PostgreSQL
    • Podman
    • Prometheus
    • Grafana

  3. Cocosations

    An XMPP client for Android based on Conversations, with call diagnostics: failed stage, reason and audio quality.

    • Android
    • Java
    • XMPP
    • WebRTC
    • F-Droid

  4. Kadr

    A screenshot tool for GNOME on Wayland: capture modes, an annotation editor, OCR and uploads over SFTP and WebDAV.

    • C++23
    • Qt 6
    • Wayland
    • xdg-desktop-portal
    • Flatpak

  5. XMPP Server Guides

    Step-by-step guides for running your own XMPP server on Prosody.

    • XMPP
    • Prosody
    • HAProxy
    • Xray
    • coturn
    • Let's Encrypt
    • Cloudflare

  6. termisations

    A terminal XMPP client built for protocol debugging: a raw stanza stream panel sits next to the conversation.

    • Python
    • Textual
    • slixmpp
    • SQLite