Cocosations
An XMPP client for Android based on Conversations, with call diagnostics: failed stage, reason and audio quality.
- Android
- Java
- XMPP
- WebRTC
- F-Droid
Senior Data Engineer / Data Platform Engineer
I build and scale data platforms: ETL/ELT pipelines, Airflow DAGs, a Hadoop-based data warehouse (Hive, Impala), data marts in ClickHouse and PostgreSQL. I own pipelines end to end, from ingestion to reporting and monitoring.
My data engineering work lives in private company repositories: see the case studies. These are open-source projects I build outside of work.
An XMPP client for Android based on Conversations, with call diagnostics: failed stage, reason and audio quality.
A screenshot tool for GNOME on Wayland: capture modes, an annotation editor, OCR and uploads over SFTP and WebDAV.
A password manager that needs only a client and an XMPP account on any server: end-to-end encryption, a Rust core, web, Android and terminal clients.
I started in application development: Java, Python and C++ applications, web interfaces and PostgreSQL migration scripts. Then I moved to product data: analyzing logs, writing loaders and parsers in Go and Python, building aggregates in ClickHouse. Today I build ETL/ELT pipelines and Airflow DAGs, a Hadoop-based data warehouse (Hive, Impala), and data marts and aggregates in ClickHouse and PostgreSQL. I also designed a pilot lakehouse on Iceberg, S3, Spark, Kafka and PyArrow.
I own the full data lifecycle: collection from internal and external sources, parsing and normalization, enrichment, storage, aggregation, reporting, monitoring, alerting and automation. I design fault-tolerant pipelines, tune query and orchestration performance, and own data quality and SLAs.
I have worked with product, marketing and log data and built integrations with Google Ads, Meta Ads, data.ai, myTracker and other external APIs. I deliver data to the business: dashboards, reports, self-service BI, ad-hoc analysis. On the team, I review code, mentor engineers and drive architecture decisions. I work closely with analytics, product and infrastructure teams.
attributes
Collecting data from product logs and external sources: Google Ads, Meta Ads, data.ai, myTracker, internal APIs, databases, files, S3. Setting up CDC, exports, parsers and loaders. Working with Kafka and message queues.
ETL/ELT pipelines in Python and SQL. Text log parsers, cleansing, normalization, enrichment, deduplication. Data marts, aggregates, SCD2, DWH layers. PySpark, dbt, Spark SQL.
Loading data into ClickHouse, aggregates in ClickHouse and MySQL. A Hadoop-based data warehouse (Hive, Impala). PostgreSQL, S3, HDFS, Parquet. Tuning partitioning, compression and storage schemas.
Airflow DAGs: dynamic DAGs, custom operators, sensors, pools, SLAs, retries, backfill. Airflow configuration and performance tuning. CeleryExecutor and KubernetesExecutor, queue and worker monitoring.
Completeness, uniqueness, timeliness and consistency checks. Reconciliation between sources and data marts. Anomaly detection, Great Expectations, dbt tests, custom checks.
Report automation, business intelligence dashboards, data analysis for marketing. Superset, Metabase, Grafana, ad-hoc analysis. Self-service BI and a data mart layer for analysts.
Grafana, Graphite and Prometheus dashboards. A web dashboard for ETL monitoring, Grafana alert webhooks. Telegram notifications, incident response, pipeline health checks.
Query optimization in ClickHouse (MergeTree), PostgreSQL, Hive and Impala, Airflow DAG optimization. Reducing processing time, storage costs and cluster load.
Bots, auto-responders, internal APIs and tools for the team.
Built the delivery backend for campaigns of up to 3M recipients: queues, rate limiting, templates, deliverability, monitoring.
Docker, Podman, Kubernetes, GitLab CI, Ansible. CI/CD for data and services. Documentation, lineage, access management, PII handling under GDPR and Russian data protection law (152-FZ).
Code review, mentoring, task estimation, architecture decisions, requirements gathering, working with product and analytics teams.
Email is the fastest way to reach me.