Work
Case studies
Short engineering reports: the context, what I did, the architecture and what changed. Each one says how far the work got.
From a central platform to domain-owned projects under shared policies
Central platform to Domain tagging. Domain tagging to Domain project A. Domain tagging to Domain project B. Domain tagging to Domain project N. Domain project A to Quality rating. Domain project B to Consumers. Domain project N to Access audits. Shared policies to Domain project N.
Central platform
one team owns everything
Domain tagging
owner per dataset
Domain project A
standard datasets
Domain project B
standard datasets
Domain project N
one per domain
Quality rating
score per source, alerts
Consumers
discover via catalog
Access audits
on a fixed schedule
Shared policies
replication, quality
catalog, access
Tokopedia (GoTo Group) · 2019 — 2024
Led the move of a large e-commerce company's central data platform into 34 domain-owned cloud projects, with shared policies and a source-quality rating.
4 → 34 domain-owned GCP projects11 direct reports across five teams
Google Cloud BigQuery GKE Airflow Kafka
Four phases, then continuous monitoring
1 · Data clean-up to 2 · Lifecycle archival. 2 · Lifecycle archival to 3 · Restructuring. 3 · Restructuring to 4 · Cost attribution. 4 · Cost attribution to Continuous monitoring. Continuous monitoring to Five teams (reported to).
reported to 1 · Data clean-up
2 · Lifecycle archival
colder data, cheaper tiers
3 · Restructuring
infrastructure reshaped
4 · Cost attribution
per business unit
Continuous monitoring
25+ cost and SLA reports
Five teams
32–43% lower spend each
Tokopedia (GoTo Group) · 2019 — 2024
Ran a four-phase FinOps programme across five teams that cut cloud spend 32–43% per team, sustained by continuous cost monitoring.
32–43% lower cloud spend per team5 teams in the programme
Google Cloud BigQuery Cost attribution Data Studio Grafana
Platform components and reporting
Source feeds to ETL. ETL to HDFS · 4.2 PB. HDFS · 4.2 PB to Hive on YARN. Hive on YARN to Reports. Operations to HDFS · 4.2 PB (automates). Monitoring to Hive on YARN (observes).
automates observes Source feeds
telecom data
ETL
Ab Initio, NiFi
HDFS · 4.2 PB
Cloudera
Hive on YARN
query and batch
Reports
billing, 15+ utilisation
Operations
Ansible, ServiceNow
Monitoring
Grafana, Kibana
Bharti Airtel · 2018 — 2019
Set up and ran a 4.2 PB Cloudera Hadoop platform end to end, with ETL, reporting and automation, plus two Cassandra clusters for Customer 360.
4.2 PB Cloudera Hadoop platform15+ cluster-utilisation reports
Cloudera Hadoop Hive YARN Ab Initio NiFi