Company-wide data requests
I extract and deliver data from the product and internal systems on request from across the company, acting as the first point of contact.
- Organisation
- MIIDAS CO., LTD.
- Period
- Jan 2025 – Present
- How it started
- Assigned
- My part
- First contact through aggregation design and delivery
- For whom
- Sales planning, CS, business development and science teams, plus the product and CRM engineering teams
- Scale
- 332 of the 799 requests the team received through the intake form (April 2025 to August 2026, from 80 requesters), in an environment of roughly 2,000 tables and tens of millions of records
What I did
Work across an environment of roughly 2,000 tables and tens of millions of records.
Turn anything that needs looking at regularly into a table or view rather than a one-off extraction.
Designed and implemented the aggregations where accuracy matters: company-master matching, CRM code linkage, performance-based fee calculation.
What comes next
Moving the questions that keep coming back out of ad-hoc work and into defined metrics and mart tables.
Putting terms, metric definitions and domain knowledge somewhere referenceable, so the premises do not have to be explained each time.
Choices I made
Start every request by pinning down definitions and conditions, putting the easily-misaligned concepts into words and agreeing on them before answering.
Decide per request how personal data is handled and whether to hand over aggregates or raw rows.
Tools
- Languages
- SQL / Python
- Frameworks & Libraries
- numpy / pandas / matplotlib
- Databases
- Amazon Aurora MySQL / Amazon Redshift / DuckDB
- Tools
- dbt / Jupyter Notebook