Skip to content
MIIDAS CO., LTD.

Company-wide data requests

I extract and deliver data from the product and internal systems on request from across the company, acting as the first point of contact.

CoreData EngineeringData AnalysisBI & Data VisualizationRequirements Definition
Organisation
MIIDAS CO., LTD.
Period
Jan 2025 – Present
How it started
Assigned
My part
First contact through aggregation design and delivery
For whom
Sales planning, CS, business development and science teams, plus the product and CRM engineering teams
Scale
332 of the 799 requests the team received through the intake form (April 2025 to August 2026, from 80 requesters), in an environment of roughly 2,000 tables and tens of millions of records

What I did

  • Work across an environment of roughly 2,000 tables and tens of millions of records.

  • Turn anything that needs looking at regularly into a table or view rather than a one-off extraction.

  • Designed and implemented the aggregations where accuracy matters: company-master matching, CRM code linkage, performance-based fee calculation.

What comes next

  • Moving the questions that keep coming back out of ad-hoc work and into defined metrics and mart tables.

  • Putting terms, metric definitions and domain knowledge somewhere referenceable, so the premises do not have to be explained each time.

Choices I made

  • Start every request by pinning down definitions and conditions, putting the easily-misaligned concepts into words and agreeing on them before answering.

  • Decide per request how personal data is handled and whether to hand over aggregates or raw rows.

Tools

Languages
SQL / Python
Frameworks & Libraries
numpy / pandas / matplotlib
Databases
Amazon Aurora MySQL / Amazon Redshift / DuckDB
Tools
dbt / Jupyter Notebook

Related strengths

Related traits