Metadata and a data catalog
Table definitions and ER diagrams were scattered and every extraction started with an investigation, so I organised the metadata and built a data catalog.
- Organisation
- MIIDAS CO., LTD.
- Period
- Jul 2025 – Present
- How it started
- Self-initiated
- My part
- Proposal through build and operation, alone
- For whom
- My own team
- What changed
- Definitions and ER diagrams scattered, investigated each time → One generated catalog to look everything up in
- Scale
- 2,656 table definitions (as of July 2026), across multiple databases and schemas
What I did
Proposed and built the data catalog platform, cutting the investigation that used to precede every extraction.
Keep the automatic collection and publication of table and column definitions running.
Contribute back to the OSS it runs on (tbls) through bug reports and improvement proposals.
What comes next
Adding business meaning on top of the generated definitions, starting with the data people ask about most.
Bringing table dependencies and lineage into the catalog.
Deciding what belongs in the catalog and what does not.
Choices I made
Combined tbls and Docusaurus so the definitions collected straight from the databases become the published catalog.
Scripted the work that recurs in operation: multiple databases and schemas, masking information, sidebar generation.
Related
Writing
Apr 12, 2026
Technical Book Fest 20 — MIIDAS Tech LOG #1
Chapter 7: Starting an internal data catalog with tbls and Docusaurus
Tools
- Languages
- JavaScript / TypeScript / Python / Go
- Frameworks & Libraries
- Node.js / React
- Cloud & Infrastructure
- Docker
- Tools
- tbls / Docusaurus