Public data consolidation
A sector’s knowledge is scattered across registers, reports and websites. Finding an organisation is not enough: people need to understand its relationships, activities and the evidence behind them.
How this work runs.
One run, start to finish. A box with an accent tick is a tool acting and opens its own page; a rounded box is an artefact or a record; a diamond is a decision the work cannot pass without. A dashed line is a hand-off the suite has not mechanised yet.
- reads what the other publishes
- Nothing is sent. The next tool reads what the one before it has published, at the moment it needs it.
- updates the current record
- The record is overwritten with what is true now. The old value is replaced, not kept beside it.
Identify the public sources, crawl and corroborate them, build the front door, and keep crawling so the front door stays true.
Each step in the order it runs, and where one stops before the next begins.
- 01RECORDWHICH SECTORS NEED THIS A record the run reads, writes or hands on.Nothing in this run reaches it. Hands on to NOT MECHANISED YET.
- 02RECORD · decisionNOT MECHANISED YET The work cannot pass this point without a decision.Reached from WHICH SECTORS NEED THIS. Hands on to MASON (FORK AND BRAND).
- 03RUN · toolMASON (FORK AND BRAND) Sets the hub up from its template, then builds and ships it.Reached from NOT MECHANISED YET. Hands on to CRAWL.
- 04RECORDPUBLIC SOURCES A record the run reads, writes or hands on.Nothing in this run reaches it. Hands on to CRAWL.
- 05RUN · toolCRAWL Fills the hub with verified public sources.Reached from MASON (FORK AND BRAND), PUBLIC SOURCES. Hands on to STARTER DATA FOR THE HUB, HUB DATA.
- 06RECORDSTARTER DATA FOR THE HUB A record the run reads, writes or hands on.Reached from CRAWL. Hands on to MASON (BUILD AND SHIP).
- 07RECORDHUB DATA A record the run reads, writes or hands on.Reached from CRAWL. Hands on to MASON.
- 08RUN · toolMASON (BUILD AND SHIP) Sets the hub up from its template, then builds and ships it.Reached from STARTER DATA FOR THE HUB. Hands on to LIVE FRONT DOOR.
- 09RUN · toolMASON Sets the hub up from its template, then builds and ships it.Reached from HUB DATA. Hands on to LIVE FRONT DOOR.
- 10RECORDLIVE FRONT DOOR A record the run reads, writes or hands on.Reached from MASON (BUILD AND SHIP), MASON. The run parks here.
- 01nothing crossesMASON (FORK AND BRAND) WHICH SECTORS NEED THIS.NOT MECHANISED YET. The work cannot pass this point without a decision.This hand-off is not mechanised yet. A person notices, or nobody does.
- 02reads what the other publishesMASON (FORK AND BRAND) → CRAWL Template structure.Nothing is sent. The next tool reads what the one before it has published, at the moment it needs it.
- 03updates the current recordCRAWL → MASON (BUILD AND SHIP) Hub record.The record is overwritten with what is true now. The old value is replaced, not kept beside it.
- 04parks hereMASON (BUILD AND SHIP) LIVE FRONT DOOR.Nothing later in this run reads it, so this is where that branch of the run stops.
- 05picked upCRAWL PUBLIC SOURCES.Scan + corroborate.Matter the run starts from. No member of the suite put it there.
- 06updates the current recordCRAWL → MASON Build input.The record is overwritten with what is true now. The old value is replaced, not kept beside it.
- 07parks hereMASON LIVE FRONT DOOR.Deploy.Nothing later in this run reads it, so this is where that branch of the run stops.
What this work delivers.
A sector hub that connects people, organisations, places and activities, with sources and uncertainty visible alongside each claim.
Define the questions
Agree what the sector needs to know and the vocabulary that describes its entities and relationships.
Find and check sources
Crawl searches public registers, reports and datasets. Sources are compared, dated and retained as evidence.
Build the knowledge graph
Scribe maps the material to the hub’s sector vocabulary. Relationships and conflicting claims remain traceable to their sources.
Make it useful
Mason presents the knowledge through a hub. Curation directs further research towards gaps, weak claims and changes in the sector.
A hub is useful on its own. Mapping it through Scribe to Spine is a separate step that makes its information available to connected systems.
Explore the sector hubsWhich tools, in what capacity.
Put this to work in your context.
Tell us what you need to achieve and what you already have.