Skip to main content

Glossary

Every acronym and platform-specific term used across this documentation, in one place. Terms are defined here once; the pages that use them link back to this list rather than redefining them.

Components​

TermMeaning
PDQThe Simplitics data platform as a whole — the unified architecture that the components below make up.
AME — Active Metadata EngineThe central metadata repository and API hub. Stores all logic, every operation that has run and every planned operation. Every other component reads its configuration from here.
INGEST — Data ImporterThe orchestrated extraction agent. One container per source connection, running on a schedule, landing data unchanged.
DLS — Data Lake ServiceThe event-driven service that archives, standardises, profiles and publishes delivered files.
DWA — Data Warehouse AutomationThe metadata-driven engine that generates SQL and orchestrates loading into the integrated model.
QPI — Quality Performance IndicatorA named data quality check that runs SQL against the warehouse and returns a pass/fail verdict with a message and a measured value.
DataOps ConsoleThe operator-facing web application for monitoring daily execution and resolving failures. Read-and-intervene, not a configuration tool.
Config UIThe developer interface for managing metadata definitions, backed by Git integration and CI/CD deployment. Also written DevUI, Developer UI and User Interface Toolkit in older material and in some release notes; this documentation says Config UI throughout.
CaddyThe reverse proxy in front of the platform, handling TLS termination and authenticated access.

Data processing zones​

The zones data passes through, in order. Zone names are configurable in Settings, so an installation may display its own labels.

ZonePurpose
LandingThe entry point, where delivered data first arrives. A transient buffer — files are processed onward, not retained.
Raw ArchiveImmutable, permanent record of every file ingested, organised and tagged for audit. Write-once; it is the recovery path.
TrustedProcessed and published in a standardised, easily consumable format. Deviations against the data contract are recorded here, not blocked.
ProfileAnalysis of what actually arrived — discovering new and missing data points without interrupting the load.
PublishedThe selected table format for the agreed source delivery, providing SQL-based access. Also called Bronze.
BaseThe ensemble integration step between Published and Core. Also called the Ensemble Model.
CoreThe integrated core business concept model, using ensemble data modelling methodology. Also called Integrated or Silver.
BusinessUse-case-driven business data sets, carrying domain-specific definitions and rules. Also called DM, Data Mart or Gold — the console labels it Data Mart in Data Lineage.

Modelling​

TermMeaning
Source ExportA configured extraction job from a source system — a database query, an API call or a file fetch.
ConnectionThe technical link to a source system: credentials, URLs, paths.
SourcefileThe definition of an ingested file's structure — fields, types, keys and governance flags. Also the data contract.
Data contractThe agreed structure and typing of a source delivery, held in the sourcefile's fileStructure. Drift against it is what Contract Validation reports.
ModelA target warehouse table with typed attributes, business keys and relationships.
MappingA link between a sourcefile field and a model attribute, optionally carrying a transformation.
Mapping groupA logical unit of work: a collection of mappings from one source file to one or more target models, sharing a key mapping definition, filters and sort orders.
Business key (BK)The attribute or attributes that uniquely identify a record in a model. Composite keys use businessKeyOrder to fix the position of each part.
Ensemble / Base modelThe agile, highly normalised integration layer — every attribute and relationship in its own physical table, fully historised. Answers "what did we know, and when?"
CORE / Enterprise modelThe consolidated physical copy of the ensemble: one row per business key, the latest version. Answers "what is true now?" quickly.
Loading patternHow a model is populated: none, full, dayspan, incremental or transaction. none leaves the data as a consolidated view without materialising a physical table, and is the default.
Load GroupA grouping that falls out of the mappings — all attribute loads, say. It has no machine function; it exists to make the order and shape of the loading legible, and to let you filter the console by it.
Load StepA single action within a Load Group, such as one action in Base. Like Load Group, a result of the mappings rather than something configured.
Additional TaskCustom work chained onto the automatic flow, before or after the generated loads.

Processing and governance​

TermMeaning
CDC — Change Data CaptureExporting only records that are new, changed or deleted since the last run. In INGEST the agent keeps a local baseline file, so the comparison survives a restart but not the container being destroyed or removed.
Data profilingAutomated checks and validation of a delivery against its data contract, run as part of the flow when enableProfiler is active.
_HID — Hierarchical IDA dot-delimited path such as 1.2.4.1 recording an element's exact position in a nested source document. Makes nested rows traceable and acts as a stable join key when arrays are split into separate tables.
Granular checksumA checksum calculated at every object level rather than only at the document root, so an edit to one child record does not mark the whole file as changed.
__fileKeyThe identifier stamped on a delivery, used to trace loaded rows back to the file they came from.
SCD Type 2Slowly Changing Dimension pattern: each change creates a new version rather than overwriting, with a validFrom field marking validity.
IdempotentSafe to re-run. DWA loading tasks are idempotent — rerunning one cannot duplicate or corrupt data — which is why restarting a failed load is the normal first response rather than a last resort.
Active metadataMetadata that does not merely describe the system but drives it — lineage, versions and compliance fall out of execution rather than being maintained separately.
Design as DocumentationThe principle that the design is the documentation, and that documentation generates the executable code — so the two cannot drift apart.
Data ModifierThe DLS component that transforms JSON, CSV and XML into one common structure, so a delivery can be read through SQL regardless of the format it arrived in.
PublisherThe DLS step that writes the trusted data into the published tables. It is part of the pipeline and cannot be switched off.
KEEPDATAINTRUSTEDFORDAYSHow many days back Published can be rerun from without reprocessing from Raw. Default 3. It is a performance setting, not a retention policy that deletes Trusted.
authpThe internal authorisation group namespace — authp/admin and authp/user. At installation each group is mapped to the GUID of an Entra group.

Operations​

TermMeaning
The daily passThe proactive routine run every operational day, verifying every delivery and processing step before the daily deadline. See The daily pass.
On file arrivalThe event-driven schedule type: the load runs when a delivery arrives rather than on a clock. Written On event-basis, ad-hoc and File-triggered elsewhere; this documentation says On file arrival.
Checklist viewA console view comparing configured against executed. The only thing that catches work which never started — a failure count reads zero for a task that was never scheduled.
Silent failureA task that completes successfully but returns zero rows. Green everywhere except the export row/file counts. See Silent failure modes.
ExpectedAn assumption made by an operator or developer, meant as a pointer rather than a verdict. On INGEST Tasks it comes from the configured schedule; on DLS Trace from the sourcefile's expected files per day, prorated across the window.

See also​

  • Architecture — how the layers fit together
  • Platform guide — how the layers connect, and the way into the per-layer detail
  • FAQ — the questions that come up most often