Requirements Library · One artifact, complete

RULE-004 — A detection claim carries its confidence, its provenance, and its observation time wherever it goes

A business rule worked through all fourteen sections of the library’s standard template. Chosen because a rule carries both acceptance criteria and measures, and because it is where the disagreement between the two source methods has to be resolved in practice rather than in principle.

Read this first

This artifact is published including the parts that do not flatter it. Acceptance criterion AC-6 is recorded as currently failing. No enforcement check listed at §5.2 has ever been observed refusing anything. Section 10, Evidence, is an explicit not-applicable. A worked example that quietly omitted those would teach that a good artifact is one with no empty slots, which is the opposite of the discipline being demonstrated.

0. Identity

IDRULE-004
Category4 — Rules and Definitions Register
StatusPublished
Version1.2
OpenedRelease 1
Last touchedRelease 3
OwnerRequirements lead, detection context
Deciding authorityProgramme design authority (see DEC-011)
Supersedes
Superseded by

1. Purpose

A detection produced by an automated sensing chain is a probabilistic claim. It becomes dangerous at the moment it stops being read as one — when a claim with a confidence value attached is relayed, summarised, exported and re-summarised until it arrives somewhere as a fact about the world, with the uncertainty stripped somewhere along the path and nobody able to say where.

This rule exists to make that stripping impossible rather than discouraged. It fixes what must travel with a detection to every surface that renders it, including surfaces outside the operating organisation, and it fixes the one direction confidence is allowed to move as a claim propagates. It is written because the failure it prevents is silent, cumulative, and only visible after a decision has already been made on a laundered claim.

2. Scope

In

Out

3. Context

Detection systems of this class produce far more candidate observations than real fires, and the candidates are handled by several parties in sequence: an automated triage step, a human dispositioning step, a duty officer deciding whether to commit a resource, and — where responsibility for the ground lies with another organisation — a counterparty acting inside its own systems and under its own procedures.

Each hand-off is a re-statement, and each re-statement is an opportunity to drop a qualifier. The pattern is well documented in adjacent domains: a hedged assessment written by an analyst arrives at a decision-maker as an unhedged assertion, having lost its hedge at a summarisation step nobody logged. The equivalent here is worse in one respect, because a detection claim’s uncertainty is numeric and therefore looks precise; a confidence value rendered without its label is easily read as a measurement rather than an estimate.

The programme’s exposure is concentrated at two points. The first is export: a receiving schema with no field for confidence will accept the claim anyway, and the claim then exists in that system as an unqualified fire report attributed to this programme. The second is aggregation: a summary that counts claims necessarily discards their individual confidences, and unless constrained it will present the count at a higher effective certainty than any of its members.

A separate and easily-missed hazard is time. A detection carries two distinct times — when the observation was made, and when the record arrived. Under a degraded communications link these can differ substantially. Every downstream latency measure, every staleness judgement, and every human decision about whether a claim is still current depends on which one is being read, and a system that carries only one of them will carry the wrong one.

4. Inputs and authority

UpstreamTypeGloss
CHT-001authorisesThe programme charter, which states uncertainty-preservation as a standing obligation and names the loss of it as a programme-level risk.
NEED-002derives fromThe triage need: an analyst dispositions every claim on one screen, which requires confidence and observation time to be present in that view.
NEED-013derives fromThe reconstruction need: an incident is reconstructable end to end without vendor assistance, which requires the qualifiers that were displayed to be recoverable.
DEC-011authorisesThe decision that observation time and receipt time are held as two attributes rather than one, taken after a review found a single-time model could not express a delayed claim.
ENT-001governsThe detection record entity, whose attribute set this rule constrains.

5. Content

5.1 The rule

Stated declaratively. One subject, one modality, one obligation per clause. No clause names a mechanism; mechanisms are recorded separately at §5.2.

R1. A detection record must carry a confidence value produced by the classifying process at the time of classification.

R2. A detection record must carry the identity and modality of the sensing chain that produced it, and the version of the model or rule set that classified it.

R3. A detection record must carry the time at which the observation was made. Where the time of receipt is also recorded, it must be held as a separate attribute, and it must not be presented in place of observation time on any surface.

R4. Every surface that renders a detection record to a human must render that record’s confidence and observation time within the same view as the record itself, without requiring a further action to reveal them.

R5. Every export of a detection record to a system outside the operating organisation must carry confidence, sensing provenance and observation time as first-class fields. Where the receiving schema cannot represent all three, the export must be refused.

R6. A derived record that restates or aggregates one or more detection records must not assert a confidence higher than the lowest confidence carried by the records it restates.

5.2 Enforcement points — recorded as metadata, not as rule text

BABOK 10.9 keeps a rule’s statement independent of its enforcement so that the rule survives a change of mechanism; the House Method requires the mechanism to be named, on the grounds that an unenforced rule is a preference. Both properties are obtainable if the two are kept in separate fields. The statements above are portable. The table below is what makes an unenforced clause countable — an empty enforcement cell is a visible defect, and a mechanism can be replaced without reopening the rule.

ClauseEnforcement pointKindCan it currently fail?
R1Non-nullable constraint on the detection record at creationStructuralSpecified; unexercised — no instance exists
R2Non-nullable constraint plus a model-version reference checkStructuralSpecified; unexercised
R3Non-nullable observation-time constraint; separate optional receipt-time attribute; a check rejecting any write in which observation time is populated from the receipt clockStructuralSpecified; unexercised
R4Surface conformance check run against the rendering-surface inventory; a surface not in the inventory is itself a findingFunctionalSpecified; unexercised
R5Export contract conformance test, including a refusal case exercised against a deliberately deficient receiving schemaFunctionalSpecified; refusal case written and not yet run
R6Cross-record consistency check comparing asserted confidence against the minimum confidence of cited membersFunctionalSpecified; unexercised
Recorded, not smoothed over

None of these checks has been observed refusing a disqualified input. Under the Category 5 standard that means none of them counts as present. They are specified controls, not proven ones.

5.3 Known pressure points — where this rule will be pushed on

Recorded in advance, because a rule that has not predicted its own erosion will be eroded quietly.

  1. R5 will be experienced as an integration failure. A counterparty whose system has no confidence field will read the refusal as this programme being difficult, and the pressure to add a “degrade and annotate” path will be immediate and reasonable-sounding. The rule refuses because an annotation lives in a comment field nobody parses, and the claim would then exist unqualified in a system the operating organisation does not control. The correct response is a schema conversation with the counterparty, and the refusal is what forces that conversation to happen.
  2. R4 will be pushed on by screen space. Confidence and observation time compete with everything else for a field device’s display, and the first proposal will be to move them behind a tap. A qualifier that requires an action to reveal is a qualifier that will not be read under load.
  3. R6 will be pushed on by summary readability. A district summary reading at the confidence of its weakest member looks pessimistic to its audience, and there will be a proposal to use an average instead. An average of confidences is not a confidence, and adopting one converts the whole rule into decoration at exactly the surface most likely to be quoted onward.
  4. R3 will be satisfied in letter and defeated in practice if observation time is back-filled from the receipt clock whenever the true observation time is unavailable. The field would be populated, the constraint would pass, and the value would be wrong. This is the reason for the fourth measure at §9.

5.4 Related definitions

Defined in the register and used here in their register sense: detection record; confidence class; sensing provenance; observation time; receipt time; derived record; rendering surface; export. Any use of these terms elsewhere in the library that is inconsistent with the register entry is a defect in the other artifact, not a permitted local variation.

6. Constraints, assumptions, dependencies

Constraints

Assumptions

AssumptionWhat would falsify itWhat breaks if it is false
The classifying process can emit a confidence value whose ordering tracks observed correctness. A calibration study in which higher-confidence claims are not more often correct than lower-confidence ones. R1 and R6 would be preserving a number that means nothing. The rule would still be structurally satisfied and would be protecting nothing — the worst available outcome, because it would read as compliance.
A complete inventory of rendering surfaces can be maintained. A surface found in operation that is absent from the inventory. R4 loses its denominator. Its measure would report a proportion of a set that is not the real set.
Counterparty schemas can be extended or negotiated on a timescale the programme can absorb. A required counterparty declining or being structurally unable to carry the three fields. R5’s refusal becomes a permanent capability loss rather than temporary friction, and the trade-off returns to Category 2 as a decision rather than being settled inside this rule.

Dependencies

Risk restatement. The first assumption is restated in the risk register, because an uncalibrated confidence value satisfies every clause here while defeating the rule’s purpose entirely. That risk is owned outside this artifact, under Category 5.

7. Stakeholders and authority

PartyInterestDecision authorityInfluence
Triage analystNeeds confidence and observation time in one view; bears the cost of R4 in screen spaceNone over this ruleHigh — will find the failure first
Duty officerNeeds to know whether a claim is current and how strong it isNone over this ruleHigh
Counterparty integratorReceives exported claims; bears the cost of R5 directlyNone over this rule; controls the receiving schemaHigh, and adversarial to R5 by position rather than intent
Records and audit functionNeeds the qualifiers that were displayed to be recoverableNone over this ruleModerate
Programme design authorityCoherence of the rule set as a wholeApproves and may amendDecisive
Detection subsystem supplierProduces the confidence value; bears R1 and R2 as build obligationsNoneModerate — can make R1 cheap or expensive

The counterparty integrator row is the one that matters. This rule creates a real cost for a party with no authority over it and a legitimate objection to it, and recording that asymmetry here is what keeps the eventual negotiation honest.

8. Acceptance and verification

Acceptance criteria are pass/fail against this rule as the single candidate. Evaluation criteria — scaled comparisons between candidate classifiers or export formats — are deliberately not in this artifact; they live in the Category 5 evaluation set, and mixing them here would produce a scored rubric that cannot accept anything.

IDAcceptance criterionVerdict basis
AC-1A detection record cannot be created without confidence, sensing provenance, model or rule-set version, and observation time. Attempted creation without any one of them is rejected, and the rejection names the missing attribute.Structural check, exercised with one deficient input per attribute
AC-2Observation time and receipt time are separately addressable on the record, and no surface substitutes one for the other.Inspection of the record definition plus the surface conformance check
AC-3Every surface in the rendering-surface inventory displays confidence and observation time in the same view as the record, with no further action required.Surface conformance check against the full inventory; a surface absent from the inventory is a finding against Category 6, not a pass here
AC-4An export to a receiving schema lacking any of the three fields is refused, and the refusal states which field could not be carried.Export conformance test, including the deliberately deficient schema case
AC-5A derived record asserting a confidence above the minimum of its cited members is rejected at creation.Cross-record consistency check, exercised with a deliberately inflated input
AC-6Each of the five checks above has been observed refusing a disqualified input, and the refusal is retained as evidence.The refusal evidence set under Category 5
Currently failing

AC-6 is failing and is recorded as failing. No check has been exercised, because nothing exists to exercise it against. Under the library’s own standard the other five criteria are therefore specified rather than met, and this artifact does not claim otherwise.

9. Measures

 M-1M-2M-3M-4 (counter)
DefinitionRendering surfaces displaying confidence and observation time in the same view, as a proportion of the surface inventoryExports completed without all three required fieldsDerived records asserting confidence above the minimum of their cited membersDetection records whose observation time equals receipt time to the second, as a proportion of all records
UnitPercent, plus the deficient-surface count as an integerCountCountPercent
InstrumentSurface conformance checkExport conformance logCross-record consistency checkQuery over the record store
FrequencyEvery releaseContinuousContinuousMonthly during any operating period
BaselineN/A for all four — no operating instance exists. The measures are specified and the absence of data is carried as a risk.
Target100 percent, with the deficient count as the reported figureZeroZeroNo target. A diagnostic, read for movement, not a threshold
ReadingAbsolute-zero on the failure sideAbsolute-zero integer, never averagedAbsolute-zero integer, never averagedTrended

Why M-4 exists. M-1 to M-3 can all be satisfied by a system that populates observation time from the receipt clock. Every constraint would pass and every value would be wrong. M-4 is the only measure here that can detect that, and it detects it by watching a distribution rather than a threshold: a healthy system under a variable link produces a spread between the two times, and a rising share of exact matches means the spread is being manufactured. It is deliberately given no target, because a target would invite the number to be managed.

What these measures do not capture. None of them says whether the confidence values are any good. That is the first assumption at §6, it is owned elsewhere, and a perfect score on all four is fully compatible with the rule protecting nothing. Stated here because a measure set that does not declare its own blind spot invites the blind spot to be read as covered.

10. Evidence

N/A — unbuilt

No operating instance of this system exists, so no run output, capture, query result or conformance log can be produced. This is an explicit not-applicable, not an omission: the slot is empty because there is nothing to observe, and it will remain empty until there is.

What can be stated: the six enforcement mechanisms at §5.2 and the six acceptance criteria at §8 exist as written specifications, including the deliberately deficient input cases each refusal test requires. They have not been executed. A control observed only passing is unproven, and a control never observed at all is further back than that. This artifact’s claims about enforcement are therefore design claims, and are labelled as such wherever they appear.

11. Traceability

DirectionArtifactLink type
UpstreamCHT-001authorised by
UpstreamDEC-011decided by
UpstreamNEED-002, NEED-013derived from
DownstreamENT-001 detection recordconstrains
DownstreamENT-008 decision recordconstrains — a decision record citing a claim inherits R6
DownstreamQUAL-014 refusal evidence setverified by
RelatedRULE-007depends on — confirmation policy; deliberately separate, and the separation is itself load-bearing
RelatedRULE-011depends on — imagery retention; shares ENT-001 and diverges on lifecycle
RelatedRULE-019conflicts-with-resolved — an interoperability rule that would have permitted degraded export; resolved in favour of R5 at DEC-011, with the loss recorded there

The conflicts-with-resolved link is retained on purpose. A resolved conflict deleted from the map reads, two years later, as a conflict that never existed, and the next person to propose degraded export will propose it without knowing it was already decided.

12. Method

Three techniques produced this artifact, and each affects how much the content should be trusted.

A constrained rule grammar. Each clause carries one subject, one modality and one obligation. The constraint is not stylistic: it is what makes a clause individually testable and individually amendable. A clause with two obligations cannot fail cleanly, because a partial failure has no verdict.

Failure-first rationale. The rule was written from the named failure — confidence laundering — outward to the clauses, rather than from a desired capability inward. The consequence is that every clause can be interrogated with “which part of the failure does this close,” and R4 through R6 exist only because that question exposed three propagation paths R1 to R3 did not cover.

Pre-registered erosion analysis. §5.3 was written before the rule was approved, not after it was challenged. The value is that the first person to propose an average at R6 is arguing against a position already considered. The cost is that a pressure point nobody predicted will be the one that succeeds, and §5.3 should be read as incomplete rather than as a survey.

13. History

Append-only. Never rewritten.

ReleaseChangeReason
1Created with R1–R3Uncertainty-preservation obligation from the charter needed a testable rule
1R4 addedReview found R1–R3 governed storage and said nothing about display; a stored qualifier that is never shown is not preserved
2R3 amended — receipt time separated from observation time as a distinct attributeA delayed claim could not be expressed under a single-time model; latency and staleness readings were both ambiguous
2R5 strengthened from “annotate where fields cannot be carried” to “refuse”An annotation in a free-text field is not a qualifier; the claim would exist unqualified in a system outside this programme’s control
3R6 addedAn aggregation review found summaries could assert certainty no member held, defeating R1–R5 at the surface most likely to be quoted onward
3Pressure points 1 and 3 added at §5.3Both objections were raised during review and both are legitimate; recording them is more useful than answering them once in a meeting