Insights / 05

Source inspection remains valuable, but it cannot by itself establish the behavior of a complex, AI-engineered production system.

Independent software assuranceSM / 05.31

SecondMark position

The unit of consequence is the operating system: code, models, data, infrastructure, operators, controls, state, and environment acting together.

The examination is bounded to defined claims, a versioned system, and evidence that can be traced to the state under review. Any material exclusion or uncertainty remains visible in the conclusion.

01

Core questions

What the examination needs to establish.

  1. 01

    Which claims can source establish directly?

  2. 02

    Which behaviors emerge only at runtime?

  3. 03

    Where do configuration and authority escape repository review?

  4. 04

    How should static evidence connect to production evidence?

02

Evidence model

Evidence is assembled around the claim—not the folder structure.

01

Explicit definitions

Collected, attributed, challenged, and connected to the exact system boundary under examination.

02

Reasoned assurance principles

Collected, attributed, challenged, and connected to the exact system boundary under examination.

03

Practical system implications

Collected, attributed, challenged, and connected to the exact system boundary under examination.

04

Boundaries and counterexamples

Collected, attributed, challenged, and connected to the exact system boundary under examination.

Intended outcome

A clearer distinction between code quality evidence and system assurance evidence, with each used only for the claims it can actually support.

A sharper decision frameQuestions for system stewardsPractical next steps
03

Professional boundary

What an opinion does—and does not—mean.

It provides

A traceable independent conclusion on defined claims, grounded in the evidence and system state examined.

It does not provide

A guarantee that failure is impossible, a permanent certification, or a conclusion beyond the stated scope and validity conditions.