Part II — Defining the Production System
The Factory Operating System
What coordinates autonomous actors and technical systems across the factory?
Ninety-seven messages and no operational warning
Chapter 5 established the Software Factory as a bounded socio-technical production system. Its Production Lines, Work Centers, Work Rooms, Factory Assets, actors, controls, and evidence form a complete model only through their relationships. Yet a complete map does not make those relationships operable. Policy can remain separate from work. A decision can be authorized but not visible where execution occurs. Evidence can be collected without reaching anyone able to change the system.
On 1 August 2012, Knight Capital experienced this separation at exceptional speed. According to the US Securities and Exchange Commission (SEC), the firm incorrectly deployed new code to one of eight servers. That deployment interacted with dormant defective functionality. While Knight processed 212 customer orders, its systems sent millions of orders into the market. Over approximately 45 minutes, the firm executed 4 million trades in 154 stocks, bought and sold more than 397 million shares, and incurred a loss exceeding $460 million.CH06-R06
The record matters here not because electronic trading represents ordinary software delivery. It does not. Market speed, financial exposure, regulatory duties, and the technical architecture made the consequences unusually rapid. Knight also settled without admitting or denying the SEC findings. The case is useful because it reveals a coordination failure that cannot be located in one missing step.
The SEC recorded that Knight received 97 automated emails before the market opened. They identified an error condition, but they were not designed or handled as system alerts. Deployment state was incomplete. Controls did not address aggregate exposure. Incident-response responsibilities and procedures were inadequate. Earlier events had not produced a sufficiently broad root-cause response. Code moved, signals appeared, and people acted, but the parts did not form an actionable whole.CH06-R06
That distinction carries the argument from Chapter 5. A factory can possess workflow automation, monitoring, policies, responsible people, and approval mechanisms while still failing to coordinate them. Adding a central dashboard would not necessarily repair the problem. Neither would delegating every response to local teams. Coordination requires the relationships among authority, state, execution, control, evidence, exception, and revision to be explicit enough to operate under real conditions.
The question of this chapter is therefore:
What coordinates autonomous actors and technical systems across the factory?
The answer is the Factory Operating System: the coordinating layer of a Software Factory that makes policy, decision rights, work state, orchestration, controls, evidence, measures, and learning explicit and operable across the production system. It spans management and technical coordination rather than belonging exclusively to either.
The name and the integration of these eight responsibilities are author synthesis. The supporting standards, research, policies, practice records, and cases establish the need to make the constituent relationships explicit. They do not establish a recognized product category, a universal architecture, or a causal performance effect.
The central reframe is:
The Factory Operating System coordinates decisions, not obedience.
It leaves contextual execution with the people and systems closest to the work unless consequence, dependency, or uncertainty requires escalation. It is not a monolithic application, command hierarchy, control room, workflow engine, data lake, or committee. Those mechanisms may carry parts of the responsibility. None is the operating system by itself.
Code, deployment state, automated messages, controls, and response existed, but they did not form an actionable whole; the visual represents SEC findings and makes no prevention counterfactual.
Coordination is a layer of responsibility
The operating-system analogy is deliberately limited. A computer operating system mediates resources and execution through technical abstractions. A Factory Operating System coordinates a socio-technical system in which authority may be contested, evidence may be incomplete, policies may conflict, and human judgment remains consequential. There is no institutional kernel with perfect state or unquestioned control.
The useful part of the analogy is shared responsibility. Production Lines and Work Centers should not each have to invent every rule for identity, state, evidence, risk treatment, exception, or escalation. Nor should a central group decide every contextual action. The coordination layer establishes enough common semantics and enforceable relationships for actors to work autonomously without making the whole system unknowable.
International standards provide pieces of this architecture without naming the integrated layer. ISO/IEC/IEEE 12207 identifies lifecycle processes, information items, control, measurement, risk, operation, maintenance, and improvement. ISO/IEC/IEEE 42010 disciplines the description of stakeholders, concerns, viewpoints, correspondences, and interfaces. ISO/IEC/IEEE 16085 makes lifecycle risk responsibilities and treatment explicit. ISO/IEC 38500 separates governing accountability, direction, and monitoring from delegated management.
These are normative sources, not evidence that a particular arrangement improves performance. Their value is to prevent a coordination design from collapsing into a workflow picture. The system must represent who may decide, what state is relevant, which action is permitted, what evidence is required, how an exception is handled, and how later evidence can alter the conditions of work.
Technical guidance shows a narrower implementation slice. NIST SP 800-204C distinguishes application, infrastructure, policy, and observability code and describes automated delivery workflows and feedback mechanisms for cloud-native microservices. Those mechanisms can make selected policy repeatable, move technical state, enforce controls, and emit evidence. They cannot determine legitimate authority, settle value conflicts, interpret every exception, or redesign institutional policy.CH06-R08
This leads to a design test. If an organization can point to one product and say, “That is our Factory Operating System,” it should ask what the product cannot contain. Who assigned the product's authority? Which decisions remain outside its data model? Who can challenge an automated result? What happens when legal, operational, security, and product policies conflict? Who changes the policy when evidence shows that it is harmful or obsolete?
The inverse test matters too. An organization may have no platform with this name and still perform the responsibilities coherently through federated tools, practices, records, and decision forums. Category adoption is irrelevant. What matters is whether a decision can be followed from intent through authority, state, action, evidence, exception, and revision without assuming a single controlling machine or team.
Eight responsibilities, one coordination fabric
The Factory Operating System integrates eight responsibilities. They are not sequential stages. Policy may change while work is active. Evidence may interrupt orchestration. An exception may return a decision to its owner. Learning may alter a Work Center, resource allocation, or the definition of demand rather than merely updating a rule.
Policy: express intent and constraint
Policy states intended outcomes, obligations, constraints, and pre-agreed responses. Some policy can be expressed as executable rules: access constraints, required evidence, prohibited configurations, or thresholds tied to a bounded action. Other policy remains human-readable because it requires interpretation, proportionality, or reconciliation among competing duties.
Policy as code is therefore a mechanism, not the whole responsibility. Encoding a rule may improve consistency and testability, but executable syntax does not make the rule legitimate, current, complete, or fair. A policy needs an owner, scope, rationale, affected parties, review conditions, and a path for challenge. When policy cannot name those things, automation can reproduce ambiguity more quickly.
Decision rights: make authority executable
Decision rights identify who may decide, execute, advise, challenge, grant an exception, escalate, and revise policy. The allocation should be visible at the point of action. A role written in a governance document but absent from the workflow, environment, or incident path is not operationally complete.
Authority is not equivalent to hierarchy. A team may have authority to select an implementation within bounded risk while a security owner retains authority over a specific exception and an accountable executive retains authority over risk acceptance. A Digital Worker may execute a release but have no authority to reinterpret policy. Chapter 18 will address institutional governance design. Here the requirement is narrower: coordination must make the relevant decision right usable and traceable.
Work state: represent what a decision needs
Work state is a decision-relevant representation of intent, authorization, progress, dependencies, evidence, and unresolved conditions. It is not total reality. Tickets, repositories, deployment records, service catalogs, and operational telemetry each hold fragments. Treating any one record as complete can hide the relationships that matter most.
The operating system does not require a universal ticket or schema. It requires enough correspondence among records that an authorized actor can determine what is intended, what has changed, which conditions apply, and what remains unresolved. Chapter 7 will define the Work Order as the governable representation of demand. This chapter does not prescribe its fields or lifecycle.
Orchestration: coordinate human and technical action
Orchestration connects decisions and state to action across people and systems. Pipeline execution is one subset. Planning a risk review, obtaining a supplier attestation, preparing an operational change, pausing for user evidence, and convening an exception decision may all be orchestration even when no workflow engine owns the full path.
Good orchestration makes handoffs, waits, dependencies, owners, and stop conditions visible. It does not force every path into the same sequence. Work may branch, return to discovery, wait for an external decision, or end. When orchestration becomes a central queue that strips context from local actors, it has confused coordination with command.
Controls: constrain, authorize, detect, and stop
Controls translate obligations and risk decisions into conditions on action. They may prevent, detect, constrain, authorize, require correction, or stop. They may be automated, human, or combined. An inventory of controls says little about their coverage or effectiveness.
The Knight record shows the distinction. Automated emails existed, but the signal did not become an operational alert with an owner and consequence. Technical checks existed, but deployment completeness and aggregate exposure remained inadequately controlled. Control design must therefore connect a condition to the scope it covers, the evidence it uses, the actor who responds, and the authority available when the condition is met.CH06-R06
Evidence: make action and consequence inspectable
Evidence includes signals and records from demand, decisions, production, controls, operation, user response, incidents, and burden. It needs provenance, context, scope, timing, and an owner. A data point without those properties may still be useful, but it cannot safely carry a consequential decision by itself.
Evidence can be delayed, disputed, biased, or incomplete. A missing signal does not establish that a condition is absent. A green control does not establish that the relevant risk was modeled. The coordination layer should preserve uncertainty and make evidence obligations explicit instead of presenting recorded state as operational truth.
Measures: connect evidence to a decision
Measures select and organize evidence for a decision. They are not a universal dashboard. A service reliability indicator may govern a release policy. A value assessment may influence resourcing. A queue measure may reveal delay. Each remains partial and can be gamed or misunderstood.
Chapter 16 will own measure selection and balanced performance architecture. At this point, the Factory Operating System needs only a relationship: a measure must name the decision it informs, the population and interval it represents, its owner, and the consequence of crossing a boundary. Otherwise measurement becomes reporting without coordination.
Learning: change the conditions of later work
Learning occurs when evidence can change policy, priority, resources, capability, controls, or work. A postmortem, retrospective, audit, or review is not learning merely because it happened. The test is whether a responsible actor could make a different later decision and whether the system preserves that change.
Organizational-learning research makes the social conditions important. People must be able to surface error, uncertainty, and challenge without the process converting every disclosure into personal blame. Exploration and exploitation also compete: an organization can become efficient at executing current policy while losing the capacity to question it. The coordination layer must therefore preserve review and challenge, not merely accelerate enforcement.
The coordination loop
Figure F06.1 brings the responsibilities together. Policy and decision rights shape work state, orchestration, and controls. Contextual human and technical execution sits beside orchestration rather than beneath it. Execution and operation produce evidence. Measures and exceptions bring selected evidence to review. Review can change policy, priorities, resources, capability, or the work itself.
Figure F06.1 — Factory Operating System coordination loop. Policy and decision rights guide work state, orchestration, controls, and contextual execution. Evidence, measures, and exceptions return to a review and learning decision that may revise policy, priorities, resources, capability, or work. Challenge and recourse can interrupt automated paths.
Source: Author synthesis informed by S01, S03, S17, S18, A06, A07, B14–B16, CH06-R01, CH06-R04–R06, and CH06-R08. Cases test mechanisms and limits; they do not validate the integrated model. Structured specification: figures/F06.1-spec.md.
The figure is a responsibility loop, not a lifecycle. A change can enter through demand, an incident, a policy update, an asset defect, or an external obligation. The path can branch, pause, or stop. Evidence may return too late, be ignored, or be disputed. Review does not automatically create learning.
The challenge and recourse path is essential. An automated control may reject work correctly under its encoded rule while missing a lawful or safer contextual option. A local actor may request an exception, explain evidence, and seek a time-bounded decision. A control owner may deny it. An appeal path may bring in another authority. The resolution and rationale should return to the policy owner so repeated exceptions can expose a defective rule.
This is how common coordination can support autonomy. Local actors retain authority over situated choices within explicit boundaries. The shared layer supplies discoverable policy, decision rights, relevant state, interfaces, and evidence expectations. Escalation occurs because a named consequence or dependency crosses the boundary, not because a central team wishes to supervise every act.
Autonomy without these relationships can become fragmentation. Every team invents its own meaning for risk, completion, evidence, or exception. Shared services receive incompatible requests. Cross-line dependencies become negotiations among individuals. Senior leaders intervene late because no earlier route carried the conflict.
Coordination without contextual authority creates the opposite failure. Policy grows into detailed prescription. Exceptions wait in central queues. Local evidence must be translated for distant reviewers who lack the context to interpret it. Teams comply with the visible rule while concealing the work needed to make it viable. The operating system then creates control theater: more recorded decisions, less responsible action.
The desired condition is neither maximum standardization nor maximum local freedom. It is explicit allocation. Standardize the relationships that must remain coherent: identity, authority, interfaces, evidence semantics, challenge, and change. Leave contextual method with the actors closest to the work unless consequence or interdependency justifies a different boundary.
Consider a high-risk change that crosses a customer-facing service, a shared identity capability, and an external regulatory obligation. The coordination problem is not to force three groups through one detailed procedure. It is to preserve a common account of the intended outcome, affected boundary, decision owners, required evidence, unresolved conditions, and stop authority. The service team may select the implementation. The identity Work Center may define interface and compatibility conditions. An assurance owner may determine whether the evidence meets the stated obligation. If the work cannot satisfy one condition, the exception route should reveal who may decide, for how long, with what compensating control, and under what review.
The same pattern applies when policy changes across several Production Lines. A policy owner may revise a security requirement after a new threat, audit finding, or operational failure. Publication alone does not coordinate the change. Each affected line needs to know whether current work is grandfathered, paused, or reassessed; which Factory Assets and Work Rooms must change; which evidence demonstrates compliance; and who can explain a local incompatibility. The operating system carries those relationships while allowing each line to schedule and implement the change according to its actual state.
Neither example requires one workflow engine. A federated implementation may use policy repositories, identity systems, Work Order records, pipelines, evidence stores, risk tools, and human review. The requirement is correspondence: the participants should be able to reconstruct why a path was selected, which authority applied, what evidence supported the decision, and what condition will cause reconsideration. Integration at the level of meaning is more important than consolidation at the level of software.
Policy and decision rights guide work state, orchestration, controls, and contextual execution. Evidence, measures, and exceptions return to a review and learning decision that may revise policy, priorities, resources, capability, or work. Challenge and recourse can interrupt automated paths.
Explicit allocation avoids both central control theater and fragmented local autonomy by standardizing shared relationships while leaving contextual method with bounded actors.
A policy frame with local tailoring
The US Department of Defense Software Acquisition Pathway offers a bounded institutional test. DoDI 5000.87 establishes responsibilities and decision authority, calls for decisions and approvals at the lowest practicable level, and permits tailoring by program size, risk, complexity, and interdependency. It requires iterative delivery, active user involvement, planning, instrumentation, risk treatment, metrics, and annual value assessments that can inform later strategy and resourcing.CH06-R01
This is evidence of policy design, not of realized performance. The pathway spans application and embedded software contexts shaped by federal law, budgets, military missions, supplier relationships, and acquisition structures. Its roles, documents, cadences, and thresholds should not be copied into an enterprise template.
The case nevertheless illustrates the coordination balance. A shared frame names accountable roles, user relationships, decision points, evidence expectations, and review. Within that frame, authority can be delegated and the pathway tailored to local conditions. Central policy defines what must remain visible without prescribing every implementation choice.
Independent audit prevents a success-story reading. The US Government Accountability Office (GAO) found inconsistency in Agile oversight and gaps in engineering-tool planning outside the software pathway, with recommendations involving outcome metrics and value assessment. A later GAO review found that military-department policies reflected iterative design, validation, production, and user feedback while emphasizing different elements.CH06-R02CH06-R03
Those findings reveal two limits. First, policy existence is not implementation. A rule can be approved yet absent from pathways, tools, or local behavior. Second, federation produces variation. Some variation is legitimate tailoring; some may create blind spots. The operating system needs evidence and review capable of distinguishing the two. A central demand for sameness cannot make that judgment in advance.
Transfer only the mechanism: a shared frame of outcomes, constraints, authority, user agreement, evidence, and review, combined with explicit tailoring. Do not transfer the institution's roles or claim that the pathway caused a delivery result. The case supports possibility and design responsibility, not a performance guarantee.
The DoD policy frame, Google error-budget example, and Knight Capital countercase test coordination mechanisms and failure boundaries; none proves adoption or a causal performance effect.
From service evidence to a release decision
Google's published Site Reliability Engineering material provides a narrower mechanism example. Its example error-budget policy identifies a service scope, owners and approvers, evidence conditions, release responses, cause-sensitive exceptions, postmortem expectations, escalation, and review metadata. Related guidance describes stakeholder agreement, named actions, documented rationale, review dates, and returning to policy approval when parties disagree.CH06-R04CH06-R05
The useful relationship is not Google's numerical threshold or time window. Those values are context-specific and are not recommendations here. Nor do first-party practice records independently establish effectiveness. The example shows how one bounded policy can connect operational evidence to a consequential decision without prescribing every engineering action.
Within the agreed boundary, a team remains responsible for diagnosis and correction. The evidence changes what work may proceed and what priority reliability receives. Cause-sensitive exceptions prevent the rule from treating every event as equivalent. Escalation supplies recourse when stakeholders disagree. Review allows the policy itself to be questioned.
This compact example contains all eight responsibilities, but only for a service-reliability decision. Policy defines intent and response. Decision rights name owners and approvers. Work state connects current reliability and release intent. Orchestration changes planned action. Controls constrain releases. Evidence comes from service behavior. Measures organize that evidence. Learning occurs only if postmortem or review changes later work or policy.
It is still not the complete Factory Operating System. It does not allocate every institutional decision, represent every dependency, or govern every form of evidence. It demonstrates why the coordination layer can be federated: a common relationship pattern can appear in many locally owned policies without one universal workflow.
When the loop breaks
Return to Knight Capital with the framework in view. The SEC record shows a deployment problem, but it also shows failures across relationships. The relevant work state did not reliably represent deployment across all servers. Automated messages did not carry the semantics, ownership, or escalation of an operational alert. Controls did not connect individual actions to aggregate market exposure. Incident procedures did not provide an adequate coordinated response. Earlier events did not produce sufficiently broad corrective learning.CH06-R06
No single missing component explains the event. A more complete ticket would not by itself create exposure controls. An additional automated message would not make the signal actionable. A policy document would not ensure deployment completeness. A local engineer could not necessarily see the aggregate consequence. A senior authority without current state could not direct a safe response.
KCG Holdings later reported changes to risk governance, change review, supervisory approval, outbound-router monitoring, kill switches, emergency response, and escalation. These statements are company-reported remediation, not independently verified effectiveness.CH06-R07 Their range reinforces the bounded point: the response crossed technology, authority, monitoring, stop mechanisms, and incident coordination because the failure crossed them.
The countercase does not prove that a Factory Operating System would have prevented the event. That would turn an explanatory framework into unsupported counterfactual certainty. It does supply hard questions for any coordination design:
- Does recorded state cover the deployment or action boundary that matters?
- Does a detected condition become evidence with a named owner and consequence?
- Can controls see aggregate exposure, not only local actions?
- Who can stop, escalate, or challenge, and can they act in time?
- Can an earlier weak signal change the policy or control model before recurrence?
These questions apply beyond trading, but their answers must reflect context. A low-risk content change does not need the same stop authority or response speed as a market-routing system. Proportionality is part of coordination. Treating every change as catastrophic would overload the system and make genuine distinctions harder to see.
Designing for both coherence and freedom
Leaders often approach coordination through one of two instincts. The first is to centralize: choose a common platform, require a common process, and route exceptions to a central authority. The second is to empower: give teams end-to-end ownership and reduce external dependencies. Each can correct real dysfunction. Each becomes dangerous when treated as a complete principle.
Centralization can establish common evidence, interfaces, and controls. It can also increase decision latency, concentrate failure, and remove context. Local autonomy can accelerate situated judgment and strengthen ownership. It can also fragment state, duplicate capability, and leave cross-boundary risk without an owner. The question is not which topology is virtuous. It is which relationships require coherence and which decisions require context.
A practical coordination review can use six tests.
First, name the decision. “Improve governance” is not a decision. “May this high-risk change proceed under these conditions?” is. The decision identifies the authority, evidence, time horizon, and consequence that coordination must support.
Second, separate policy from execution. State the outcome, constraint, and exception logic that must remain coherent. Do not prescribe local method unless the method itself carries cross-boundary risk or evidence obligations.
Third, make state correspondence visible. Identify which records represent intent, authorization, deployed condition, operational behavior, and unresolved risk. Do not require one database; require known relationships and correction paths among partial records.
Fourth, attach controls to consequence. A control must identify scope, trigger, response owner, authority, evidence, and failure mode. More controls do not necessarily produce more safety. An unactionable alert can increase noise while preserving risk.
Fifth, design exception and recourse with the rule. Name who can request, decide, challenge, time-limit, review, and revoke an exception. Repeated exceptions are evidence about policy, capability, or demand—not merely noncompliance.
Sixth, prove that review can change something. Name the policy, priority, resource, capability, control, or work decision that the review can alter. If nothing can change, the activity is reporting.
Executives should inspect these relationships, not operate every workflow. They should ask whether consequential decisions have legitimate owners, whether local actors possess sufficient authority, whether cross-line dependencies are visible, whether evidence can interrupt action, and whether challenge reaches someone able to respond. They should also look for policy lag: a local adaptation may become safer than waiting for a formal revision, provided its authority and evidence remain explicit.
The same tests apply to automation. A policy engine may enforce a bounded rule. A pipeline may move work state. An observability service may emit evidence. A Digital Worker may coordinate an authorized task. None should silently acquire the authority to interpret ambiguous obligations or close an exception. Chapter 11 will define bounded delegation; the present rule is that automation inherits explicit authority and evidence duties rather than creating its own.
What each participant should know
For a practitioner, the coordination layer should reduce avoidable interpretation work. Before acting, the practitioner should be able to find the applicable policy, current authorization, dependencies, evidence expectations, and available exception route. During work, state changes should remain visible to affected parties without demanding constant status translation. After work, evidence should return to the owner of the next relevant decision. This does not eliminate uncertainty. It prevents uncertainty about the system from being confused with uncertainty inherent in the problem.
For a Work Center owner, the layer should expose demand and service relationships without turning the center into an anonymous queue. Requests should carry enough context to identify outcome, consequence, urgency, and required evidence. The owner should be able to publish interface and policy changes, see repeated exceptions, and distinguish a capacity problem from a defective interface or missing asset. Chapter 8 will examine those topology choices; here they are coordination obligations.
For a policy or control owner, the layer should reveal how a rule behaves in practice. Which work is stopped? Which exceptions recur? Which populations carry the burden? Which evidence is routinely missing or disputed? A rule that appears sound in isolation may create unsafe delay or encourage workarounds when it meets production. The owner needs a review cadence and authority to revise the rule, not merely a compliance count.
For an executive, the system should make intervention more selective. Leaders should not need to enter normal local decisions. They should see unresolved conflicts whose consequence crosses boundaries, persistent constraints that local actors cannot remove, evidence that a policy is not working, and exceptions that exceed delegated authority. Escalation is then a designed relationship rather than a symptom of missing coordination.
These perspectives also expose a boundary. The Factory Operating System cannot manufacture trust where incentives punish disclosure, authority is deliberately ambiguous, or leaders override policy without evidence. It can make those conditions visible. It cannot make an institution act on them. Coordination architecture supports accountable behavior; it does not substitute for it.
Six decision questions test whether coordination connects policy, state, controls, exception, evidence, and possible change without becoming a score or prescribed process.
What to remember
The Factory Operating System is the coordinating layer of a Software Factory that makes policy, decision rights, work state, orchestration, controls, evidence, measures, and learning explicit and operable across the production system.
Its name and eight-part integration are author synthesis. The framework does not require a single product, architecture, workflow, data model, queue, committee, or central team. Existing mechanisms may already satisfy the responsibilities under different language.
Coordination preserves contextual autonomy when actors can see the outcomes, constraints, interfaces, evidence obligations, exceptions, and escalation conditions that bound their authority. It does not guarantee autonomy, and decentralization without shared relationships can produce fragmentation.
Policy as code, workflow automation, controls, observability, dashboards, and reviews are narrower mechanisms. They contribute only when their relationships to legitimate decisions and accountable actors are explicit.
Evidence becomes learning only when it can change policy, priorities, resources, capability, controls, or work. Collection, reporting, alerts, postmortems, and meetings do not qualify by themselves.
The Factory Operating System coordinates decisions, not obedience.
From coordination to authorized demand
The coordination layer now makes the factory's governing relationships visible. It can express policy, locate authority, connect state to action, expose exceptions, and return evidence to a decision. But it still needs a governable object on which those relationships can operate.
Demand rarely arrives as a stable instruction. It may be a regulatory obligation, user problem, reliability concern, hypothesis, incident finding, or strategic option. If it enters the factory as an unqualified ticket, important authority and evidence can disappear. If it is frozen into a complete specification too early, discovery becomes unauthorized deviation.
The next question is therefore unavoidable: How can uncertain demand become authorized, traceable work without freezing discovery too early? Chapter 7 will answer through the Work Order—a progressively elaborated authorization boundary, not a bureaucratic form.
The coordination layer needs a governable representation of uncertain demand before policy, authority, evidence, and revision can operate coherently.