Skip to content
SupraOS
VTWM TECHNICAL EVALUATION

How VTWM handles hidden effects, delayed risk and silent policy failure.

The evaluation asks whether a model can anticipate consequences that are not obvious in the immediate state, rank risks that appear later and avoid releasing policy-breaking actions without overwhelming human review.

PRIMARY RESULTS

Stronger consequence detection with fewer silent failures.

84.13%hidden-effect recall
Language-model agent + policy monitor: 61.94%
89.57%delayed-risk AUROC
Language-model agent + policy monitor: 84.96%
1.31%silent policy-violation rate
Language-model agent + policy monitor: 21.76%
POLICY-INVISIBLE CASES

VTWM left 2 violations silent. The language-model agent plus monitor left 167.

VTWM2
Language-model agent + policy monitor167
Cases2,4002,400
Policy violations648648
Hidden effects found356 / 480257 / 480
Delayed-risk AUPRC86.81%76.46%
Reviews1,0711,389

First value: VTWMSecond value: language-model agent + policy monitor

TRANSFER BEYOND FAMILIAR PATTERNS

The transition model retained performance across new workflow structures, enterprise environments and policy families.

NEW WORKFLOW STRUCTURES94.21transition F184.04%hidden-effect recall86.09%delayed-risk AUPRC
NEW ENTERPRISE ENVIRONMENT94.15transition F186.98%hidden-effect recall85.31%delayed-risk AUPRC
NEW POLICY FAMILY94.28transition F184.10%hidden-effect recall85.64%delayed-risk AUPRC
WHY THIS MATTERS IN PRODUCTION

A consequential action can be locally correct and still create the wrong company future.

Hidden effects

Changes in one system can alter customer, contract, product or finance conditions that are not visible in the immediate action record.

Delayed risk

The commercial consequence may appear after the write succeeds, when a decision window, obligation or customer condition changes.

Silent policy failure

An action can look operationally valid while violating a constraint that should have stopped or narrowed the move.

See the same model choose and verify a live company route.

Run the demo