Factual summary
Underwrite behaviour, authority and change.
Agent-operated strategies require the conventional assessment of return quality, drawdown, leverage, concentration, capacity and execution. They also require a map of what the agent can observe, decide and execute; which models, tools and policies it uses; and how those components can change.
Evidence model
Logs and lineage must connect decisions to outcomes.
Useful evidence includes transaction history, prompts or policy states where available, tool calls, model and code versions, permission boundaries, overrides, exception records and monitoring events. The absence of interpretable traces lowers evidence confidence even when performance appears attractive.
Governance
Human control must be an operating mechanism.
Institutions should define approval limits, position and loss constraints, permitted venues, emergency stops, change controls, review triggers and accountable human owners. A human-in-the-loop statement is not sufficient unless intervention rights and response procedures are testable.
Model drift, tool failure, prompt injection, permission escalation and silent software change can create risks that are not visible in a return series.
Institutional review
Five questions organise the operating-risk assessment.
- Authority: What can the system observe, decide, sign, transfer, or execute without another approval?
- Change: Which model, code, prompt, tool, policy, or dependency changes can alter behaviour, and who approves them?
- Evidence: Can each material decision be connected to a timestamped input, action, outcome, and software version?
- Limits: Are position, leverage, venue, loss, and transfer constraints enforced outside the reasoning layer?
- Intervention: Who receives alerts, who can stop the system, and has the response path been tested under failure?
The answers should be compared with observed behaviour. A policy document that is not enforced, logged, and reviewable provides weaker evidence than a technical control with a visible operating record.
Sources and related pages
