cayu.evals.scenario_preflight

Public Cayu API. Definitions are grouped by their public source module, and definitions from private implementation modules appear on their package’s page; adding a symbol does not move existing links. The import shown at each entry is a supported public namespace. Read the Python API overview and install the required extra.

materialize_eval_scenario_artifact_fixture

from cayu.evals import materialize_eval_scenario_artifact_fixture

Idempotently copy exact retained bytes into a reusable environment fixture.

async materialize_eval_scenario_artifact_fixture(scenario: EvalScenarioDocumentV2, target: CorpusTarget, requirement_id: str, *, environment_name: str | None=None, source_artifact_id: str | None=None, project_root: str | Path | None=None) -> ScenarioArtifactMaterializationV2

Release source · Runtime guarantees · Capability guides

preflight_eval_scenario

from cayu.evals import preflight_eval_scenario

Resolve current launch facts without invoking providers or application work.

async preflight_eval_scenario(scenario: EvalScenarioDocumentV2, target: CorpusTarget, settings: ScenarioLaunchSettingsV2 | None=None, *, actor_authorized: bool, project_root: str | Path | None=None) -> ScenarioLaunchPreflightResultV2

Release source · Runtime guarantees · Capability guides

SCENARIO_PREFLIGHT_ARTIFACT_READ_CONCURRENCY

from cayu.evals import SCENARIO_PREFLIGHT_ARTIFACT_READ_CONCURRENCY

SCENARIO_PREFLIGHT_ARTIFACT_READ_CONCURRENCY = 8

Release source · Runtime guarantees · Capability guides

SCENARIO_PREFLIGHT_MAX_DIAGNOSTICS

from cayu.evals import SCENARIO_PREFLIGHT_MAX_DIAGNOSTICS

SCENARIO_PREFLIGHT_MAX_DIAGNOSTICS = 1024

Release source · Runtime guarantees · Capability guides

ScenarioArtifactLaunchBindingV2

from cayu.evals import ScenarioArtifactLaunchBindingV2

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
requirement_id	StrictStr	Field(max_length=128)
artifact_id	StrictStr	Field(max_length=512)
content_sha256	StrictStr	required

validate_requirement_id (method)

ScenarioArtifactLaunchBindingV2.validate_requirement_id(value: str, info) -> str

validate_artifact_id (method)

ScenarioArtifactLaunchBindingV2.validate_artifact_id(value: str, info) -> str

validate_digest (method)

ScenarioArtifactLaunchBindingV2.validate_digest(value: str, info) -> str

Release source · Runtime guarantees · Capability guides

ScenarioArtifactMaterializationError

from cayu.evals import ScenarioArtifactMaterializationError

Bases: RuntimeError.

init (method)

ScenarioArtifactMaterializationError.__init__(code: ScenarioLaunchDiagnosticCode) -> None

Release source · Runtime guarantees · Capability guides

ScenarioArtifactMaterializationV2

from cayu.evals import ScenarioArtifactMaterializationV2

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
scenario	EvalScenarioDocumentV2	required
requirement_id	StrictStr	Field(max_length=128)
artifact_id	StrictStr	Field(max_length=512)

validate_requirement_id (method)

ScenarioArtifactMaterializationV2.validate_requirement_id(value: str, info) -> str

validate_artifact_id (method)

ScenarioArtifactMaterializationV2.validate_artifact_id(value: str, info) -> str

Release source · Runtime guarantees · Capability guides

ScenarioLaunchBindingV2

from cayu.evals import ScenarioLaunchBindingV2

Public-safe facts frozen by one successful current-authority preflight.

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
revision	StrictStr	required
scenario_revision	StrictStr	required
target_key	StrictStr	required
application_release_id	StrictStr	Field(max_length=256)
app_manifest_fingerprint	StrictStr	required
agent_name	StrictStr	Field(max_length=256)
environment_name	StrictStr | None	Field(default=None, max_length=256)
approval_behavior	Literal['fresh_decision']	'fresh_decision'
trials	StrictInt	Field(ge=1, le=EVAL_CORPUS_MAX_TRIALS)
max_concurrency	StrictInt	Field(ge=1, le=EVAL_MAX_CONCURRENCY)
timeout_seconds	StrictInt	Field(ge=1, le=EVAL_CORPUS_MAX_TIMEOUT_SECONDS)
max_steps	StrictInt	Field(ge=1, le=MAX_STEPS)
target_limits	RunLimits	required
operator_run_limits	RunLimits | None	None
cost_budget	EvalRunCostBudget | None	None
artifacts	tuple[ScenarioArtifactLaunchBindingV2, ...]	Field(default_factory=tuple, max_length=EVAL_SCENARIO_MAX_ARTIFACT_REQUIREMENTS)
secrets	tuple[ScenarioSecretLaunchBindingV2, ...]	Field(default_factory=tuple, max_length=EVAL_SCENARIO_MAX_SECRET_REQUIREMENTS)

validate_revisions (method)

ScenarioLaunchBindingV2.validate_revisions(value: str, info) -> str

validate_target_key (method)

ScenarioLaunchBindingV2.validate_target_key(value: str, info) -> str

validate_identity_text (method)

ScenarioLaunchBindingV2.validate_identity_text(value: str | None, info) -> str | None

validate_manifest_fingerprint (method)

ScenarioLaunchBindingV2.validate_manifest_fingerprint(value: str, info) -> str

copy_limits (method)

ScenarioLaunchBindingV2.copy_limits(value: object) -> object

validate_revision (method)

ScenarioLaunchBindingV2.validate_revision(info: ValidationInfo) -> ScenarioLaunchBindingV2

create (method)

ScenarioLaunchBindingV2.create(**values: Any) -> ScenarioLaunchBindingV2

Release source · Runtime guarantees · Capability guides

ScenarioLaunchDiagnosticCode

from cayu.evals import ScenarioLaunchDiagnosticCode

Bases: StrEnum.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
TARGET_MISMATCH	class attribute	'target_mismatch'
PROVIDER_UNAVAILABLE	class attribute	'provider_unavailable'
ENVIRONMENT_UNAVAILABLE	class attribute	'environment_unavailable'
EXECUTION_BINDING_REQUIRED	class attribute	'execution_binding_required'
ARTIFACT_BINDING_REQUIRED	class attribute	'artifact_binding_required'
ARTIFACT_NOT_RETAINED	class attribute	'artifact_not_retained'
ARTIFACT_ACCESS_DENIED	class attribute	'artifact_access_denied'
ARTIFACT_STORE_UNAVAILABLE	class attribute	'artifact_store_unavailable'
ARTIFACT_CONTENT_INCONSISTENT	class attribute	'artifact_content_inconsistent'
SECRET_REFERENCE_UNAVAILABLE	class attribute	'secret_reference_unavailable'
APPROVAL_TOOL_UNAVAILABLE	class attribute	'approval_tool_unavailable'
APPROVAL_POLICY_SELECTION_REQUIRED	class attribute	'approval_policy_selection_required'
EXECUTION_LIMIT_EXCEEDED	class attribute	'execution_limit_exceeded'
PRICING_UNAVAILABLE	class attribute	'pricing_unavailable'
ACTOR_AUTHORITY_UNAVAILABLE	class attribute	'actor_authority_unavailable'
SCENARIO_CONTENT_UNSAFE	class attribute	'scenario_content_unsafe'

Release source · Runtime guarantees · Capability guides

ScenarioLaunchDiagnosticV2

from cayu.evals import ScenarioLaunchDiagnosticV2

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
code	ScenarioLaunchDiagnosticCode	required
message	StrictStr	Field(min_length=1, max_length=512)
remediation	StrictStr	Field(min_length=1, max_length=512)
event_id	StrictStr | None	Field(default=None, max_length=128)
requirement_id	StrictStr | None	Field(default=None, max_length=128)

validate_optional_id (method)

ScenarioLaunchDiagnosticV2.validate_optional_id(value: str | None, info) -> str | None

validate_copy (method)

ScenarioLaunchDiagnosticV2.validate_copy() -> ScenarioLaunchDiagnosticV2

Release source · Runtime guarantees · Capability guides

ScenarioLaunchPreflightResultV2

from cayu.evals import ScenarioLaunchPreflightResultV2

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
ready	StrictBool	required
scenario_revision	StrictStr	required
binding	ScenarioLaunchBindingV2 | None	None
diagnostics	tuple[ScenarioLaunchDiagnosticV2, ...]	Field(default_factory=tuple, max_length=SCENARIO_PREFLIGHT_MAX_DIAGNOSTICS)

validate_scenario_revision (method)

ScenarioLaunchPreflightResultV2.validate_scenario_revision(value: str, info) -> str

validate_readiness (method)

ScenarioLaunchPreflightResultV2.validate_readiness() -> ScenarioLaunchPreflightResultV2

Release source · Runtime guarantees · Capability guides

ScenarioLaunchSettingsV2

from cayu.evals import ScenarioLaunchSettingsV2

Authority-free operator selections narrowed by current server policy.

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
environment_name	StrictStr | None	Field(default=None, max_length=256)
approval_behavior	Literal['fresh_decision']	'fresh_decision'
trials	StrictInt	Field(default=1, ge=1, le=EVAL_CORPUS_MAX_TRIALS)
max_concurrency	StrictInt	Field(default=1, ge=1, le=EVAL_MAX_CONCURRENCY)
timeout_seconds	StrictInt	Field(default=300, ge=1, le=EVAL_CORPUS_MAX_TIMEOUT_SECONDS)
max_steps	StrictInt | None	Field(default=None, ge=1, le=MAX_STEPS)
limits	RunLimits | None	None
cost_budget	EvalRunCostBudget | None	None
artifact_references	dict[StrictStr, StrictStr]	Field(default_factory=dict, max_length=EVAL_SCENARIO_MAX_ARTIFACT_REQUIREMENTS)

validate_environment_name (method)

ScenarioLaunchSettingsV2.validate_environment_name(value: str | None, info) -> str | None

require_run_scoped_limits (method)

ScenarioLaunchSettingsV2.require_run_scoped_limits(value: object) -> object

validate_artifact_references (method)

ScenarioLaunchSettingsV2.validate_artifact_references(value: dict[str, str]) -> dict[str, str]

Release source · Runtime guarantees · Capability guides

ScenarioSecretLaunchBindingV2

from cayu.evals import ScenarioSecretLaunchBindingV2

Public proof that a named requirement has a current vault binding.

Bases: _ScenarioPreflightModel.

Fields and attributes

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name	Type	Default
requirement_id	StrictStr	Field(max_length=128)
usage	Literal['provider', 'tool', 'environment', 'artifact', 'other']	required

validate_requirement_id (method)

ScenarioSecretLaunchBindingV2.validate_requirement_id(value: str, info) -> str

Release source · Runtime guarantees · Capability guides