cayu.evals.workflow_target
Public Cayu API. Definitions are grouped by their public source module, and definitions from private implementation modules appear on their package’s page; adding a symbol does not move existing links. The import shown at each entry is a supported public namespace. Read the Python API overview and install the required extra.
WORKFLOW_EVAL_DEFAULT_CLOSE_TIMEOUT_SECONDS
Section titled “WORKFLOW_EVAL_DEFAULT_CLOSE_TIMEOUT_SECONDS”from cayu.evals import WORKFLOW_EVAL_DEFAULT_CLOSE_TIMEOUT_SECONDSWORKFLOW_EVAL_DEFAULT_CLOSE_TIMEOUT_SECONDS = 30.0Release source · Runtime guarantees · Capability guides
workflow_eval_input_messages_sha256
Section titled “workflow_eval_input_messages_sha256”from cayu.evals import workflow_eval_input_messages_sha256Bind the exact candidate input retained on a workflow-root trajectory.
workflow_eval_input_messages_sha256(messages: tuple[Message, ...]) -> strRelease source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_APPLICATION_CONTEXT_BYTES
Section titled “WORKFLOW_EVAL_MAX_APPLICATION_CONTEXT_BYTES”from cayu.evals import WORKFLOW_EVAL_MAX_APPLICATION_CONTEXT_BYTESWORKFLOW_EVAL_MAX_APPLICATION_CONTEXT_BYTES = 64 << 10Release source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_CLOSE_TIMEOUT_SECONDS
Section titled “WORKFLOW_EVAL_MAX_CLOSE_TIMEOUT_SECONDS”from cayu.evals import WORKFLOW_EVAL_MAX_CLOSE_TIMEOUT_SECONDSWORKFLOW_EVAL_MAX_CLOSE_TIMEOUT_SECONDS = 300.0Release source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_FINAL_OUTPUT_CHARS
Section titled “WORKFLOW_EVAL_MAX_FINAL_OUTPUT_CHARS”from cayu.evals import WORKFLOW_EVAL_MAX_FINAL_OUTPUT_CHARSWORKFLOW_EVAL_MAX_FINAL_OUTPUT_CHARS = 1048576Release source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_INPUT_BYTES
Section titled “WORKFLOW_EVAL_MAX_INPUT_BYTES”from cayu.evals import WORKFLOW_EVAL_MAX_INPUT_BYTESWORKFLOW_EVAL_MAX_INPUT_BYTES = 8 << 20Release source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_INPUT_MESSAGES
Section titled “WORKFLOW_EVAL_MAX_INPUT_MESSAGES”from cayu.evals import WORKFLOW_EVAL_MAX_INPUT_MESSAGESWORKFLOW_EVAL_MAX_INPUT_MESSAGES = 32Release source · Runtime guarantees · Capability guides
WORKFLOW_EVAL_MAX_STRUCTURED_OUTPUT_BYTES
Section titled “WORKFLOW_EVAL_MAX_STRUCTURED_OUTPUT_BYTES”from cayu.evals import WORKFLOW_EVAL_MAX_STRUCTURED_OUTPUT_BYTESWORKFLOW_EVAL_MAX_STRUCTURED_OUTPUT_BYTES = 256 << 10Release source · Runtime guarantees · Capability guides
workflow_eval_output_sha256
Section titled “workflow_eval_output_sha256”from cayu.evals import workflow_eval_output_sha256Bind one projected text result without duplicating it in evidence metadata.
workflow_eval_output_sha256(final_output: str) -> strRelease source · Runtime guarantees · Capability guides
workflow_eval_trial_session_id
Section titled “workflow_eval_trial_session_id”from cayu.evals import workflow_eval_trial_session_idDerive the recovery-stable root identity for one concrete workflow trial.
workflow_eval_trial_session_id(*, target_revision: str, run_id: str, suite_id: str, case_id: str, trial_number: int) -> strRelease source · Runtime guarantees · Capability guides
workflow_spec_revision
Section titled “workflow_spec_revision”from cayu.evals import workflow_spec_revisionReturn the canonical public revision of one workflow specification.
workflow_spec_revision(spec: WorkflowSpec) -> strRelease source · Runtime guarantees · Capability guides
WorkflowEvalExecution
Section titled “WorkflowEvalExecution”from cayu.evals import WorkflowEvalExecutionThe exact application/workflow pair and optional quiescence callback for one trial.
Decorators: @dataclass(frozen=True, slots=True).
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
app |
CayuApp |
required |
workflow |
WorkflowBase |
required |
close |
Callable[[], Awaitable[None]] | None |
None |
Release source · Runtime guarantees · Capability guides
WorkflowEvalFactory
Section titled “WorkflowEvalFactory”from cayu.evals import WorkflowEvalFactoryWorkflowEvalFactory: TypeAlias = Callable[[WorkflowEvalInvocation], WorkflowEvalExecution | Awaitable[WorkflowEvalExecution]]Release source · Runtime guarantees · Capability guides
WorkflowEvalInstanceScope
Section titled “WorkflowEvalInstanceScope”from cayu.evals import WorkflowEvalInstanceScopeHow a target constructs application/workflow state for concrete trials.
Bases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
SHARED |
class attribute |
'shared' |
PER_TRIAL |
class attribute |
'per_trial' |
Release source · Runtime guarantees · Capability guides
WorkflowEvalInvocation
Section titled “WorkflowEvalInvocation”from cayu.evals import WorkflowEvalInvocationBounded candidate input and runtime identities supplied to one trusted factory.
Bases: BaseModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
run_id |
StrictStr |
Field(max_length=256) |
suite_id |
StrictStr |
Field(max_length=128) |
case_id |
StrictStr |
Field(max_length=128) |
trial_number |
StrictInt |
Field(ge=1, le=100) |
workflow_run_id |
StrictStr |
Field(max_length=128) |
idempotency_key |
StrictStr |
Field(max_length=256) |
messages |
tuple[Message, ...] |
required |
application_context |
dict[str, Any] |
Field(default_factory=dict) |
validate_ids (method)
Section titled “validate_ids (method)”WorkflowEvalInvocation.validate_ids(value: str, info) -> strcopy_messages (method)
Section titled “copy_messages (method)”WorkflowEvalInvocation.copy_messages(value: object) -> tuple[Message, ...]copy_application_context (method)
Section titled “copy_application_context (method)”WorkflowEvalInvocation.copy_application_context(value: object) -> dict[str, Any]Release source · Runtime guarantees · Capability guides
WorkflowEvalOutputEvidenceV1
Section titled “WorkflowEvalOutputEvidenceV1”from cayu.evals import WorkflowEvalOutputEvidenceV1Replay-safe binding from projected output to one exact workflow completion.
Bases: BaseModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
schema_version |
Literal[1] |
1 |
target_revision |
StrictStr |
required |
projector_revision |
StrictStr |
required |
workflow_name |
StrictStr |
required |
attempt_id |
StrictStr |
required |
completion_event_id |
StrictStr |
required |
input_message_count |
StrictInt |
Field(ge=0, le=WORKFLOW_EVAL_MAX_INPUT_MESSAGES) |
input_messages_sha256 |
StrictStr |
required |
final_output_sha256 |
StrictStr |
required |
structured_output |
dict[str, Any] | None |
None |
validate_schema_version_type (method)
Section titled “validate_schema_version_type (method)”WorkflowEvalOutputEvidenceV1.validate_schema_version_type(value: object) -> objectvalidate_revisions (method)
Section titled “validate_revisions (method)”WorkflowEvalOutputEvidenceV1.validate_revisions(value: str, info) -> strvalidate_sha256 (method)
Section titled “validate_sha256 (method)”WorkflowEvalOutputEvidenceV1.validate_sha256(value: str, info) -> strvalidate_ids (method)
Section titled “validate_ids (method)”WorkflowEvalOutputEvidenceV1.validate_ids(value: str, info) -> strcopy_structured_output (method)
Section titled “copy_structured_output (method)”WorkflowEvalOutputEvidenceV1.copy_structured_output(value: object) -> dict[str, Any] | NoneRelease source · Runtime guarantees · Capability guides
WorkflowEvalResult
Section titled “WorkflowEvalResult”from cayu.evals import WorkflowEvalResultTyped bounded candidate output returned by an application-owned projector.
Bases: BaseModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
final_output |
StrictStr |
required |
structured_output |
dict[str, Any] | None |
None |
validate_final_output (method)
Section titled “validate_final_output (method)”WorkflowEvalResult.validate_final_output(value: str, info) -> strcopy_structured_output (method)
Section titled “copy_structured_output (method)”WorkflowEvalResult.copy_structured_output(value: object) -> dict[str, Any] | NoneRelease source · Runtime guarantees · Capability guides
WorkflowEvalResultProjector
Section titled “WorkflowEvalResultProjector”from cayu.evals import WorkflowEvalResultProjectorWorkflowEvalResultProjector: TypeAlias = Callable[[WorkflowEvalTerminalEvidence], WorkflowEvalResult | Awaitable[WorkflowEvalResult]]Release source · Runtime guarantees · Capability guides
WorkflowEvalTargetIdentityV1
Section titled “WorkflowEvalTargetIdentityV1”from cayu.evals import WorkflowEvalTargetIdentityV1Portable behavior identity for a trusted workflow-root eval target.
Bases: BaseModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
schema_version |
Literal[1] |
1 |
revision |
StrictStr |
required |
workflow_name |
StrictStr |
required |
workflow_spec_revision |
StrictStr |
required |
implementation_revision |
StrictStr |
required |
result_projector_revision |
StrictStr |
required |
execution_scope_revision |
StrictStr |
required |
application_context_revision |
StrictStr |
required |
evidence_policy_revision |
StrictStr |
required |
capture_bounds |
SessionTrajectoryBounds | None |
Field(default=None, exclude_if=lambda value: value is None) |
instance_scope |
WorkflowEvalInstanceScope |
required |
close_timeout_seconds |
float |
Field(gt=0, le=WORKFLOW_EVAL_MAX_CLOSE_TIMEOUT_SECONDS) |
validate_schema_version_type (method)
Section titled “validate_schema_version_type (method)”WorkflowEvalTargetIdentityV1.validate_schema_version_type(value: object) -> objectvalidate_workflow_name (method)
Section titled “validate_workflow_name (method)”WorkflowEvalTargetIdentityV1.validate_workflow_name(value: str, info) -> strvalidate_revisions (method)
Section titled “validate_revisions (method)”WorkflowEvalTargetIdentityV1.validate_revisions(value: str, info) -> strvalidate_close_timeout (method)
Section titled “validate_close_timeout (method)”WorkflowEvalTargetIdentityV1.validate_close_timeout(value: object) -> objectvalidate_revision (method)
Section titled “validate_revision (method)”WorkflowEvalTargetIdentityV1.validate_revision() -> WorkflowEvalTargetIdentityV1create (method)
Section titled “create (method)”WorkflowEvalTargetIdentityV1.create(*, workflow_spec: WorkflowSpec, implementation_revision: str, result_projector_revision: str, execution_scope_revision: str, application_context: dict[str, Any], evidence_policy_revision: str, instance_scope: WorkflowEvalInstanceScope | str, close_timeout_seconds: float, capture_bounds: SessionTrajectoryBounds | None=None) -> WorkflowEvalTargetIdentityV1Release source · Runtime guarantees · Capability guides
WorkflowEvalTerminalEvidence
Section titled “WorkflowEvalTerminalEvidence”from cayu.evals import WorkflowEvalTerminalEvidenceExact current-attempt completion evidence visible to the result projector.
Bases: BaseModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
workflow_run_id |
StrictStr |
required |
workflow_name |
StrictStr |
required |
attempt_id |
StrictStr |
required |
completion_event |
Event |
required |
validate_ids (method)
Section titled “validate_ids (method)”WorkflowEvalTerminalEvidence.validate_ids(value: str, info) -> strcopy_completion_event (method)
Section titled “copy_completion_event (method)”WorkflowEvalTerminalEvidence.copy_completion_event(value: object) -> objectvalidate_completion_boundary (method)
Section titled “validate_completion_boundary (method)”WorkflowEvalTerminalEvidence.validate_completion_boundary() -> WorkflowEvalTerminalEvidence