Skip to content

cayu.evals.incremental_recovery

Public Cayu API. Definitions are grouped by their public source module, and definitions from private implementation modules appear on their package’s page; adding a symbol does not move existing links. The import shown at each entry is a supported public namespace. Read the Python API overview and install the required extra.

from cayu.evals import capture_incremental_workflow_eval_attempt

Capture and revalidate one saved attempt without providers, tools or callbacks.

admission must be shared across concurrent callers. Limits are aggregate across the selected descendants; two full reads are charged as processing work. Root journal reads retain their separate existing finite bound. The first seal cannot establish the contents of records deleted before capture began.

async capture_incremental_workflow_eval_attempt(target: WorkflowEvalTarget, source_trial: EvalTrialResult, *, messages: tuple[Message, ...], output: WorkflowEvalResult | None=None, limits: IncrementalEvidenceLimits, admission: IncrementalEvidenceAdmission, expected_evidence_sha256: str | None=None) -> SavedIncrementalWorkflowCapture

Release source · Runtime guarantees · Capability guides

from cayu.evals import IncrementalCaptureProgress

Payload-free progress, inspectable without source I/O after expiry.

Bases: BaseModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
stage str required
session_id str | None None
processed_events StrictInt Field(default=0, ge=0)
processed_transcript_records StrictInt Field(default=0, ge=0)
processed_bytes StrictInt Field(default=0, ge=0)
peak_record_bytes StrictInt Field(default=0, ge=0)
peak_spill_bytes StrictInt Field(default=0, ge=0)
peak_page_transport_bytes StrictInt Field(default=0, ge=0)
peak_page_records StrictInt Field(default=0, ge=0)
spill_records_read StrictInt Field(default=0, ge=0)

Release source · Runtime guarantees · Capability guides

from cayu.evals import IncrementalSessionSeal

Bases: BaseModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
session_id str required
parent_session_id str required
status Literal['completed', 'failed'] required
first_event_sequence int required
terminal_event_sequence int required
evidence_sha256 str required
event_count int required
transcript_count int required
evidence_bytes int required

Release source · Runtime guarantees · Capability guides

from cayu.evals import IncrementalWorkflowCaptureError

Bases: IncrementalEvidenceError.

IncrementalWorkflowCaptureError.__init__(code: str, *, progress: IncrementalCaptureProgress, limits: IncrementalEvidenceLimits) -> None

Release source · Runtime guarantees · Capability guides

from cayu.evals import SavedIncrementalWorkflowCapture

Independent capture revision with full-scope verification and summary retention.

Bases: BaseModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
schema_version Literal[1] 1
capture_id str Field(default_factory=lambda: str(uuid4()))
captured_at datetime Field(default_factory=lambda: datetime.now(UTC))
source_attempt WorkflowAttemptAnchor required
limits IncrementalEvidenceLimits required
evidence_digest_scheme Literal['cayu.incremental-workflow-evidence.v1'] 'cayu.incremental-workflow-evidence.v1'
evidence_sha256 str Field(pattern='^[0-9a-f]{64}$')
capture_policy_revision str required
evidence_complete Literal[True] True
retained_evidence Literal['summary_only'] 'summary_only'
sessions tuple[IncrementalSessionSeal, ...] Field(max_length=500)
process_event_counts dict[str, int] required
progress IncrementalCaptureProgress required
reserved_buffer_bytes int required
model_calls Literal[0] 0
SavedIncrementalWorkflowCapture.validate_policy_revision() -> SavedIncrementalWorkflowCapture

Release source · Runtime guarantees · Capability guides

from cayu.evals import SavedIncrementalWorkflowScore

Scoring revision linked to a separately preserved capture revision.

Bases: BaseModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
schema_version Literal[1] 1
score_id str Field(default_factory=lambda: str(uuid4()))
scored_at datetime Field(default_factory=lambda: datetime.now(UTC))
source_capture_id str required
revalidation SavedIncrementalWorkflowCapture required
source_evidence_sha256 str required
target_revision str required
evidence_policy_revision str required
scoring_semantics Literal['cayu.incremental-assertions.v1'] 'cayu.incremental-assertions.v1'
assertion_revisions tuple[str, ...] required
assertions tuple[EvalAssertionResult, ...] required
score float | None required
model_calls Literal[0] 0

Release source · Runtime guarantees · Capability guides

from cayu.evals import score_incremental_workflow_eval_capture

Freshly validate a capture seal, then apply closed incremental assertions.

Unsupported full-trace, probe and model-backed assertions fail before source reads. The output projection retains its existing redaction and finite bound. Process-event counts examine the entire scope with constant-size counters; their semantics are versioned separately from eager display-event retention.

async score_incremental_workflow_eval_capture(target: WorkflowEvalTarget, source_trial: EvalTrialResult, capture: SavedIncrementalWorkflowCapture, assertions: tuple[AssertionSpec, ...], *, messages: tuple[Message, ...], output: WorkflowEvalResult | None=None, admission: IncrementalEvidenceAdmission) -> SavedIncrementalWorkflowScore

Release source · Runtime guarantees · Capability guides