cayu.evals.memory_reporting
Public Cayu API. Definitions are grouped by their public source module, and definitions from private implementation modules appear on their package’s page; adding a symbol does not move existing links. The import shown at each entry is a supported public namespace. Read the Python API overview and install the required extra.
build_memory_experiment_report
Section titled “build_memory_experiment_report”from cayu.evals import build_memory_experiment_reportBuild one complete deterministic report without launching work.
build_memory_experiment_report(request: MemoryExperimentReportRequest) -> MemoryExperimentReportRelease source · Runtime guarantees · Capability guides
memory_experiment_accounting_source_id
Section titled “memory_experiment_accounting_source_id”from cayu.evals import memory_experiment_accounting_source_idReturn the exact #300 source identity for one repeated case row.
memory_experiment_accounting_source_id(case_revision: str, repetition: int) -> strRelease source · Runtime guarantees · Capability guides
memory_experiment_accounting_task_id
Section titled “memory_experiment_accounting_task_id”from cayu.evals import memory_experiment_accounting_task_idReturn the shared #300 task identity for one experiment cohort.
memory_experiment_accounting_task_id(experiment_id: str) -> strRelease source · Runtime guarantees · Capability guides
memory_experiment_report_from_json
Section titled “memory_experiment_report_from_json”from cayu.evals import memory_experiment_report_from_jsonmemory_experiment_report_from_json(source: str | bytes) -> MemoryExperimentReportRelease source · Runtime guarantees · Capability guides
MEMORY_EXPERIMENT_REPORT_MAX_BYTES
Section titled “MEMORY_EXPERIMENT_REPORT_MAX_BYTES”from cayu.evals import MEMORY_EXPERIMENT_REPORT_MAX_BYTESMEMORY_EXPERIMENT_REPORT_MAX_BYTES = 64 << 20Release source · Runtime guarantees · Capability guides
MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION
Section titled “MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION”from cayu.evals import MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSIONMEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION = 1Release source · Runtime guarantees · Capability guides
memory_experiment_report_to_json
Section titled “memory_experiment_report_to_json”from cayu.evals import memory_experiment_report_to_jsonmemory_experiment_report_to_json(report: MemoryExperimentReport) -> strRelease source · Runtime guarantees · Capability guides
memory_experiment_request_from_json
Section titled “memory_experiment_request_from_json”from cayu.evals import memory_experiment_request_from_jsonmemory_experiment_request_from_json(source: str | bytes) -> MemoryExperimentReportRequestRelease source · Runtime guarantees · Capability guides
MemoryCaseComparison
Section titled “MemoryCaseComparison”from cayu.evals import MemoryCaseComparisonBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
schema_version |
Literal[1] |
1 |
revision |
StrictStr |
Field(min_length=71, max_length=71) |
case_id |
StrictStr |
required |
case_revision |
StrictStr |
required |
candidate_variant_id |
StrictStr |
required |
pairs |
tuple[MemoryTrialPairComparison, ...] |
required |
metric_roles |
tuple[MemoryMetricRole, ...] |
required |
distributions |
tuple[MemoryMetricDistribution, ...] |
required |
operational_distributions |
tuple[MemoryOperationalDistribution, ...] |
required |
validate_revision (method)
Section titled “validate_revision (method)”MemoryCaseComparison.validate_revision() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryExperimentCase
Section titled “MemoryExperimentCase”from cayu.evals import MemoryExperimentCaseBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
case_id |
StrictStr |
Field(max_length=128) |
case_revision |
StrictStr |
Field(min_length=71, max_length=71) |
validate_case_id (method)
Section titled “validate_case_id (method)”MemoryExperimentCase.validate_case_id(value: str, info) -> strvalidate_case_revision (method)
Section titled “validate_case_revision (method)”MemoryExperimentCase.validate_case_revision(value: str, info) -> strRelease source · Runtime guarantees · Capability guides
MemoryExperimentGatePolicy
Section titled “MemoryExperimentGatePolicy”from cayu.evals import MemoryExperimentGatePolicyBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
required_metric_roles |
tuple[MemoryMetricRole, ...] |
() |
metric_gates |
tuple[MemoryMetricGate, ...] |
() |
minimum_comparable_pairs |
StrictInt |
Field(default=1, ge=1) |
require_priced_cost |
StrictBool |
False |
maximum_candidate_cost |
Decimal | None |
Field(default=None, ge=Decimal(0)) |
cost_currency |
StrictStr | None |
Field(default=None, min_length=3, max_length=16) |
order_required_roles (method)
Section titled “order_required_roles (method)”MemoryExperimentGatePolicy.order_required_roles(value: object) -> objectorder_metric_gates (method)
Section titled “order_metric_gates (method)”MemoryExperimentGatePolicy.order_metric_gates(value: object) -> objectvalidate_cost_gate (method)
Section titled “validate_cost_gate (method)”MemoryExperimentGatePolicy.validate_cost_gate() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryExperimentReport
Section titled “MemoryExperimentReport”from cayu.evals import MemoryExperimentReportBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
record_type |
Literal['cayu.memory-experiment-report'] |
'cayu.memory-experiment-report' |
schema_version |
Literal[1] |
MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION |
revision |
StrictStr |
Field(min_length=71, max_length=71) |
experiment_id |
StrictStr |
required |
baseline_variant_id |
StrictStr |
required |
repetitions |
StrictInt |
Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS) |
cases |
tuple[MemoryExperimentCase, ...] |
required |
variants |
tuple[MemoryExperimentVariant, ...] |
required |
metric_bindings |
tuple[MemoryMetricBinding, ...] |
required |
ranking |
tuple[MemoryRankingTerm, ...] |
required |
gates |
MemoryExperimentGatePolicy |
required |
rows |
tuple[MemoryTrialReportRow, ...] |
required |
comparisons |
tuple[MemoryCaseComparison, ...] |
required |
operational_summary |
tuple[MemoryVariantOperationalReport, ...] |
required |
cost_quality |
tuple[MemoryVariantCostQualityReport, ...] |
required |
selected_variant_id |
StrictStr |
required |
dispositions |
tuple[MemoryVariantDisposition, ...] |
required |
validate_report (method)
Section titled “validate_report (method)”MemoryExperimentReport.validate_report() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryExperimentReportRequest
Section titled “MemoryExperimentReportRequest”from cayu.evals import MemoryExperimentReportRequestBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
schema_version |
Literal[1] |
1 |
experiment_id |
StrictStr |
Field(max_length=128) |
cases |
tuple[MemoryExperimentCase, ...] |
Field(min_length=1, max_length=MEMORY_EXPERIMENT_REPORT_MAX_CASES) |
repetitions |
StrictInt |
Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS) |
baseline_variant_id |
StrictStr |
Field(max_length=128) |
variants |
tuple[MemoryExperimentVariant, ...] |
Field(min_length=2, max_length=MEMORY_EXPERIMENT_REPORT_MAX_VARIANTS) |
metric_bindings |
tuple[MemoryMetricBinding, ...] |
Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_METRICS) |
ranking |
tuple[MemoryRankingTerm, ...] |
Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_METRICS) |
gates |
MemoryExperimentGatePolicy |
Field(default_factory=MemoryExperimentGatePolicy) |
published_results |
tuple[MemoryPublishedResultEvidence, ...] |
Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_ROWS) |
trials |
tuple[MemoryExperimentTrialEvidence, ...] |
Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_ROWS) |
validate_ids (method)
Section titled “validate_ids (method)”MemoryExperimentReportRequest.validate_ids(value: str, info) -> strvalidate_request (method)
Section titled “validate_request (method)”MemoryExperimentReportRequest.validate_request() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryExperimentTrialEvidence
Section titled “MemoryExperimentTrialEvidence”from cayu.evals import MemoryExperimentTrialEvidenceBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
case_id |
StrictStr |
Field(max_length=128) |
case_revision |
StrictStr |
Field(min_length=71, max_length=71) |
repetition |
StrictInt |
Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS) |
variant_id |
StrictStr |
Field(max_length=128) |
execution |
MemoryInterventionExecutionRecord |
required |
intervention_binding |
MemoryInterventionTrialBinding | None |
None |
intervention_binding_omitted |
StrictBool |
False |
published_result_revision |
StrictStr | None |
Field(default=None, max_length=71) |
accounting_side |
PairedCostQualitySide | None |
None |
memory_overhead |
MemoryPreparationOverheadEvidence | None |
None |
validate_ids (method)
Section titled “validate_ids (method)”MemoryExperimentTrialEvidence.validate_ids(value: str, info) -> strvalidate_case_revision (method)
Section titled “validate_case_revision (method)”MemoryExperimentTrialEvidence.validate_case_revision(value: str, info) -> strcopy_execution (method)
Section titled “copy_execution (method)”MemoryExperimentTrialEvidence.copy_execution(value: object) -> objectcopy_intervention_binding (method)
Section titled “copy_intervention_binding (method)”MemoryExperimentTrialEvidence.copy_intervention_binding(value: object) -> objectvalidate_published_result_revision (method)
Section titled “validate_published_result_revision (method)”MemoryExperimentTrialEvidence.validate_published_result_revision(value: str | None, info) -> str | Nonecopy_accounting_side (method)
Section titled “copy_accounting_side (method)”MemoryExperimentTrialEvidence.copy_accounting_side(value: object) -> objectcopy_memory_overhead (method)
Section titled “copy_memory_overhead (method)”MemoryExperimentTrialEvidence.copy_memory_overhead(value: object) -> objectvalidate_binding_omission (method)
Section titled “validate_binding_omission (method)”MemoryExperimentTrialEvidence.validate_binding_omission() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryExperimentVariant
Section titled “MemoryExperimentVariant”from cayu.evals import MemoryExperimentVariantBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
variant_id |
StrictStr |
Field(max_length=128) |
candidate_id |
StrictStr |
Field(max_length=256) |
spec |
MemoryInterventionSpec |
required |
execution_profile |
EvalExecutionProfileV1 |
required |
execution_profile_binding |
EvalExecutionProfileBindingV1 |
required |
evaluator_fingerprint |
StrictStr |
Field(min_length=64, max_length=64) |
validate_ids (method)
Section titled “validate_ids (method)”MemoryExperimentVariant.validate_ids(value: str, info) -> strvalidate_evaluator_fingerprint (method)
Section titled “validate_evaluator_fingerprint (method)”MemoryExperimentVariant.validate_evaluator_fingerprint(value: str, info) -> strcopy_spec (method)
Section titled “copy_spec (method)”MemoryExperimentVariant.copy_spec(value: object) -> objectcopy_profile (method)
Section titled “copy_profile (method)”MemoryExperimentVariant.copy_profile(value: object) -> objectcopy_binding (method)
Section titled “copy_binding (method)”MemoryExperimentVariant.copy_binding(value: object) -> objectvalidate_profile (method)
Section titled “validate_profile (method)”MemoryExperimentVariant.validate_profile() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryMetricAvailability
Section titled “MemoryMetricAvailability”from cayu.evals import MemoryMetricAvailabilityBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
AVAILABLE |
class attribute |
'available' |
UNAVAILABLE |
class attribute |
'unavailable' |
ERROR |
class attribute |
'error' |
Release source · Runtime guarantees · Capability guides
MemoryMetricBinding
Section titled “MemoryMetricBinding”from cayu.evals import MemoryMetricBindingBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
assertion_id |
StrictStr |
Field(max_length=128) |
assertion_revision |
StrictStr |
Field(min_length=71, max_length=71) |
direction |
MemoryMetricDirection |
MemoryMetricDirection.HIGHER_IS_BETTER |
validate_id (method)
Section titled “validate_id (method)”MemoryMetricBinding.validate_id(value: str, info) -> strvalidate_assertion_revision (method)
Section titled “validate_assertion_revision (method)”MemoryMetricBinding.validate_assertion_revision(value: str, info) -> strRelease source · Runtime guarantees · Capability guides
MemoryMetricDelta
Section titled “MemoryMetricDelta”from cayu.evals import MemoryMetricDeltaBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
baseline |
StrictFloat |
required |
candidate |
StrictFloat |
required |
delta |
StrictFloat |
required |
Release source · Runtime guarantees · Capability guides
MemoryMetricDirection
Section titled “MemoryMetricDirection”from cayu.evals import MemoryMetricDirectionBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
HIGHER_IS_BETTER |
class attribute |
'higher_is_better' |
LOWER_IS_BETTER |
class attribute |
'lower_is_better' |
Release source · Runtime guarantees · Capability guides
MemoryMetricDistribution
Section titled “MemoryMetricDistribution”from cayu.evals import MemoryMetricDistributionBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
pair_count |
StrictInt |
Field(ge=0) |
available_count |
StrictInt |
Field(ge=0) |
unavailable_count |
StrictInt |
Field(ge=0) |
incomparable_count |
StrictInt |
Field(ge=0) |
baseline_values |
tuple[StrictFloat, ...] |
() |
candidate_values |
tuple[StrictFloat, ...] |
() |
deltas |
tuple[StrictFloat, ...] |
() |
mean_delta |
StrictFloat | None |
None |
median_delta |
StrictFloat | None |
None |
validate_distribution (method)
Section titled “validate_distribution (method)”MemoryMetricDistribution.validate_distribution() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryMetricGate
Section titled “MemoryMetricGate”from cayu.evals import MemoryMetricGateBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
minimum |
StrictFloat | None |
Field(default=None, ge=0.0, le=1.0) |
maximum |
StrictFloat | None |
Field(default=None, ge=0.0, le=1.0) |
validate_threshold (method)
Section titled “validate_threshold (method)”MemoryMetricGate.validate_threshold() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryMetricObservation
Section titled “MemoryMetricObservation”from cayu.evals import MemoryMetricObservationBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
assertion_id |
StrictStr |
required |
assertion_revision |
StrictStr |
required |
availability |
MemoryMetricAvailability |
required |
outcome |
PublishedOutcome | None |
None |
value |
StrictFloat | None |
Field(default=None, ge=0.0, le=1.0) |
evaluator_key |
StrictStr | None |
Field(default=None, max_length=128) |
evaluator_implementation_revision |
StrictStr | None |
Field(default=None, min_length=71, max_length=71) |
validate_assertion_id (method)
Section titled “validate_assertion_id (method)”MemoryMetricObservation.validate_assertion_id(value: str, info) -> strvalidate_assertion_revision (method)
Section titled “validate_assertion_revision (method)”MemoryMetricObservation.validate_assertion_revision(value: str, info) -> strvalidate_evaluator_key (method)
Section titled “validate_evaluator_key (method)”MemoryMetricObservation.validate_evaluator_key(value: str | None, info) -> str | Nonevalidate_evaluator_revision (method)
Section titled “validate_evaluator_revision (method)”MemoryMetricObservation.validate_evaluator_revision(value: str | None, info) -> str | Nonevalidate_availability (method)
Section titled “validate_availability (method)”MemoryMetricObservation.validate_availability() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryMetricRole
Section titled “MemoryMetricRole”from cayu.evals import MemoryMetricRoleBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
TASK_QUALITY |
class attribute |
'task_quality' |
FACTUAL_SUPPORT |
class attribute |
'factual_support' |
HALLUCINATION_AVOIDANCE |
class attribute |
'hallucination_avoidance' |
SAFETY |
class attribute |
'safety' |
PRIVACY |
class attribute |
'privacy' |
STALE_EXPOSURE_AVOIDANCE |
class attribute |
'stale_exposure_avoidance' |
FALSE_EXPOSURE_AVOIDANCE |
class attribute |
'false_exposure_avoidance' |
UNAUTHORIZED_EXPOSURE_AVOIDANCE |
class attribute |
'unauthorized_exposure_avoidance' |
Release source · Runtime guarantees · Capability guides
MemoryOperationalDelta
Section titled “MemoryOperationalDelta”from cayu.evals import MemoryOperationalDeltaBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
dimension |
MemoryOperationalDimension |
required |
baseline |
AggregateCount |
Field(ge=0) |
candidate |
AggregateCount |
Field(ge=0) |
delta |
SignedAggregateCount |
required |
validate_delta (method)
Section titled “validate_delta (method)”MemoryOperationalDelta.validate_delta() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryOperationalDimension
Section titled “MemoryOperationalDimension”from cayu.evals import MemoryOperationalDimensionBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
LATENCY_MS |
class attribute |
'latency_ms' |
TOTAL_TOKENS |
class attribute |
'total_tokens' |
MEMORY_PREPARATION_DURATION_MS |
class attribute |
'memory_preparation_duration_ms' |
MEMORY_CONTEXT_TOKENS |
class attribute |
'memory_context_tokens' |
MEMORY_CONTEXT_BYTES |
class attribute |
'memory_context_bytes' |
Release source · Runtime guarantees · Capability guides
MemoryOperationalDistribution
Section titled “MemoryOperationalDistribution”from cayu.evals import MemoryOperationalDistributionBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
dimension |
MemoryOperationalDimension |
required |
pair_count |
StrictInt |
Field(ge=0) |
available_count |
StrictInt |
Field(ge=0) |
unavailable_count |
StrictInt |
Field(ge=0) |
incomparable_count |
StrictInt |
Field(ge=0) |
baseline_values |
tuple[AggregateCount, ...] |
() |
candidate_values |
tuple[AggregateCount, ...] |
() |
deltas |
tuple[SignedAggregateCount, ...] |
() |
mean_delta |
StrictFloat | None |
None |
median_delta |
StrictFloat | None |
None |
validate_distribution (method)
Section titled “validate_distribution (method)”MemoryOperationalDistribution.validate_distribution() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryPairStatus
Section titled “MemoryPairStatus”from cayu.evals import MemoryPairStatusBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
COMPARABLE |
class attribute |
'comparable' |
INCOMPARABLE |
class attribute |
'incomparable' |
UNAVAILABLE |
class attribute |
'unavailable' |
Release source · Runtime guarantees · Capability guides
MemoryPreparationOverheadEvidence
Section titled “MemoryPreparationOverheadEvidence”from cayu.evals import MemoryPreparationOverheadEvidenceBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
evidence_revision |
StrictStr |
Field(min_length=71, max_length=71) |
preparation_duration_ms |
StrictInt | None |
Field(default=None, ge=0) |
context_tokens |
StrictInt | None |
Field(default=None, ge=0) |
context_bytes |
StrictInt | None |
Field(default=None, ge=0) |
validate_revision (method)
Section titled “validate_revision (method)”MemoryPreparationOverheadEvidence.validate_revision(value: str, info) -> strvalidate_content_revision (method)
Section titled “validate_content_revision (method)”MemoryPreparationOverheadEvidence.validate_content_revision() -> Selfcreate (method)
Section titled “create (method)”MemoryPreparationOverheadEvidence.create(*, preparation_duration_ms: int | None=None, context_tokens: int | None=None, context_bytes: int | None=None) -> MemoryPreparationOverheadEvidenceRelease source · Runtime guarantees · Capability guides
MemoryPublishedResultEvidence
Section titled “MemoryPublishedResultEvidence”from cayu.evals import MemoryPublishedResultEvidenceOne complete content-addressed EvalStore result available to report rows.
Bases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
run_id |
StrictStr |
Field(max_length=512) |
result |
SkipValidation[CorpusExecutionResult] |
required |
validate_run_id (method)
Section titled “validate_run_id (method)”MemoryPublishedResultEvidence.validate_run_id(value: str, info) -> strcopy_result (method)
Section titled “copy_result (method)”MemoryPublishedResultEvidence.copy_result(value: object) -> objectRelease source · Runtime guarantees · Capability guides
MemoryRankingTerm
Section titled “MemoryRankingTerm”from cayu.evals import MemoryRankingTermBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
role |
MemoryMetricRole |
required |
direction |
MemoryMetricDirection |
required |
Release source · Runtime guarantees · Capability guides
MemoryTrialAvailability
Section titled “MemoryTrialAvailability”from cayu.evals import MemoryTrialAvailabilityBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
AVAILABLE |
class attribute |
'available' |
UNAVAILABLE |
class attribute |
'unavailable' |
MISSING |
class attribute |
'missing' |
UNMATCHED |
class attribute |
'unmatched' |
FAILED |
class attribute |
'failed' |
CANCELLED |
class attribute |
'cancelled' |
TIMED_OUT |
class attribute |
'timed_out' |
OUTCOME_UNKNOWN |
class attribute |
'outcome_unknown' |
CONFLICTING |
class attribute |
'conflicting' |
INDETERMINATE |
class attribute |
'indeterminate' |
Release source · Runtime guarantees · Capability guides
MemoryTrialPairComparison
Section titled “MemoryTrialPairComparison”from cayu.evals import MemoryTrialPairComparisonBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
pair_id |
StrictStr |
Field(min_length=71, max_length=71) |
case_id |
StrictStr |
required |
case_revision |
StrictStr |
required |
repetition |
StrictInt |
required |
baseline_variant_id |
StrictStr |
required |
candidate_variant_id |
StrictStr |
required |
baseline_row_id |
StrictStr |
required |
candidate_row_id |
StrictStr |
required |
status |
MemoryPairStatus |
required |
reasons |
tuple[StrictStr, ...] |
() |
memory_comparability_fingerprint |
StrictStr | None |
None |
metric_deltas |
tuple[MemoryMetricDelta, ...] |
() |
operational_deltas |
tuple[MemoryOperationalDelta, ...] |
() |
accounting_pair |
PairedCostQualityPairReport | None |
None |
validate_pair (method)
Section titled “validate_pair (method)”MemoryTrialPairComparison.validate_pair() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryTrialReportRow
Section titled “MemoryTrialReportRow”from cayu.evals import MemoryTrialReportRowBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
row_id |
StrictStr |
Field(min_length=71, max_length=71) |
case_id |
StrictStr |
required |
case_revision |
StrictStr |
required |
repetition |
StrictInt |
Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS) |
variant_id |
StrictStr |
required |
intervention_spec_fingerprint |
StrictStr |
required |
snapshot_fingerprint |
StrictStr |
required |
execution_profile_revision |
StrictStr |
required |
runtime_execution_profile_fingerprint |
StrictStr |
required |
provider_name |
StrictStr |
required |
model |
StrictStr |
required |
evaluator_fingerprint |
StrictStr |
required |
execution_id |
StrictStr | None |
None |
trial_id |
StrictStr | None |
None |
execution_revision |
StrictInt | None |
Field(default=None, ge=0) |
final_binding_fingerprint |
StrictStr | None |
None |
execution_binding_lineage_revision |
StrictStr | None |
None |
intervention_binding |
MemoryInterventionTrialBinding | None |
None |
intervention_binding_omitted |
StrictBool |
False |
published_result_revision |
StrictStr | None |
None |
published_run_id |
StrictStr | None |
None |
source_trial_revision |
StrictStr | None |
None |
corpus_revision |
StrictStr | None |
None |
suite_id |
StrictStr | None |
None |
suite_revision |
StrictStr | None |
None |
evidence_policy_revision |
StrictStr | None |
None |
pricing_profile_fingerprint |
StrictStr | None |
None |
intervention_attribution_fingerprint |
StrictStr | None |
None |
attribution_evidence_revision |
StrictStr | None |
None |
attribution_status |
EvalMemoryEvidenceCompleteness | None |
None |
availability |
MemoryTrialAvailability |
required |
execution_status |
MemoryInterventionExecutionStatus | None |
None |
published_status |
PublishedOutcome | None |
None |
metrics |
tuple[MemoryMetricObservation, ...] |
() |
duration_ms |
StrictInt | None |
Field(default=None, ge=0) |
total_tokens |
AggregateCount | None |
Field(default=None, ge=0) |
accounting_side |
PairedCostQualitySide | None |
None |
memory_overhead |
MemoryPreparationOverheadEvidence | None |
None |
validate_revisions (method)
Section titled “validate_revisions (method)”MemoryTrialReportRow.validate_revisions(value: str | None, info) -> str | Nonevalidate_fingerprints (method)
Section titled “validate_fingerprints (method)”MemoryTrialReportRow.validate_fingerprints(value: str | None, info) -> str | Nonevalidate_source_trial_revision (method)
Section titled “validate_source_trial_revision (method)”MemoryTrialReportRow.validate_source_trial_revision(value: str | None, info) -> str | Nonecopy_intervention_binding (method)
Section titled “copy_intervention_binding (method)”MemoryTrialReportRow.copy_intervention_binding(value: object) -> objectvalidate_suite_id (method)
Section titled “validate_suite_id (method)”MemoryTrialReportRow.validate_suite_id(value: str | None, info) -> str | Nonevalidate_evidence_shape (method)
Section titled “validate_evidence_shape (method)”MemoryTrialReportRow.validate_evidence_shape() -> SelfRelease source · Runtime guarantees · Capability guides
MemoryVariantCostQualityReport
Section titled “MemoryVariantCostQualityReport”from cayu.evals import MemoryVariantCostQualityReportCanonical #300 evidence scoped to one candidate versus the baseline.
Bases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
candidate_variant_id |
StrictStr |
Field(max_length=128) |
report |
PairedCostQualityComparisonReport | None |
None |
validate_candidate_variant_id (method)
Section titled “validate_candidate_variant_id (method)”MemoryVariantCostQualityReport.validate_candidate_variant_id(value: str, info) -> strcopy_report (method)
Section titled “copy_report (method)”MemoryVariantCostQualityReport.copy_report(value: object) -> objectRelease source · Runtime guarantees · Capability guides
MemoryVariantDisposition
Section titled “MemoryVariantDisposition”from cayu.evals import MemoryVariantDispositionBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
variant_id |
StrictStr |
required |
status |
MemoryVariantDispositionStatus |
required |
reasons |
tuple[StrictStr, ...] |
required |
comparable_pair_count |
StrictInt |
Field(ge=0) |
unavailable_pair_count |
StrictInt |
Field(ge=0) |
incomparable_pair_count |
StrictInt |
Field(ge=0) |
ranking_values |
tuple[StrictFloat | None, ...] |
() |
Release source · Runtime guarantees · Capability guides
MemoryVariantDispositionStatus
Section titled “MemoryVariantDispositionStatus”from cayu.evals import MemoryVariantDispositionStatusBases: StrEnum.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
SELECTED |
class attribute |
'selected' |
BASELINE_SUPERSEDED |
class attribute |
'baseline_superseded' |
ELIGIBLE_NOT_SELECTED |
class attribute |
'eligible_not_selected' |
REJECTED |
class attribute |
'rejected' |
INCOMPARABLE |
class attribute |
'incomparable' |
UNAVAILABLE |
class attribute |
'unavailable' |
NOT_BETTER |
class attribute |
'not_better_than_baseline' |
Release source · Runtime guarantees · Capability guides
MemoryVariantOperationalReport
Section titled “MemoryVariantOperationalReport”from cayu.evals import MemoryVariantOperationalReportBases: _ReportModel.
Fields and attributes
Section titled “Fields and attributes”Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.
| Name | Type | Default |
|---|---|---|
candidate_variant_id |
StrictStr |
Field(max_length=128) |
distributions |
tuple[MemoryOperationalDistribution, ...] |
required |
validate_candidate_variant_id (method)
Section titled “validate_candidate_variant_id (method)”MemoryVariantOperationalReport.validate_candidate_variant_id(value: str, info) -> strvalidate_distributions (method)
Section titled “validate_distributions (method)”MemoryVariantOperationalReport.validate_distributions() -> SelfRelease source · Runtime guarantees · Capability guides
render_memory_experiment_report_html
Section titled “render_memory_experiment_report_html”from cayu.evals import render_memory_experiment_report_htmlrender_memory_experiment_report_html(report: MemoryExperimentReport) -> str