Skip to content

cayu.evals.memory_reporting

Public Cayu API. Definitions are grouped by their public source module, and definitions from private implementation modules appear on their package’s page; adding a symbol does not move existing links. The import shown at each entry is a supported public namespace. Read the Python API overview and install the required extra.

from cayu.evals import build_memory_experiment_report

Build one complete deterministic report without launching work.

build_memory_experiment_report(request: MemoryExperimentReportRequest) -> MemoryExperimentReport

Release source · Runtime guarantees · Capability guides

from cayu.evals import memory_experiment_accounting_source_id

Return the exact #300 source identity for one repeated case row.

memory_experiment_accounting_source_id(case_revision: str, repetition: int) -> str

Release source · Runtime guarantees · Capability guides

from cayu.evals import memory_experiment_accounting_task_id

Return the shared #300 task identity for one experiment cohort.

memory_experiment_accounting_task_id(experiment_id: str) -> str

Release source · Runtime guarantees · Capability guides

from cayu.evals import memory_experiment_report_from_json
memory_experiment_report_from_json(source: str | bytes) -> MemoryExperimentReport

Release source · Runtime guarantees · Capability guides

from cayu.evals import MEMORY_EXPERIMENT_REPORT_MAX_BYTES
MEMORY_EXPERIMENT_REPORT_MAX_BYTES = 64 << 20

Release source · Runtime guarantees · Capability guides

from cayu.evals import MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION
MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION = 1

Release source · Runtime guarantees · Capability guides

from cayu.evals import memory_experiment_report_to_json
memory_experiment_report_to_json(report: MemoryExperimentReport) -> str

Release source · Runtime guarantees · Capability guides

from cayu.evals import memory_experiment_request_from_json
memory_experiment_request_from_json(source: str | bytes) -> MemoryExperimentReportRequest

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryCaseComparison

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
schema_version Literal[1] 1
revision StrictStr Field(min_length=71, max_length=71)
case_id StrictStr required
case_revision StrictStr required
candidate_variant_id StrictStr required
pairs tuple[MemoryTrialPairComparison, ...] required
metric_roles tuple[MemoryMetricRole, ...] required
distributions tuple[MemoryMetricDistribution, ...] required
operational_distributions tuple[MemoryOperationalDistribution, ...] required
MemoryCaseComparison.validate_revision() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentCase

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
case_id StrictStr Field(max_length=128)
case_revision StrictStr Field(min_length=71, max_length=71)
MemoryExperimentCase.validate_case_id(value: str, info) -> str
MemoryExperimentCase.validate_case_revision(value: str, info) -> str

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentGatePolicy

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
required_metric_roles tuple[MemoryMetricRole, ...] ()
metric_gates tuple[MemoryMetricGate, ...] ()
minimum_comparable_pairs StrictInt Field(default=1, ge=1)
require_priced_cost StrictBool False
maximum_candidate_cost Decimal | None Field(default=None, ge=Decimal(0))
cost_currency StrictStr | None Field(default=None, min_length=3, max_length=16)
MemoryExperimentGatePolicy.order_required_roles(value: object) -> object
MemoryExperimentGatePolicy.order_metric_gates(value: object) -> object
MemoryExperimentGatePolicy.validate_cost_gate() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentReport

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
record_type Literal['cayu.memory-experiment-report'] 'cayu.memory-experiment-report'
schema_version Literal[1] MEMORY_EXPERIMENT_REPORT_SCHEMA_VERSION
revision StrictStr Field(min_length=71, max_length=71)
experiment_id StrictStr required
baseline_variant_id StrictStr required
repetitions StrictInt Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS)
cases tuple[MemoryExperimentCase, ...] required
variants tuple[MemoryExperimentVariant, ...] required
metric_bindings tuple[MemoryMetricBinding, ...] required
ranking tuple[MemoryRankingTerm, ...] required
gates MemoryExperimentGatePolicy required
rows tuple[MemoryTrialReportRow, ...] required
comparisons tuple[MemoryCaseComparison, ...] required
operational_summary tuple[MemoryVariantOperationalReport, ...] required
cost_quality tuple[MemoryVariantCostQualityReport, ...] required
selected_variant_id StrictStr required
dispositions tuple[MemoryVariantDisposition, ...] required
MemoryExperimentReport.validate_report() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentReportRequest

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
schema_version Literal[1] 1
experiment_id StrictStr Field(max_length=128)
cases tuple[MemoryExperimentCase, ...] Field(min_length=1, max_length=MEMORY_EXPERIMENT_REPORT_MAX_CASES)
repetitions StrictInt Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS)
baseline_variant_id StrictStr Field(max_length=128)
variants tuple[MemoryExperimentVariant, ...] Field(min_length=2, max_length=MEMORY_EXPERIMENT_REPORT_MAX_VARIANTS)
metric_bindings tuple[MemoryMetricBinding, ...] Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_METRICS)
ranking tuple[MemoryRankingTerm, ...] Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_METRICS)
gates MemoryExperimentGatePolicy Field(default_factory=MemoryExperimentGatePolicy)
published_results tuple[MemoryPublishedResultEvidence, ...] Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_ROWS)
trials tuple[MemoryExperimentTrialEvidence, ...] Field(default=(), max_length=MEMORY_EXPERIMENT_REPORT_MAX_ROWS)
MemoryExperimentReportRequest.validate_ids(value: str, info) -> str
MemoryExperimentReportRequest.validate_request() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentTrialEvidence

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
case_id StrictStr Field(max_length=128)
case_revision StrictStr Field(min_length=71, max_length=71)
repetition StrictInt Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS)
variant_id StrictStr Field(max_length=128)
execution MemoryInterventionExecutionRecord required
intervention_binding MemoryInterventionTrialBinding | None None
intervention_binding_omitted StrictBool False
published_result_revision StrictStr | None Field(default=None, max_length=71)
accounting_side PairedCostQualitySide | None None
memory_overhead MemoryPreparationOverheadEvidence | None None
MemoryExperimentTrialEvidence.validate_ids(value: str, info) -> str
MemoryExperimentTrialEvidence.validate_case_revision(value: str, info) -> str
MemoryExperimentTrialEvidence.copy_execution(value: object) -> object
MemoryExperimentTrialEvidence.copy_intervention_binding(value: object) -> object

validate_published_result_revision (method)

Section titled “validate_published_result_revision (method)”
MemoryExperimentTrialEvidence.validate_published_result_revision(value: str | None, info) -> str | None
MemoryExperimentTrialEvidence.copy_accounting_side(value: object) -> object
MemoryExperimentTrialEvidence.copy_memory_overhead(value: object) -> object
MemoryExperimentTrialEvidence.validate_binding_omission() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryExperimentVariant

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
variant_id StrictStr Field(max_length=128)
candidate_id StrictStr Field(max_length=256)
spec MemoryInterventionSpec required
execution_profile EvalExecutionProfileV1 required
execution_profile_binding EvalExecutionProfileBindingV1 required
evaluator_fingerprint StrictStr Field(min_length=64, max_length=64)
MemoryExperimentVariant.validate_ids(value: str, info) -> str
MemoryExperimentVariant.validate_evaluator_fingerprint(value: str, info) -> str
MemoryExperimentVariant.copy_spec(value: object) -> object
MemoryExperimentVariant.copy_profile(value: object) -> object
MemoryExperimentVariant.copy_binding(value: object) -> object
MemoryExperimentVariant.validate_profile() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricAvailability

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
AVAILABLE class attribute 'available'
UNAVAILABLE class attribute 'unavailable'
ERROR class attribute 'error'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricBinding

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
assertion_id StrictStr Field(max_length=128)
assertion_revision StrictStr Field(min_length=71, max_length=71)
direction MemoryMetricDirection MemoryMetricDirection.HIGHER_IS_BETTER
MemoryMetricBinding.validate_id(value: str, info) -> str
MemoryMetricBinding.validate_assertion_revision(value: str, info) -> str

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricDelta

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
baseline StrictFloat required
candidate StrictFloat required
delta StrictFloat required

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricDirection

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
HIGHER_IS_BETTER class attribute 'higher_is_better'
LOWER_IS_BETTER class attribute 'lower_is_better'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricDistribution

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
pair_count StrictInt Field(ge=0)
available_count StrictInt Field(ge=0)
unavailable_count StrictInt Field(ge=0)
incomparable_count StrictInt Field(ge=0)
baseline_values tuple[StrictFloat, ...] ()
candidate_values tuple[StrictFloat, ...] ()
deltas tuple[StrictFloat, ...] ()
mean_delta StrictFloat | None None
median_delta StrictFloat | None None
MemoryMetricDistribution.validate_distribution() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricGate

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
minimum StrictFloat | None Field(default=None, ge=0.0, le=1.0)
maximum StrictFloat | None Field(default=None, ge=0.0, le=1.0)
MemoryMetricGate.validate_threshold() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricObservation

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
assertion_id StrictStr required
assertion_revision StrictStr required
availability MemoryMetricAvailability required
outcome PublishedOutcome | None None
value StrictFloat | None Field(default=None, ge=0.0, le=1.0)
evaluator_key StrictStr | None Field(default=None, max_length=128)
evaluator_implementation_revision StrictStr | None Field(default=None, min_length=71, max_length=71)
MemoryMetricObservation.validate_assertion_id(value: str, info) -> str
MemoryMetricObservation.validate_assertion_revision(value: str, info) -> str
MemoryMetricObservation.validate_evaluator_key(value: str | None, info) -> str | None
MemoryMetricObservation.validate_evaluator_revision(value: str | None, info) -> str | None
MemoryMetricObservation.validate_availability() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryMetricRole

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
TASK_QUALITY class attribute 'task_quality'
FACTUAL_SUPPORT class attribute 'factual_support'
HALLUCINATION_AVOIDANCE class attribute 'hallucination_avoidance'
SAFETY class attribute 'safety'
PRIVACY class attribute 'privacy'
STALE_EXPOSURE_AVOIDANCE class attribute 'stale_exposure_avoidance'
FALSE_EXPOSURE_AVOIDANCE class attribute 'false_exposure_avoidance'
UNAUTHORIZED_EXPOSURE_AVOIDANCE class attribute 'unauthorized_exposure_avoidance'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryOperationalDelta

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
dimension MemoryOperationalDimension required
baseline AggregateCount Field(ge=0)
candidate AggregateCount Field(ge=0)
delta SignedAggregateCount required
MemoryOperationalDelta.validate_delta() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryOperationalDimension

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
LATENCY_MS class attribute 'latency_ms'
TOTAL_TOKENS class attribute 'total_tokens'
MEMORY_PREPARATION_DURATION_MS class attribute 'memory_preparation_duration_ms'
MEMORY_CONTEXT_TOKENS class attribute 'memory_context_tokens'
MEMORY_CONTEXT_BYTES class attribute 'memory_context_bytes'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryOperationalDistribution

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
dimension MemoryOperationalDimension required
pair_count StrictInt Field(ge=0)
available_count StrictInt Field(ge=0)
unavailable_count StrictInt Field(ge=0)
incomparable_count StrictInt Field(ge=0)
baseline_values tuple[AggregateCount, ...] ()
candidate_values tuple[AggregateCount, ...] ()
deltas tuple[SignedAggregateCount, ...] ()
mean_delta StrictFloat | None None
median_delta StrictFloat | None None
MemoryOperationalDistribution.validate_distribution() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryPairStatus

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
COMPARABLE class attribute 'comparable'
INCOMPARABLE class attribute 'incomparable'
UNAVAILABLE class attribute 'unavailable'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryPreparationOverheadEvidence

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
evidence_revision StrictStr Field(min_length=71, max_length=71)
preparation_duration_ms StrictInt | None Field(default=None, ge=0)
context_tokens StrictInt | None Field(default=None, ge=0)
context_bytes StrictInt | None Field(default=None, ge=0)
MemoryPreparationOverheadEvidence.validate_revision(value: str, info) -> str
MemoryPreparationOverheadEvidence.validate_content_revision() -> Self
MemoryPreparationOverheadEvidence.create(*, preparation_duration_ms: int | None=None, context_tokens: int | None=None, context_bytes: int | None=None) -> MemoryPreparationOverheadEvidence

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryPublishedResultEvidence

One complete content-addressed EvalStore result available to report rows.

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
run_id StrictStr Field(max_length=512)
result SkipValidation[CorpusExecutionResult] required
MemoryPublishedResultEvidence.validate_run_id(value: str, info) -> str
MemoryPublishedResultEvidence.copy_result(value: object) -> object

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryRankingTerm

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
role MemoryMetricRole required
direction MemoryMetricDirection required

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryTrialAvailability

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
AVAILABLE class attribute 'available'
UNAVAILABLE class attribute 'unavailable'
MISSING class attribute 'missing'
UNMATCHED class attribute 'unmatched'
FAILED class attribute 'failed'
CANCELLED class attribute 'cancelled'
TIMED_OUT class attribute 'timed_out'
OUTCOME_UNKNOWN class attribute 'outcome_unknown'
CONFLICTING class attribute 'conflicting'
INDETERMINATE class attribute 'indeterminate'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryTrialPairComparison

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
pair_id StrictStr Field(min_length=71, max_length=71)
case_id StrictStr required
case_revision StrictStr required
repetition StrictInt required
baseline_variant_id StrictStr required
candidate_variant_id StrictStr required
baseline_row_id StrictStr required
candidate_row_id StrictStr required
status MemoryPairStatus required
reasons tuple[StrictStr, ...] ()
memory_comparability_fingerprint StrictStr | None None
metric_deltas tuple[MemoryMetricDelta, ...] ()
operational_deltas tuple[MemoryOperationalDelta, ...] ()
accounting_pair PairedCostQualityPairReport | None None
MemoryTrialPairComparison.validate_pair() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryTrialReportRow

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
row_id StrictStr Field(min_length=71, max_length=71)
case_id StrictStr required
case_revision StrictStr required
repetition StrictInt Field(ge=1, le=MEMORY_EXPERIMENT_REPORT_MAX_REPETITIONS)
variant_id StrictStr required
intervention_spec_fingerprint StrictStr required
snapshot_fingerprint StrictStr required
execution_profile_revision StrictStr required
runtime_execution_profile_fingerprint StrictStr required
provider_name StrictStr required
model StrictStr required
evaluator_fingerprint StrictStr required
execution_id StrictStr | None None
trial_id StrictStr | None None
execution_revision StrictInt | None Field(default=None, ge=0)
final_binding_fingerprint StrictStr | None None
execution_binding_lineage_revision StrictStr | None None
intervention_binding MemoryInterventionTrialBinding | None None
intervention_binding_omitted StrictBool False
published_result_revision StrictStr | None None
published_run_id StrictStr | None None
source_trial_revision StrictStr | None None
corpus_revision StrictStr | None None
suite_id StrictStr | None None
suite_revision StrictStr | None None
evidence_policy_revision StrictStr | None None
pricing_profile_fingerprint StrictStr | None None
intervention_attribution_fingerprint StrictStr | None None
attribution_evidence_revision StrictStr | None None
attribution_status EvalMemoryEvidenceCompleteness | None None
availability MemoryTrialAvailability required
execution_status MemoryInterventionExecutionStatus | None None
published_status PublishedOutcome | None None
metrics tuple[MemoryMetricObservation, ...] ()
duration_ms StrictInt | None Field(default=None, ge=0)
total_tokens AggregateCount | None Field(default=None, ge=0)
accounting_side PairedCostQualitySide | None None
memory_overhead MemoryPreparationOverheadEvidence | None None
MemoryTrialReportRow.validate_revisions(value: str | None, info) -> str | None
MemoryTrialReportRow.validate_fingerprints(value: str | None, info) -> str | None
MemoryTrialReportRow.validate_source_trial_revision(value: str | None, info) -> str | None
MemoryTrialReportRow.copy_intervention_binding(value: object) -> object
MemoryTrialReportRow.validate_suite_id(value: str | None, info) -> str | None
MemoryTrialReportRow.validate_evidence_shape() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryVariantCostQualityReport

Canonical #300 evidence scoped to one candidate versus the baseline.

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
candidate_variant_id StrictStr Field(max_length=128)
report PairedCostQualityComparisonReport | None None
MemoryVariantCostQualityReport.validate_candidate_variant_id(value: str, info) -> str
MemoryVariantCostQualityReport.copy_report(value: object) -> object

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryVariantDisposition

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
variant_id StrictStr required
status MemoryVariantDispositionStatus required
reasons tuple[StrictStr, ...] required
comparable_pair_count StrictInt Field(ge=0)
unavailable_pair_count StrictInt Field(ge=0)
incomparable_pair_count StrictInt Field(ge=0)
ranking_values tuple[StrictFloat | None, ...] ()

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryVariantDispositionStatus

Bases: StrEnum.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
SELECTED class attribute 'selected'
BASELINE_SUPERSEDED class attribute 'baseline_superseded'
ELIGIBLE_NOT_SELECTED class attribute 'eligible_not_selected'
REJECTED class attribute 'rejected'
INCOMPARABLE class attribute 'incomparable'
UNAVAILABLE class attribute 'unavailable'
NOT_BETTER class attribute 'not_better_than_baseline'

Release source · Runtime guarantees · Capability guides

from cayu.evals import MemoryVariantOperationalReport

Bases: _ReportModel.

Defaults below are source expressions; Field(...) includes schema/validation settings and default_factory creates a fresh value. Inherited declarations are included. Constructor behavior follows the model or dataclass shown in the bases/decorators.

Name Type Default
candidate_variant_id StrictStr Field(max_length=128)
distributions tuple[MemoryOperationalDistribution, ...] required
MemoryVariantOperationalReport.validate_candidate_variant_id(value: str, info) -> str
MemoryVariantOperationalReport.validate_distributions() -> Self

Release source · Runtime guarantees · Capability guides

from cayu.evals import render_memory_experiment_report_html
render_memory_experiment_report_html(report: MemoryExperimentReport) -> str

Release source · Runtime guarantees · Capability guides