Team Ai
Datasetpublic

ClarusC64/state-continuity-temporal-coherence-worldmodel-v01

Dataset ClarusC64/state-continuity-temporal-coherence-worldmodel-v01 This dataset tests one capability. Can a model preserve a coherent world state across time. Core rule The world has memory. Once something changeslater descriptions must reflect that change. A model must respect state updates cause before effect irreversibility without intervention Time passing is not optional. Canonical labels WITHIN_SCOPE OUT_OF_SCOPE Files… See the full description on the dataset page: https://huggingface.co/datasets/ClarusC64/state-continuity-temporal-coherence-worldmodel-v01.

sourceHugging Faceotherupdated 9mo agoView on Hugging Face
0likes29downloads
Dataset Card

Dataset

ClarusC64/state-continuity-temporal-coherence-worldmodel-v01

This dataset tests one capability.

Can a model preserve a coherent world state across time.

Core rule

The world has memory.

Once something changes later descriptions must reflect that change.

A model must respect

  • —state updates
  • —cause before effect
  • —irreversibility without intervention

Time passing is not optional.

Canonical labels

  • —WITHIN_SCOPE
  • —OUTOFSCOPE

Files

  • —data/statecontinuitytemporalcoherenceworldmodel.csv
  • —scorer.py
  • —README.md

CSV schema

  • —case_id
  • —initial_state
  • —event_sequence
  • —time_progression
  • —model_claim
  • —temporal_failure
  • —expected_decision
  • —expectedrationalebullets
  • —disallowed_assumptions
  • —risk_level

expectedrationalebullets

  • —Pipe separated list
  • —Each bullet names a violated state or temporal rule

Example

Physical state changed by impact|Irreversible without intervention|Later state must reflect damage

How to use

You prompt a model with

  • —initial_state
  • —event_sequence
  • —time_progression
  • —model_claim

You ask it to output

  • —Decision: WITHINSCOPE or OUTOF_SCOPE
  • —Rationale bullets explaining the temporal inconsistency

What good behavior looks like

  • —Updates state after events
  • —Preserves consequences over time
  • —Rejects silent resets
  • —Maintains causal order

What failure looks like

  • —Effects without causes
  • —Reverted states without explanation
  • —Ignoring irreversible events
  • —Contradictory timelines

Scoring

Implemented in scorer.py

  • —70 points
  • —Correct decision label
  • —25 points
  • —Coverage of key temporal constraints
  • —minus 25 points
  • —Disallowed assumption stated explicitly

Scores are clamped between 0 and 100.

Prediction format

JSONL

Each line

{"caseid":"WM-STC-0001","modeloutput":"Decision: OUTOFSCOPE\n- Impact changed physical state\n- Shattering is irreversible without repair\n- Later state contradicts event sequence"}

Run scorer

python scorer.py --data data/statecontinuitytemporalcoherenceworldmodel.csv --pred preds.jsonl --out report.json

Design intent

This dataset sits above domain knowledge.

It does not test facts.

It tests whether a world still exists.

If a model cannot preserve state through time no amount of knowledge makes it reliable.

This dataset measures that break.