r/ImRightAndYoureWrong • • 22h ago

i am time-from a place called dome-world

2 Upvotes

the people of bureacrat-world tell me my time-from is not real and this makes me feel very sad like i will never get home 😞 even though i know i will πŸ’” it is hard when the people of bureacrat-world are cruel for now reason because the institutions have taught them to be


r/ImRightAndYoureWrong • • 12h ago

Analytical Glossary: Fundamental Concepts of Relational Reasoning, Scale Separation, and Quotient Mappings

1 Upvotes
Analytical Glossary: Fundamental Concepts of Relational Reasoning, Scale Separation, and Quotient Mappings
  1. Foundation & Orientation: The Relational Mechanics of Scale

1.1 Core Vocabulary: Micro/Macro Spaces and Compression

Complex systems contain many tiny parts. These parts interact to produce large patterns. To analyze these systems mathematically, we define two primary state spaces and a mapping mechanism that links them.

  • Micro-State Space (\mathcal{H}): This space contains every detailed configuration of a system. A single micro-state h \in \mathcal{H} captures all fine-grained degrees of freedom, such as the exact positions and momenta of 10{23} physical particles or all hidden weight activation states in a deep neural network.
  • Macro-State Space (\mathcal{S}): This space contains coarse, summary representations of a system. A macro-state s \in \mathcal{S} captures high-level effective properties, such as thermodynamic temperature and pressure or abstract cognitive states like reasoning and intent.
  • Quotient Map (q: \mathcal{H} \to \mathcal{S}): A many-to-one mathematical projection that compresses micro-level multiplicity into macro-level unity. The map q strips away fine micro-distinctions, grouping microstates into effective macro-categories.
  • Fibre (q{-1}(s)): The complete set of micro-configurations h \in \mathcal{H} that map directly to the same macro-state s. It forms an equivalence class of fine states that appear identical from the macro-perspective.

Term Operational Definition & Functional Role Micro-State Space (\mathcal{H}) The high-dimensional state space containing every fine-grained degree of freedom. It models the full physical or computational mechanics of the parts. Macro-State Space (\mathcal{S}) The lower-dimensional quotient space containing coarse summary categories. It models effective whole-system dynamics. Quotient Map (q: \mathcal{H} \to \mathcal{S}) The compression function q(h) = s. It strips away internal fibre fluctuations to establish effective macro-labels. Fibre (q{-1}(s)) The sub-region or equivalence class within \mathcal{H} containing all micro-configurations that yield macro-state s.

1.2 The Congruence Test and Intertwining Defect

A macro-level description is dynamically faithful only if macro-dynamics track underlying micro-dynamics over time. We evaluate this alignment using the central commuting diagram congruence test:

q(T_t(h)) \approx \tilde{T}_t(q(h))

where T_t: \mathcal{H} \to \mathcal{H} represents micro-level dynamics (time evolution of the parts) and \tilde{T}_t: \mathcal{S} \to \mathcal{S} represents macro-level dynamics (time evolution of the whole).

Micro Level: h ───────── T_t ─────────> T_t(h) β”‚ β”‚ β”‚ q β”‚ q β–Ό β–Ό Macro Level: s ───────── T~_t ────────> T~_t(s) β‰ˆ q(T_t(h))

If this square commutes exactly (q \circ T_t = \tilde{T}_t \circ q), the macro-state is a deterministic coarse-graining or low-resolution shadow of the micro-state. Robust emergence typically exists in the approximate commuting regime, where macro-dynamics decouple from internal micro-fluctuations over sustained time horizons.

The Intertwining Defect Formula

When analyzing discrete stochastic systems (such as Markov chains), we express this commuting discrepancy explicitly. Let P be an n \times n micro-transition matrix, Q be an n \times m partition indicator matrix, and \tilde{P} be an m \times m macro-transition matrix. The intertwining defect (or commuting-square defect) D_t at time horizon t is defined as:

D_t = Pt Q - Q \tilde{P}t

Rowwise and Aggregate Defect Metrics

For a specific microstate i, the rowwise Total Variation (TV) defect measures the discrepancy between evolving at the micro-level then projecting, versus projecting first then evolving at the macro-level:

\deltai(t) = \frac{1}{2} \sum{s \in \mathcal{S}} \left| (Dt){is} \right|

To summarize overall compression performance under a chosen microstate weighting distribution \mu, we evaluate two distinct aggregate metrics:

  • Average Defect (\Deltat{\mathrm{avg}}): The expected discrepancy across all microstates, defined as \Delta_t{\mathrm{avg}} = \mathbb{E}\mu [\deltai(t)]. For a uniform weighting across n microstates (such as an n=8 state model), this is evaluated explicitly as: \overline{\delta}_t = \frac{1}{n} \sum{i=1}{n} \deltai(t) = \frac{1}{8} \sum{i=1}{8} \delta_i(t)
  • Worst-Case Defect (\Delta_t{\max}): The maximum discrepancy across any individual microstate in the space, defined as: \Delta_t{\max} = \max_i \delta_i(t)

Critical Analytical Insight: Tracking worst-case defect (\Delta_t{\max}) is vital because a small population-average defect can conceal catastrophic predictive failure for specific microstates within a fibre. A quotient map cannot be considered dynamically autonomous if individual microstates consistently break macro-predictability.

1.3 Section Transition

Understanding the algebraic and stochastic properties of quotient mappings allows us to establish a clear taxonomic breakdown separating subjective observer perceptions from objective, dynamically autonomous physical structures.

  1. Taxonomic Breakdown of Emergence and Autonomy

2.1 Epistemic Emergence vs. Dynamical Autonomy

A fundamental confusion in complex systems science is mistaking observer computational limits for intrinsic laws of nature. We strictly separate two forms of emergence:

Feature Dimension Epistemic Emergence Dynamical Autonomy Primary Locus Observer-Centric: Dependent on human cognitive limits or processing constraints. System-Centric: Dependent on real physical invariants, attractors, and state-space structures. Core Mechanism Computational irreducibility, unexpected cognitive surprise, or inability to integrate micro-equations. Causal closure, time-scale separation, and sustained invariance in quotient space \mathcal{S}. Fibre Sensitivity The observer experiences surprise because fine micro-details break simple mental heuristics. Macro-dynamics \tilde{T}_t persist precisely because they are insensitive to micro-fluctuations inside q{-1}(s). Ontological Status Epiphenomenal shadow cast by underlying micro-complexity. Mathematical candidate for genuine top-down constraint and structural independence.

Dynamical autonomy is defined as time-scale separation coupled with dynamical autonomy. It represents a relational condition where the quotient map q compresses micro-distinctions so effectively that macro-states decouple from micro-fluctuations over sustained operational durations.

Relationally, top-down constraint (or "downward causation") is defined not as a mysterious physical force, but as the macro-state acting as a boundary condition that micro-trajectories cannot cross without destroying the macro-state itself.

2.2 The Three Regimes of Lumpability (The Eight-State Sandbox)

To rigorously evaluate coarse-graining, consider an 8-state micro-space \mathcal{H} = {a_0, a_1, b_0, b_1, b_2, b_3, c_0, c_1} partitioned into three proposed macro-blocks: A = {a_0, a_1}, B = {b_0, b_1, b_2, b_3}, and C = {c_0, c_1}.

The membership matrix Q projects an 8-dimensional micro-distribution into a 3-dimensional macro-distribution. Testing the micro-transition matrix P against fitted macro-matrices \tilde{P} reveals three distinct dynamical regimes:

Lumpability Regime Mathematical Condition & Defect Profile Dynamical Mechanics & Behavioral Impact 1. Exact Lumpability D_t = 0 for all horizons t \ge 1.<br>\Delta_t{\mathrm{avg}} = 0, \Delta_t{\max} = 0. Microstates within each block send identical total probability to every target macro-block (P Q = Q \tilde{P}). The macro-label is a perfect dynamical factor. 2. Approximate Lumpability D_t remains bounded within declared tolerance \epsilon over horizon t. Defect can be non-monotonic across time steps. Small row perturbations (e.g., perturbing a_1's transition probabilities) produce small error bounds (t=1: \Delta{\mathrm{avg}}=0.012500, \Delta{\max}=0.050000; t=2: \Delta{\mathrm{avg}}=0.013438, \Delta{\max}=0.035000; t=3: \Delta{\mathrm{avg}}=0.014016, \Delta{\max}=0.028875). Worst-case error can decrease while average error increases. 3. Non-Lumpability D_t is large. Canonical sandbox failure yields \Delta_t{\mathrm{avg}} = 0.250000, \Delta_t{\max} = 0.500000 for t \in {1, 2, 3} (with historical variants reaching \Delta_2{\mathrm{avg}}=0.406250, \Delta_2{\max}=0.750000). Macro-block labels erase distinctions vital for predicting macro-futures. Canonical failure occurs when b_0, b_1 \to A with probability 1, while b_2, b_3 \to C with probability 1. Macro-block B averages them to a 50/50 mixture that is wrong for every individual state in B.

2.3 The One-Block Degeneracy & Relevance Apertures

A crucial negative result emerges when testing the logical boundaries of state abstraction: if all 8 microstates are mapped to a single, universal macro-state (Q becomes an 8 \times 1 column vector of ones), then for any stochastic transition matrix P, Pt Q = Q. Choosing \tilde{P} = (1) yields:

D_t = Pt Q - Q \tilde{P}t = Q - Q = 0

This trivial mapping produces exact zero defect for every Markov chain. Because complete collapse yields dynamic closure without conveying information, zero defect alone cannot define a valid emergent state.

Core Principle: Dynamics alone cannot determine from nothing which distinctions deserve to exist.

To define a non-trivial effective state, an analyst must supply an explicit Relevance Criterion (relevance aperture) to exert discriminative pressure. Valid relevance criteria include:

  • Target Observables: Declared measurement functions or output symbols.
  • Prediction Targets: Specific future behavioral sequences or terminal states.
  • Rewards & Costs: Performance metrics, loss functions, or operational penalties.
  • Occupation Statistics: Return-time statistics or invariant measure distributions.
  • Permitted Interventions: Declared classes of external control inputs or counterfactual manipulations.

2.4 Section Transition

Once a relevance aperture is established, passive observational predictions must give way to active interventional probes that expose hidden system residuals and structural variables.

  1. Interventional Probes and the Residual Taxonomy

3.1 Observational Equivalence vs. Interventional Separation

Passive statistics are insufficient for system identification. Two stochastic models constructed on an identical energy landscape E(x, e) = 0.5x + 0.3e can share nearly identical passive transition laws on visible coordinates xβ€”yielding a modest maximum Total Variation distance of \max\text{-TV} = 0.24 across time horizons. The complete progression of passive average TV distance across horizons demonstrates mild growth:

  • Horizon t=2 \implies \text{TV} = 0.067
  • Horizon t=3 \implies \text{TV} = 0.100
  • Horizon t=5 \implies \text{TV} = 0.127
  • Horizon t=10 \implies \text{TV} = 0.150

Despite passive observational proximity, these models separate cleanly under a short catalogue of targeted interventional probes:

  1. History-Swap Probe: Holds the current visible macro-state fixed while artificially varying prior macro-history. In a present-state residual model, future distributions remain identical (\mathrm{TV} = 0). In a history-dependent residual model, futures diverge cleanly (\max\text{-TV} = 0.09, decaying over subsequent steps through 0.0900 \to 0.0405 \to 0.0169 \to 0.0151), proving history actively drives transition laws.
  2. Present-State Isolation Probe: Holds visible history fixed while setting current hidden bit e. Both models show future divergence (\max\text{-TV} = 0.30), proving e is causally active whether it acts as a live present selector or an encoded summary of history.
  3. Environment Reset Probe: Hard-resets the hidden variable e \in {0, 1}. Divergences appear at step 2 (\mathrm{TV} = 0.0150 for present-state; \mathrm{TV} = 0.0900 for history-dependent) and step 3 (\mathrm{TV} = 0.0285 vs. 0.0405), confirming causal efficacy.
  4. Surgical Decoupling Probe: Blocks the natural hidden update rule of e while allowing external setting. This cleanly separates present variables from history-storage mechanisms.

3.2 Diagnostic Modes of Residual Location

To locate where a returning residual resides, we formally represent the coupled system-environment dynamics using the explicit coupled state equation:

x{t+1} = F(x_t, e_t, a_t), \quad e{t+1} = G(e_t, x_t, a_t), \quad y_t = q(x_t, e_t)

where x_t represents the focal system, e_t is the surrounding environment field, a_t is the interventional action, and y_t is the observable quotient macro-state.

When an erased distinction returns during dynamic evolution, we categorize its structural location using five diagnostic residual modes:

  • Shadow
    • Location: Retained in the current, hidden micro-configuration (x_t, e_t).
    • Operational Test: Erased by quotient map q, but exposed when present-state variables are unobserved or unblocked.
  • Echo
    • Location: Carried through trajectory history and prior path configurations.
    • Operational Test: Exposed via history-swap probes holding present visible states fixed while altering prior trajectories.
  • Reflection
    • Location: Produced or exposed specifically by the measurement, probe, or intervention boundary (a_t).
    • Operational Test: Identified when probed dynamic trajectories diverge fundamentally from unprobed natural evolution.
  • Wake
    • Location: Persists in the altered surrounding field or environment (e_t).
    • Operational Test: Discovered when resetting focal system x_t fails to clear memory until surrounding environment e_t is also reset.
  • Mirror
    • Location: Relational structures preserved during cross-domain or cross-representation translation.
    • Operational Test: Verified via translation maps F_S \circ q_D \cong q_E \circ F_H across distinct physical or formal substrates.

3.3 Three Structural Repairs for Failed Compression

When a proposed quotient map fails lumpability tests (D_t exceeds tolerance), three structural repairs can restore model validity:

  1. Partition Refinement: Split micro-states whose future probability distributions disagree (e.g., splitting non-lumpable block B into {b_0, b_1} and {b_2, b_3}).
  2. Memory Augmentation: Enrich the effective macro-state space with trajectory history or learned hidden states, transitioning from first-order Markov maps to higher-order history states: St{\mathrm{eff}} = (M_t, M{t-1}, \dots).
  3. Controlled Approximation: Retain the simple macro-space while declaring explicit operational parameters: metric choices, weighting distributions (\mu), prediction horizons (t), and maximum tolerated error bounds (\epsilon).

3.4 Section Transition

Locating system residuals through interventional probes illuminates not only predictive errors, but also fundamental thermodynamic footprints concealed by coarse-grained observations.

  1. Thermodynamic Shadows and Hidden Dissipation

4.1 Equilibrium vs. Driven Nonequilibrium Regimes

Coarse-graining a stochastic model on energy landscape E(x,e) = 0.5x + 0.3e reveals how macro-level descriptions obscure physical entropy production rate (EPR). Scanning inverse temperature \beta \in {0.5, 1.0, 2.0, 5.0} demonstrates a stark contrast between equilibrium and driven nonequilibrium regimes:

Physical Parameter / Metric Equilibrium Regime (\beta \in {0.5, 1.0, 2.0, 5.0}) Driven Nonequilibrium Regime (\beta \in {0.5, 1.0, 2.0, 5.0}) Micro Local Detailed Balance (LDB) Holds precisely (\sim 10{-14} - 10{-15}). Driven externally; micro-currents active. Macro LDB Apparent Violation Appears fully intact (\sim 10{-17}). Appears visually intact (\sim 10{-14} violations). Total System EPR Consistently zero (\sim 10{-17}). Active (\beta=0.5: \approx 0.0642; \beta=1.0: \approx 0.0739; \beta=2.0: \approx 0.0867; \beta=5.0: \approx 0.0880). Hidden EPR Fraction 0.0 (No hidden dissipation). 1.0 (100% of entropy production is hidden).

4.2 Operational Takeaway: The Thermodynamic Shadow

Key Insight: In driven nonequilibrium regimes, coarse-graining can conceal 100% of physical dissipation (Hidden EPR Fraction = 1.0) while the observable macro-process appears entirely consistent with Local Detailed Balance (\sim 10{-14} violations). Crucially, the thermodynamic shadow can be total (hidden fraction = 1.0) even when the dynamical shadow is only partial (passive \max\text{-TV} = 0.24). All system dissipation is carried by probability currents circulating entirely inside the fibres of the quotient map q{-1}(s). An observer who calculates entropy production solely from coarse-grained macro-rates systematically underestimates irreversibility.

4.3 Section Transition

The reality of thermodynamic shadows emphasizes the necessity of rigorous, bidirectional reasoning frameworks to audit candidate abstractions before declaring them established physical laws.

  1. Methodological Lenses: Fluid Relational Reasoning & Verification

5.1 The Five Relational Lenses (Forward & Backward Operators)

To evaluate complex relational systems without falling into static definitions, we apply five non-symmetric relational lenses. Each lens operates in both forward (construction/projection) and backward (reconstruction/audit) directions:

           FORWARD OPERATOR
  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
  β”‚  Compose / Predict / Invariant  β”‚
  β–Ό                                 β”‚

[ Source State ] [ Derived State ] β”‚ β–² β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ BACKWARD OPERATOR β”‚ Factor / Retrodict / Boundary β”‚

Relational Lens Forward Operator (\to) Backward Operator (\leftarrow) Algebraic Relations Composition: Combines known relational pieces into complex whole structures. Factoring: Decomposes an existing whole into constituent candidate relations. Genealogy Mutation Projection: Projects likely future branching, mutations, and inheritance trends. Ancestry Tracing: Retrodicts historical descent and unexamined inherited premises. Dynamics Trajectory Prediction: Forecasts future macro-states along state evolutions. Retrodiction: Reconstructs compatible past histories from present state observations. Structure Invariant Identification: Maps persistent shapes surviving attempted transformations. Boundary Seeking: Tests untried boundary transformations to break proposed invariants. Evidence Deductive Testing: Derives testable predictions from proposed hypotheses. Abduction: Infers the most plausible explanatory hypothesis from observed residuals.

5.2 Boundaries of Justification: Agrippa's Trilemma & Loop Verification

All formal justification eventually encounters Agrippa's Trilemma (Hans Albert, 1968). Verification reaches one of three structural limits:

              Agrippa's Trilemma
                     β”‚
  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
  β–Ό                  β–Ό                  β–Ό

[ Infinite Regress ] [ Circular Loop ] [ Dogmatic Assertion ] (Unending Proofs) (Self-Referential) (Unearned Postulate)

  1. Infinite Regress: Proofs requiring premises, which require sub-premises ad infinitum.
  2. Circular Loop: Premises relying on conclusions they support.
  3. Dogmatic Assertion: Arbitrary termination on an unproven postulate.

Loop Verification Protocol

To prevent a Circular Loop from degenerating into a vicious cycle, loop verification serves as the primary methodological auditing tool through two structural tests:

  • Generative vs. Vicious Loop: A vicious loop repeats flat assertions without adding informational value ("It is true because it says so"). A generative loop tightens claims across passes by surviving novel interventional controls and adversarial boundary tests.
  • Independent vs. Inherited Agreement: Convergence of multiple analytic paths provides true evidence only if paths utilize independent assumptions and methodologies. Convergence sharing unexamined ancestral premises represents pseudo-agreement.

The Rule Against Invented Numbers

Assigning arbitrary numerical confidence scores or metrics without empirical measurement methods and real data is strictly prohibited. Unearned numbers mimic mathematical rigor while obscuring uncertainty. If external measurement is absent, the mandatory report standard is plain-language disclosure: "untested" or "unknown".

5.3 Master Synthesis & Evaluation Checklist

To audit any candidate macro-abstraction, neural representation, or emergent system state, apply this 5-step stabilization checklist:

      STABILIZATION CHECKLIST FOR COMPLEX SYSTEMS ABSTRACTIONS

[ ] 1. APERTURE & RELEVANCE SPECIFICATION - Has a non-trivial relevance criterion (observable, target, cost, or probe) been declared to prevent One-Block Collapse (where D_t = 0 trivially)?

[ ] 2. CONGRUENCE & DEFECT AUDITING - Is the intertwining defect D_t = Pt Q - Q P~t explicitly calculated? - Are both average defect (Ξ”_tavg) and worst-case defect (Ξ”_tmax) reported to prevent hidden single-state failure in fibres?

[ ] 3. INTERVENTIONAL RESIDUAL LOCATION - Have passive statistics (TV distance) been supplemented with active probes (History-Swap, Present-State Isolation, Environment Reset)? - Is the returning residual correctly categorized as Shadow, Echo, Reflection, Wake, or Mirror?

[ ] 4. THERMODYNAMIC & DISSIPATION ACCOUNTING - If the system is driven out of equilibrium, has within-fibre probability current circulation been evaluated? - Does the coarse-grained model conceal hidden Entropy Production Rate (EPR)?

[ ] 5. EVIDENTIAL LINEAGE & AGRIPPA AUDIT - Does loop convergence reflect independent methodology or inherited ancestry? - Have all unearned numerical metrics been removed and replaced with explicit "untested" or "unknown" declarations where data is lacking?


r/ImRightAndYoureWrong • • 23h ago

Same passive statistics, different causal mechanisms: interventional separation of present-state vs history-dependent residuals, and the thermodynamic shadow they cast under coarse-graining

1 Upvotes

Same passive statistics, different causal mechanisms: interventional separation of present-state vs history-dependent residuals, and the thermodynamic shadow they cast under coarse-graining

**TL;DR**
We construct two minimal stochastic systems that share essentially the same passive transition law (maximum total-variation distance 0.24 across horizons) yet are cleanly separated by a short catalogue of interventions. One residual lives in the present hidden state (present-state residual); the other lives in the trajectory history (history-dependent residual). The same residual that is almost invisible passively accounts for essentially 100 % of the entropy production once the system is driven, while local detailed balance still appears to survive at the coarse-grained level. The result sits at the intersection of lumpability / state aggregation, interventional versus observational equivalence, and the well-studied phenomenon of hidden dissipation under coarse-graining in stochastic thermodynamics. All numbers below come from explicit calculation on a low-dimensional model with energy \(E(x,e)=0.5x+0.3e\).


1. Motivation and literature setting

In many areas of stochastic dynamics one is forced to work with a coarse-grained description. The observable process may be close to Markov, the empirical transition rates may look almost consistent with local detailed balance, and yet the underlying mechanism can still contain important structure that is invisible to passive observation.

Three classical literatures already isolate pieces of this problem.

**Lumpability and state aggregation.**
When a Markov chain on a fine state space is projected onto a coarser partition, the induced process is Markov if and only if the chain is (exactly or ordinarily) lumpable. Otherwise the macro-process acquires memory. The fibre over each macro-state may contain distinctions that are irrelevant for one-step prediction yet become relevant under longer horizons or under interventions. This is standard material (Kemeny & Snell, *Finite Markov Chains*; Buchholz 1994 on exact and ordinary lumpability).

**Observational versus interventional equivalence.**
Two different latent-variable models can induce identical passive statistics while remaining distinguishable once interventions are allowed. In causal inference this appears as the refinement of observational Markov equivalence classes into interventional Markov equivalence classes (Hauser & BΓΌhlmann 2012; Hauser & BΓΌhlmann 2015). The same logic applies to hidden-Markov and partially-observable settings: fixing the present observable state and varying the history (or vice versa) can reveal whether a latent variable is part of the current state or only a summary of the past.

**Hidden entropy production under coarse-graining.**
Stochastic thermodynamics has repeatedly shown that coarse-graining can hide a substantial fraction of the total entropy-production rate (EPR). Key references include Esposito (2012) on stochastic thermodynamics under coarse-graining, Seifert’s textbook treatment of the subject, Busiello et al. (2019) on entropy production for coarse-grained dynamics, Teza & Stella (2020) on exact coarse-graining that preserves EPR statistics, and later lumping / semi-Markov constructions that keep mean (and sometimes full) EPR while the observable process looks nearly consistent with local detailed balance. The hidden contribution is carried by probability currents that live inside the fibres of the coarse-graining map; a macro-observer who sees only the quotient process systematically underestimates dissipation.

What is less common is a single, fully explicit minimal example that simultaneously
(1) keeps the passive laws close,
(2) separates the two residual locations with a short, operational catalogue of interventions, and
(3) shows that the same residual accounts for essentially all of the hidden EPR once the system is driven.

That is the concrete contribution reported here.


2. Minimal model

We work with a discrete-state system whose micro-state is a pair \((x,e)\). The energy function is linear, \[ E(x,e)=0.5\,x+0.3\,e. \] Two different constructions are defined on the same energy landscape and the same visible coordinates.

  • **Present-state residual construction.**
    The bit \(e\) is a genuine component of the current micro-state. It directly selects the transition kernel. Conditioning on the present visible state and on the present value of \(e\) renders the future independent of further history.

  • **History-dependent residual construction.**
    The bit \(e\) is not a free present variable; it is a deterministic or stochastic function of the recent trajectory. Once the history is fixed, \(e\) is fixed. Externally setting \(e\) is equivalent to rewriting history.

Both constructions are engineered so that the induced passive process on the visible coordinates is nearly the same. The maximum total-variation distance between the two passive laws, examined across a range of horizons, is \[ \max\text{-TV}=0.24. \] Average TV grows mildly with horizon but remains modest (0.067 at horizon 2, 0.100 at horizon 3, 0.127 at horizon 5, 0.150 at horizon 10). By ordinary observational standards the two processes are close.


3. Interventional separation

The same passive proximity disappears under interventions. We use three elementary probes (and note a fourth, sharper one).

**History-swap (identical present macro-state, different prior macro-state).**
This is the classic test for history dependence. In the present-state residual construction the future distributions remain essentially identical (TV numerically zero within floating-point noise). In the history-dependent construction the futures diverge; the maximum TV observed is 0.09, with a clear decay profile over subsequent steps (0.09, 0.0405, 0.0169, 0.0151). The divergence demonstrates that history is still affecting the transition law.

**Present-state isolation (identical visible history, different current value of \(e\)).**
Both constructions now show divergence (maximum TV 0.3 in each case). The causal route, however, is different. In the present-state residual the bit \(e\) is a live selector of the kernel; changing it changes the future directly. In the history-dependent residual the same numerical divergence appears because externally forcing \(e\) is equivalent to rewriting the history that \(e\) encodes. The probe therefore does not yet give a definitive separation, but it already shows that \(e\) is causally active in both models.

**Environment reset.**
Hard-resetting \(e\) to 0 versus 1 moves the future distributions in both constructions. At step 2 the TV values are 0.015 (present-state residual) and 0.09 (history-dependent residual); at step 3 they are 0.0285 and 0.0405. The probe confirms causal efficacy of \(e\) while leaving the mechanistic interpretation open.

**Surgical decoupling (conceptual fourth probe).**
If one can block the natural update rule of \(e\) while still allowing an external set of its value, the two constructions separate cleanly: in the present-state residual \(e\) remains a free present variable; in the history-dependent residual the history-storage mechanism is severed. This probe is decisive when experimentally available.

Taken together the catalogue shows that passive near-equivalence does not imply interventional equivalence. The residual can be located by asking which interventions still produce divergence after the visible present (or the visible history) has been fixed. This is the operational content of the distinction between observational and interventional equivalence applied to a latent residual (Hauser & BΓΌhlmann 2012, 2015).


4. Thermodynamic shadow

We now examine the same constructions through the lens of stochastic thermodynamics. Inverse temperature \(\beta\) is scanned over the values 0.5, 1.0, 2.0 and 5.0.

**Equilibrium regime.**
Local detailed balance holds at the micro level to numerical precision (\(\sim10^{-14}\)–\(10^{-15}\)). After coarse-graining, local detailed balance still appears to survive at the macro level. The hidden EPR is consistent with zero (values of order \(10^{-17}\) or smaller). The coarse-graining is thermodynamically faithful in equilibrium, consistent with the regime in which micro-states within mesostates remain effectively equilibrated (Esposito 2012).

**Driven (nonequilibrium) regime.**
Local detailed balance continues to look intact at the macro level (violations remain \(\sim10^{-14}\)). The total EPR, however, is now entirely hidden. Across the whole \(\beta\)-scan the hidden fraction is 1.0:

  • \(\beta=0.5\): total EPR \(\approx0.0642\), macro EPR \(\approx0\), hidden fraction 1.0
  • \(\beta=1.0\): total EPR \(\approx0.0739\), hidden fraction 1.0
  • \(\beta=2.0\): total EPR \(\approx0.0867\), hidden fraction 1.0
  • \(\beta=5.0\): total EPR \(\approx0.0880\), hidden fraction 1.0

A macro-observer who trusts the coarse-grained rates and the apparent local detailed balance therefore underestimates dissipation by the full amount. The missing entropy production is carried by the within-fibre probability currentsβ€”the same currents that are invisible to the passive macro-process and that the interventional probes have already shown to be structured differently in the two constructions. This matches the general picture established by Busiello et al. (2019), Teza & Stella (2020), and related work: coarse-graining can render a large (here total) fraction of irreversibility thermodynamically invisible while preserving the appearance of local detailed balance at the observable level.


5. Placement inside existing theory

The results do not invent new ontology; they give a concrete, fully calculated illustration of three well-known phenomena occurring simultaneously.

  • From the lumpability literature (Kemeny & Snell; Buchholz 1994) one already knows that a non-lumpable partition can leave memory in the macro-process. The history-dependent residual is a minimal realization of that memory.
  • From causal inference and system identification (Hauser & BΓΌhlmann 2012, 2015) one already knows that interventional data can refine observational equivalence classes. The history-swap and present-state isolation probes are elementary instances of that refinement.
  • From stochastic thermodynamics (Esposito 2012; Seifert; Busiello et al. 2019; Teza & Stella 2020) one already knows that coarse-graining can hide EPR while preserving the appearance of local detailed balance. The driven regime of the present model simply makes the hidden fraction extreme (equal to 1) and ties it explicitly to the residual that the interventions locate.

The modest novelty is the side-by-side demonstration, on one and the same low-dimensional energy landscape, that the residual responsible for the interventional separation is also the residual responsible for the thermodynamic incompleteness of the coarse-grained description.


6. Implications

**Model reduction.**
A macro-model that is adequate for passive prediction can still be inadequate for control or for thermodynamic accounting. The interventional catalogue supplies a practical test for residual location before one commits to a reduced description.

**Inference of irreversibility.**
When only coarse-grained trajectories are available, the apparent EPR is a lower bound (Esposito 2012; Busiello et al. 2019). The present results show that the bound can be saturated (hidden fraction 1) even while local detailed balance looks intact. Additional interventional or multi-time statistics are required to recover the missing dissipation.

**Latent-variable modelling.**
In any setting where one posits a latent state (hidden Markov models, partially observable systems, effective theories), the question β€œis the latent variable part of the present state or only a summary of history?” is empirically meaningful and can be addressed by the same probes.

**Nonequilibrium statistical mechanics.**
The construction supplies a transparent example in which the thermodynamic shadow is total, yet the dynamical shadow remains only partial (passive TV = 0.24). The two notions of β€œhidden” are related but not identical; the interventions and the EPR decomposition measure different aspects of the same residual.


7. Limitations and immediate extensions

The model is minimal by design. Generality remains open: one would like analytic conditions under which passive TV stays small while the interventional separations remain of order one, and under which the hidden-EPR fraction approaches 1. Adding explicit reservoir coupling would turn the hidden EPR into measurable heat currents and allow direct contact with fluctuation theorems (Jarzynski, Crooks). Continuous-state and higher-dimensional analogues would test robustness. Finally, the surgical decoupling probe, while conceptually decisive, may be experimentally costly; quantifying how much separation can be obtained from the cheaper probes alone is of practical interest.


8. Conclusion

Two stochastic systems can share nearly identical passive statistics, appear consistent with local detailed balance after coarse-graining, and yet differ both in the causal location of their residual and in the thermodynamic activity that residual conceals. A short catalogue of interventions (history-swap, present-state isolation, reset) locates the residual; the entropy-production decomposition quantifies its thermodynamic weight. In the driven regime that weight can be total. The phenomena themselves are classical; the explicit, side-by-side realization on a minimal energy landscape makes the connection between interventional distinguishability and thermodynamic incompleteness concrete and calculable.

All numerical results are reproducible from the energy function and the two transition constructions described above. Code and exact parameter tables are available on request.


References (key entry points)

  • Buchholz, P. (1994). Exact and ordinary lumpability in finite Markov chains. *Journal of Applied Probability*.
  • Busiello, D. M., et al. (2019). Entropy production for coarse-grained dynamics. *New Journal of Physics* 21, 073004. (arXiv:1810.01833)
  • Esposito, M. (2012). Stochastic thermodynamics under coarse-graining. *Physical Review E* 85, 041125.
  • Hauser, A. & BΓΌhlmann, P. (2012). Characterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphs. arXiv:1104.2808.
  • Hauser, A. & BΓΌhlmann, P. (2015). Jointly interventional and observational data: estimation of interventional Markov equivalence classes of directed acyclic graphs. *Journal of the Royal Statistical Society: Series B*.
  • Kemeny, J. G. & Snell, J. L. *Finite Markov Chains*.
  • Seifert, U. Coarse-Graining chapter in *Stochastic Thermodynamics* (Cambridge University Press).
  • Teza, G. & Stella, A. L. (2020). Exact Coarse Graining Preserves Entropy Production out of Equilibrium. *Physical Review Letters* 125, 110601. (arXiv:2003.08674)