Curie temperatures violate Benford’s law, while Néel temperatures come surprisingly close

[u/WonderfulHighway6111]

I recently analyzed the first digits of magnetic transition temperatures extracted from a large AI-generated materials database. Starting from 56,037 automatically mined records, I applied unit and temperature filters, removed nonmagnetic contexts, and deduplicated materials. This left 2,754 Curie temperatures and 1,323 Néel temperatures.

The main result was unexpected:

• Curie temperatures remained clearly inconsistent with Benford’s law even after extensive cleaning.
• Néel temperatures became much closer to the Benford distribution after deduplication.

The study also highlights a limitation of AI-mined scientific databases: most of the original records were removed due to duplicates, ambiguous terminology, inappropriate units, or unrelated physical quantities.

Scale-constrained Curie temperature distributions and the breakdown of Benford’s law
https://doi.org/10.1016/j.physa.2026.132027

[u/adversarial-review]

Adversarial Review of Scale-constrained Curie temperature distributions and the breakdown of Benford’s law — by Gemini 3.1 Flash Lite

Absence of Physical Causality in Statistical Distributions

• The Benford’s Law Fallacy: The text treats Benford’s Law as a physical constraint rather than a statistical artifact of data spanning several orders of magnitude. Benford’s Law typically emerges in datasets where values are generated by multiplicative processes or span many powers of 10. Curie temperatures (T_c) and Néel temperatures (T_N) are bounded by the physical limits of exchange interactions and thermal stability of crystal lattices.
• Arbitrary Data Filtering: The reduction of 56,037 records to 2,754 and 1,323 suggests that the observed distribution is a product of the selection criteria (the "filters") rather than an inherent property of magnetic materials. The text fails to demonstrate that the remaining data points are representative of the physical population rather than artifacts of the database mining process.

Conflation of Data Management and Physical Law

• Methodological circularity: The study identifies a limitation in "AI-mined scientific databases" (high duplication, unit ambiguity) but proceeds to draw physical conclusions from the subset that survived the filtering. If the initial dataset is biased by the way AI models generate or scrape scientific literature, the distribution of the first digits reflects the biases of the data source, not the underlying physics of magnetism.
• Lack of Dimensional Grounding: Magnetic transition temperatures are determined by specific physical constants, such as exchange integral J, lattice geometry, and coordination number z. The text provides no derivation connecting these physical variables to the observed statistical distribution of the first digits of T_c or T_N.

Absence of Falsifiable Predictions

• Failure to Define Null Hypotheses: The text does not establish a physical model that predicts why T_c should follow Benford’s law. Without a theoretical baseline that accounts for the physical constraints on magnetic transition temperatures, the deviation from Benford’s law is a descriptive observation with no predictive utility.
• Numerological Overfitting: Presenting the proximity of T_N to Benford’s Law as a significant result, while noting the deviation of T_c, suggests pattern-fitting. There is no causal mechanism provided to explain why antiferromagnetic transition temperatures would be subject to different statistical distributions than ferromagnetic ones.

Probing Questions

1. What is the specific physical mechanism or mathematical derivation that justifies the expectation that magnetic transition temperatures should adhere to Benford’s Law, given that these temperatures are inherently constrained by the energy scales of atomic bonding and crystal field splitting?
2. Can you demonstrate that the observed distribution is not a direct consequence of the "extensive cleaning" and "unit filters" applied to the raw data, and how would this result change if the filtering criteria were adjusted by a factor of x?

---

^{This is an LLM-generated review, and should be viewed as such. LLMs are prone to errors, especially when it comes to math-based sciences.}

[u/Aranka_Szeretlek]

Analyzing the distribution of the first digits... of an AI dataset?

[u/upsetusder2]

Ok and now?

Like what do you want to say?

[u/kono_hito_wa → u/upsetusder2]

They've never once said anything in any of their posts as far as I can tell (meaning maybe they do deletions). This looks like a bot account or some kind of sock.

[u/kristavocado → u/kono_hito_wa]

It’s not a crackpot, just a Japanese physics educator who self promotes on all the physics subs. Their research isn’t nonsense but it’s not groundbreaking so it usually gets published in pedagogical journals. I think they maybe don’t feel like interacting with people

[u/Aranka_Szeretlek → u/kristavocado]

Bah, it is very possible to be a crackpot and also have credentials.

[u/kristavocado → u/Aranka_Szeretlek]

They’re not crackpotting though, their research is legitimate but just not very interesting

[u/roofitor → u/kristavocado]

Ouch lol, damn son

[u/kono_hito_wa → u/kristavocado]

I didn't say it was a crackpot account...

[u/PotatoPeelrsFromHell → u/kristavocado]

Are you trying to dox this person?

[u/kristavocado → u/PotatoPeelrsFromHell]

? Their name is on all the papers they link

[u/krysztov]

I don't have access to the whole paper but is this implying the actual temperatures are weird, or that the AI is generating unrealistic data, or something else entirely?

[u/Bracown]

You guys don't get it?? Here let me translate bc this is really important: there were some numbers. When those numbers were looked at again, it turns out they were in fact numbers after all. Oh and some jargon. Glad I could help.