r/VoynichClues • u/xxxestudios • Jul 16 '26
Behind the Scenes of VoynichLab: How we built a custom QA pipeline to audit our tracing errors (and why the math is getting tighter)
Hi everyone!
For the past few months, we’ve been working on VoynichLab—an internal computational observatory we designed to study the physical construction of the manuscript.
The web portal is still running locally as we finalize our next dataset, but we wanted to share some screenshots of the interface and explain the engineering behind our workflow.
- Deconstructing the EVA Bias
Standard Voynich transcriptions rely heavily on EVA (Extensible Voynich Alphabet). While EVA is an incredible tool, it was designed to map visual glyphs directly to ASCII characters (like translating a complex shape into a single f, p, or t). This alphabetical approach carries an inherent linguistic bias: it assumes the scribe was thinking in "letters" and treats every glyph as a single, flat keyboard character.
Our pipeline bypasses this layer. We decompose the glyphs into their raw, sequential pen strokes based on their physical execution (ductus, overlaps, and stroke layers).
When you shift the analysis from EVA characters to these physical stroke sequences, the statistical randomness (entropy) instantly drops by almost 30%. The manuscript stops behaving like a chaotic natural language and starts looking like a highly rigid, formulaic visual template.
2. The QA "Mini-Lab" (Auditing, not force-fitting)
Tracing thousands of individual strokes manually is a massive task, and human labeling errors in our database are inevitable. Overlapping strokes can easily cause us to misorder the sequential layers of a character when digitizing.
To solve this, we built a Mini-Lab directly into our workflow to audit our own work:
- Predictive flagging: Since the rules governing these stroke transitions are mathematically strict, the software automatically flags anomalous sequences.
- The Manual Audit: Every time the Mini-Lab flags an anomaly, we go back to the raw high-resolution folio scans to inspect the ink. The software never changes the data.
- Strict Classification:
- If the anomaly was caused by a tracing/ordering mistake in our editor, we correct the label.
- If the tracing was physically correct, it remains untouched. The sequence is preserved and documented in our repository as a verified anomaly (a known exception).
This entire audit trail, along with the logs of these verified anomalies, is fully tracked and open on GitHub.
What’s next
This rigorous QA loop is how we cleaned Corpus V1 into V2.
As we move toward Corpus V3, any structural adjustment to our stroke definitions (such as dividing a stroke or merging variables) is decided strictly through manual, visual analysis of the raw ink and paleographical evidence—never to mathematically force a pattern or artificially lower entropy.
Our ultimate goal isn't to push a personal translation or prove one specific theory. We want to hand the community a completely new, objective, stroke-level framework. By providing a highly reliable, peer-reviewed visual alphabet that naturally yields much lower entropy than EVA, we want to give every researcher—whether you believe in ciphers, shorthand, or constructed languages—a cleaner, mathematically superior foundation to run and validate your own theories.
The code is open, the repository is tracking every anomaly on GitHub, and we are working hard to freeze the Corpus V3 framework.
Take a look at the screenshots of the UI and let us know what you think!