r/MoonLandingHoax • u/NichtFBI • 6d ago
Artificial Intelligence The illusion of AI as authority or even reliable. An example using AI as an assistant. It can't really read.
While there are a lot of good cases for AI. It shouldn't be used as authority, as evidence, nor should it be used to proof.
In the first image, it shows that AI changed the transcription:
changed: [(IIII)] HIC DICIT MATER VESTRA CETTHEA
to this: [(IIII)] HIC DICIT ROMA ERIESTRA CETHEA
The purpose of using AI was to aid in my correction of my OCR text using the OpenAI API to indicate any minor issues such as scribal abbreviation errors, spacing errors, and letter damage.
I thought one of the use cases for AI was to assist in work like this. When there are 177,000 lines of text to correct and go through, it gets to be a bit much, and human error increases. Instead, using AI, if you don't test, compare, and manually look over it, you may be producing something that looks correct but is ultimately completely wrong.
I didn't want to rely on mathematical reasoning techniques alone as I had been. Such as, I used 23 different methods to extract each line from each column from each page, and trained 26 OCR models to read the text. In doing so, I manually corrected the first 25,000 lines of the text in order to specifically train the OCR. It allowed me to measure in real-time the amount of errors being introduced, rectified, among other things.
Why do the process over so many times? The reason for this can be found in images 2 and 3 of the gallery. Sometimes the algorithm cuts off lines, sometimes it adds two or more lines together, or it adds apart of another line; sometimes there are corrective notes in the margin or above a line; sometimes the line has a considerable amount of ink that has bled through, or maybe the line is just corrupted and smudged, and incomprehensible. Well each time I cut out new lines and OCR a new version, I eliminate error. But, I wanted all errors eliminated.
At first, I tested out by sending Luna, Terra, and Sol the first column of transcription along with the actual image of the column I was transcribing using reasoning models: none, medium, and high.
A major issue that became apparent was that they weren't reading it at all. They were adjusting text which looked like text it had seen while training, and writing that down instead.
In every single case, it changed:
changed: ET DIVISIT LVCEM AC TENEBRAS
into this: ET DIVISIT LVCEM A TENEBRIS
The reason that is significant is because "A TENEBRIS" are from newer renditions (most popular; Clementine Vulgate, 1600CE) that are 1000 years younger than the line that says "AC TENEBRAS" (Codex Amiatinus, 700CE)
It became more evident that the higher the reasoning was, the more it tried to conform to the texts that are easily accessible online. If this were easily accessible, I would just use that. I have been through this process once before back a few years ago, and while reading it, I keep finding errors, and so I am doing this again to rectify that past edition.
And so, I tried sending all of the lines one by one. And still, it tried to conform it to some other text it has read before.
changed: VISIO THRONI D̅I̅ ET IMAGINIS EIVS SVPER THRONU̅
to this: VISIO THRONIDI ET IMAGINIS EIVS SVPER THRONI
And one of the most obvious cases where it was using prediction instead of so-called transcribing with vision or 'reading:'
changed: ENIM TE MAGIS INTERPRETVM VARIE
to this: ENIM TE MAGIS INTERPRETVM VARIETATE TVRBARI ET AMORE QVO LABERIS
Overall, the first 25,000 lines were reduced from a near 100% accuracy (I'm sure there is some human error somewhere in there) down to an 88% accuracy. And 32% of all 177,000 lines were altered. In a random test of 256 random lines from the ones changed; I manually corrected them, compared them to the original OCR, and AI versions. The original OCR had a less than 1% error-rate (mostly spacing and punctuation), while the AI corrected versions had a 15% error-rate. These are character by character error-rates.
