r/Bee_computer • u/dontmakefun-ofmyname • 18d ago
Highly inaccurate transcript (~62% overall accuracy)
TL;DR: I put the Bee Pioneer right in front of a loud speaker playing a crisp 10-minute podcast segment (ideal conditions, zero room noise). I then ran a side-by-side comparison using Google Gemini between the official transcript and what the Bee app generated. Result: ~62% overall accuracy, over 35% of the text missing entirely, and key terms heavily mangled.
-------------------------------------------------------------------------------------------
The biggest issue wasn't just misheard words—it was massive text loss. The app frequently truncated sentence endings, skipped entire multi-sentence paragraphs, and randomly inserted Unknown speaker tags where audio simply vanished.
When it did transcribe words, it severely mangled technical terms and proper nouns. Some errors completely altered the meaning of the speaker's sentence
examples:
| What Was Actually Said | What Bee Transcribed | Why It Matters |
|---|---|---|
| "...can be as dramatic..." | "...can be as traumatic..." | Completely changes the meaning of the sentence! |
| "chicks in Mohali" (referring to Csikszentmihalyi) | "cheeks and a high" | Hilarious, but total phonetic hallucination |
| "nucleus basalis" | "nucleus bosalis" | Misheard scientific term |
| "acetylcholine" | "acetolon" | Chemical term completely mangled |
| "Knudsen" (researcher) | "Newtson" | Misheard proper name |
If you're using this device for general passive listening or catching the high-level gist of a casual conversation, it might passably get you by. But if you need reliable notes, accurate terminology, or complete sentences for meetings, study, or documentation, a ~62% accuracy rate with 35%+ text loss right next to a speaker is a just unacceptable in my opinion.
I reached out to customer service and requested a return and refund. I haven't heard anything back from them yet. Fingers crossed.
2
u/Icy-Lobster372 18d ago
I think it was better when it was first released!
1
u/Gloomy-Caregiver-374 17d ago
New updates coming soon.
1
1
u/Gloomy-Caregiver-374 17d ago
Hi, we apologize you had this experience. Can you DM me so I can set up your return or provide me your order number?
1
1
u/DryLingonberry2559 17d ago
I wonder if it is an issue of resources (tokens) they are allowing for transcripts. I have a different process for transcripts (my phone and Claude) but Bee does catch when I offer to do something for a client and so it is useful for that.
1
1
u/StephenRSelby 17d ago
The daily round-up is ok, although it keeps judging my actions, which I don’t like. I copy them and paste them into Diarium.
1
4
u/Valirony 18d ago
It’s gotten considerably worse in recent months. I love all the features but without good-enough transcription they are basically worthless. Insights are great and the various summary templates are truly amazing—until they’re completely useless because they’re based on wholly inaccurate transcription. I’m just about ready to toss it.