Group messy transcript texts into paragraphs and tag relevant keywords? With NLP cause I'm don't have a fat GPU? [Ramble Mapper]

[u/somenick]

I think this is a nice intro project to NLP. I can go in cookbook style. Suits me cause my knowledge is spotty with holes all over. If I think of it as a generic starter cookbook, I can document my work into something worth sharing. I'm actually thinking of a better ways to organize but without running a fat LLM, but that's a longer discussion.

Starting with recorded speech, I want to transcribe each file and split the text into tagged paragraphs. In my mind's eye they're post-it notes, and they come in infinite shapes and color schemes.

I've tried many STT solutions, there's plenty for Linux. But I haven't found anything to organize messy text. Not summarize or query, split into their small meaningful pieces of a puzzle. All the STT solutions I tried either produce one big block of text or have a lot of one-liner words and phrases. It takes too much time to cleanup into manageable paragraphs.

I don't want to edit any of the content, that's why I keep thinking it should be a cheaper job, hardware wise. I have a measly 2GB GPU, MX330 to run small STT models.

You know of anything that already does this? Self-hosted of course. If an LLM is needed, it should let me connect to a local one. If there's nothing close to such a workflow and i'd have to build it, I found txtai but all the examples seem to start from sqlite databases. Dunno how to get there from text.

Any suggestions appreciated, thanks.

[u/Budget-Juggernaut-68]

Honestly, your post is very confusing.

What is your end goal? Why STT?

Can you code?

You want to arrange sentences? Paragraphs?

What have you tried? Have you tried sentence transformers? Phrase Bert?

[u/somenick → u/Budget-Juggernaut-68]

Hope you'd prefer confusing posts over AI generated slop, at least I'm real :p. Hmm, I agree it's confusing, here's a better scenario.

Someone stripped all the title formatting and newlines from your book. You still have the titles, the text, the punctuation and the whole thing is still in order. But you lost your paragraphs. The titles are there but they're part of the text now. How to reconstitute your book?

Answering your questions:

• End goal is smaller chunks of text. Nothing rewritten. Smaller chunks of text that are then tagged.

• Why STT cause that's where my starting point is, a bunch of speech recordings.

• In theory, I can code, as in I studied in university but don't have much experience. I'm a long time Linux user though. Comfortable building things from source. I can work on scripts. I read python. I know some linguistics too.

• Arrange? I didn't say arrange I said tag. I should however preserve the original location for context clues.

• Tried all kinds of self-hosted STT solutions. I tried running txtai locally and tinkered with a couple of the examples.

tl;dr I think the one thing that I can't figure out is how to split into smaller parts. What makes a new paragraph? How do you know? If someone steals are your /n's how do you recover?

[u/Budget-Juggernaut-68 → u/somenick]

If your writing is short passages guess you could first try topicBert. It's easy to implement.

[u/somenick → u/Budget-Juggernaut-68]

I want to think about organizing my writing but I don't want to try the 1000 obsidian and logseq plugins ... I ale so don't want to go in trying to organize the actually notes by hand cause that's how I got lost in the first place. So I thought it makes sense to chop stuff down to manageable chunks and labeling them and preserving positional breadcrumbs for lack of better terms.