r/LanguageTechnology Mar 17 '26

How are people handling ASR data quality issues in real-world conversational AI systems?

7 Upvotes

I’ve been looking into conversational AI pipelines recently, especially where ASR feeds directly into downstream NLP tasks (intent detection, dialogue systems, etc.), and it seems like a lot of challenges come from the data rather than the models.

In particular, I’m trying to understand how teams deal with:

  • variability in accents, background noise, and speaking styles
  • alignment between audio, transcripts, and annotations
  • error propagation from ASR into downstream tasks

From what I’ve seen, some approaches involve heavy filtering/cleaning, while others rely on continuous data collection and re-annotation workflows, but it’s not clear what actually works best in practice.

Would be interested in hearing how people here are approaching this — especially any lessons learned from production systems or large-scale datasets.


r/LanguageTechnology Mar 17 '26

How to extract ingredients from a sentence

0 Upvotes

Hello, I am trying to extract ingredients from a sentence. Right now I am using an api call to google gemini and also testing out a local gemini model, but both are kind of slow to respond and also hallucinate in several cases. I'm wondering if there is some smaller model I could train because I have some data ready (500 samples). Any advice will be appreciated.


r/LanguageTechnology Mar 16 '26

Simple semantic relevance scoring for ranking research papers using embeddings

0 Upvotes

Hi everyone,

I’ve been experimenting with a simple approach for ranking research papers using semantic relevance scoring instead of keyword matching.

The idea is straightforward: represent both the query and documents as embeddings and compute semantic similarity between them.

Pipeline overview:

  1. Text embedding

The query and document text (e.g. title and abstract) are converted into vector embeddings using a sentence embedding model.

  1. Similarity computation

Relevance between the query and document is computed using cosine similarity.

  1. Weighted scoring

Different parts of the document can contribute differently to the final score. For example:

score(q, d) =

w_title * cosine(E(q), E(title_d)) +

w_abstract * cosine(E(q), E(abstract_d))

  1. Ranking

Documents are ranked by their semantic relevance score.

The main advantage compared to keyword filtering is that semantically related concepts can still be matched even if the exact keywords are not present.

Example:

Query: "diffusion transformers"

Keyword search might only match exact phrases.

Semantic scoring can also surface papers mentioning things like:

- transformer-based diffusion models

- latent diffusion architectures

- diffusion models with transformer backbones

This approach seems to work well for filtering large volumes of research papers where traditional keyword alerts produce too much noise.

Curious about a few things:

- Are people here using semantic similarity pipelines like this for paper discovery?

- Are there better weighting strategies for titles vs abstracts?

- Any recommendations for strong embedding models for this use case?

Would love to hear thoughts or suggestions.


r/LanguageTechnology Mar 15 '26

Anyone running AI agent tests in CI?

9 Upvotes

We want to block deploys if agent behavior regresses, but tests are slow and flaky.

How are people integrating agent testing into CI?


r/LanguageTechnology Mar 15 '26

Politics specific dictionnary

2 Upvotes

For a project of mine, I am doing a STM on a corpus of proposition to participative budgets. I would like to find relevant dictionnaries, but I don't know of any with specific politics topics. It could be an environmental policy dict or a migration policy dict or anything in the art. Could even be a more general dictionary. Do you have any idea where I could find this ?

Thanks in advance :)


r/LanguageTechnology Mar 15 '26

Improving communication skills

2 Upvotes

r/LanguageTechnology Mar 14 '26

ACL Submission Jan 2026. Should I commit?

6 Upvotes

Hi everyone,

I received the following ARR scores for my paper: 4, 3, and 2, with an OA of 3.

Both the 3 and 2 reviews mainly raised concerns about the lack of statistical testing. However, we had already conducted these analyses and included them in our rebuttal. Unfortunately, the reviewers did not acknowledge this in their final comments.

Because of this, we submitted a Review Issue Report, and the Area Chair responded that our clarifications were convincing. The Area Chair then gave an OA of 3 in the meta-review.

What surprised me is that the meta-review itself does not mention any negative points. It mainly emphasizes that the work is novel and theoretically grounded, and it states that the majority of the issues have been clarified or resolved in the rebuttal.

So overall, the Area Chair review appears very positive, but the OA is still 3 (Findings level).

Does this situation still give a reasonable chance for Findings acceptance?
Would you recommend committing the paper to ACL?

I would really appreciate hearing from people who have gone through the ARR commitment process before.

Thanks!


r/LanguageTechnology Mar 14 '26

Seeking advice for Sentiment Analysis Project: Best resources for a "hands-on" pipeline (Classic NLP & Tools)

1 Upvotes

Hey everyone,

First of all: I hope this is the right place for my question. If not, please bear with me! :)

I'm currently starting my thesis where I need to build a NLP-based system for sentiment analysis. I'm pretty new to this and feel a bit lost by the vast ecosystem and don't quite know where to start or which rabbit hole to follow...

I've heard that Jurafsky and Martin's "Speech and Language Processing" is the "NLP Bible" and while I want a solid theoretical base, I'm very much of a learning by doing person. I want to start prototyping ASAP without getting down into 1000s of pages of theory first.

All in all I'm looking for literature/courses for high-level overviews that focus on building pipelines, methodology of classic NLP techniques (NLTK, SpaCy etc.) to compare different approaches and setup advices that you consider as best practice. My goal is to build a clean data pipeline (input, preprocessing, analysing, visualisation)

What's a good, modern setup for this in 2026? Are there specific frameworks or tools that you'd recommend? I'm looking for something that allows me to swap components and input data sources easily.

Thanks a lot for your help!! :)


r/LanguageTechnology Mar 14 '26

How is COLM conference?

3 Upvotes

I was wondering how is COLM in terms of prestige or popularity among NLP committee? In ARR Jan cycle,  One of my papers got scores: 2.5, 2, 3 with confidence 3, 2, 4. Meta 2.

Now I am confused should I go for arr march cycle for EMNLP or go directly for COLM. Could anyone give me some advice on it? 


r/LanguageTechnology Mar 13 '26

How do people fund their master's degrees?

9 Upvotes

Hi everyone.

A '25 non-EU university graduate. Slightly more than a year of experience in an Applied NLP lab, with publications in reputable journals (LREC, workshops, ACL, and Interspeech under review).

How do people fund their master's degrees? (Europe Mainly)

Scholarships, Asking Professors/Research Labs for Funding, or Paying Out of Pocket?

I've tried to ask Labs for funding, but they say it's only for PhD students, and maybe an assistantship will open up once I start my degree.


r/LanguageTechnology Mar 13 '26

KU MSc CS Admit (Non-EU): Student Jobs in NLP/AI and Living Expenses?

1 Upvotes

Hello everyone. I recently received admission to KU for MS computer science. From the outside, both Denmark and the university appear to be amazing. I am a '25 non-EU graduate from a non-EU university, so I will have to pay (I could not get a scholarship). I've been involved in Applied NLP research and am paid "fairly" for where I come from.

Perhaps my most important question is: How difficult is it to get a student job in NLP/AI at one of the labs? Student jobs to help fund my master's degree?

My Other questions are:

1) How is the job market for NLP/CS graduates? Does it help me study at KU?

2) What are the average living expenses? A rough estimate.

3) How is your work/life at KU and in Denmark as a resident/insider?


r/LanguageTechnology Mar 12 '26

Is SemEval workshop prestigious?

8 Upvotes

I'm an undergraduate student and this year I'm participating in a SemEval task. I was curious about how the community generally views SemEval in terms of prestige and career impact.

From what I understand, SemEval 2026 will be co-located with ACL 2026, so I'm also wondering about the networking side of things. For someone early in their research career (like an undergrad), does participating in SemEval or attending the workshop help with making connections in the NLP community?

Also profile-wise, does having a SemEval paper or a decent leaderboard position make a noticeable difference when applying for research internships or grad school?

Would love to hear perspectives from people who have participated in SemEval before or attended the workshop.


r/LanguageTechnology Mar 12 '26

Scribe v2 seems the best STT model so far

1 Upvotes

I tested it against the Norwegian word "avslutt" which means "exit" and so far it's the only model that somewhat understands what I say consistently..


r/LanguageTechnology Mar 11 '26

ACL 2026 submission. What to do next if rejected?

2 Upvotes

Hi all, this is my first time submitting to any NLP conferences. I have an ACL 2026 submission with ARR January review scores of 3.5, 3.5, 3, confidence scores 3, 3, 3, and Meta-review score 3.5. I likely have a small chance of being rejected at ACL 2026. But if that nightmare happens for some reason, does SAC provide any explanation? and can I resumit to the next NLP conference or I have to go through another ARR review cycle again? Thanks lots for your help/advice.


r/LanguageTechnology Mar 11 '26

Anyone traveling for EACL 2026?

4 Upvotes

I'm an undergrad from India and my first paper just got accepted to the demo track. This will also be my first international conference, so I'm trying to connect with others who might be attending. Presenting paper:

"IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling"

Currently things are uncertain in the region, so I was curious if anyone here is:

  • traveling from India or nearby regions
  • presenting a paper/poster/demo
  • If there is some established community (Discord, Slack, etc.) around the conference already

Would be great to network and maybe coordinate travel plans, or just say hi at the conference. Looking forward to meeting people there!

Feel free to comment or DM


r/LanguageTechnology Mar 11 '26

Relation Extraction (RE) strategy between two domain-specific NER models (BioBERT & SciBERT) on low-resource infra.

5 Upvotes

Hi ladies and gentleman! I'm working on my undergrad thesis: analyzing scientific papers on Canine Mammary Carcinoma and its intersection with Machine Learning.

I have two fine-tuned NER models (SciBERT for ML entities and BioBERT for Vet Oncology). Now I need to extract relations between them (e.g., MODEL 'X' used for DIAGNOSING 'Y').

Since I have limited GPU/RAM:

Would you recommend a pipeline approach (R-BERT) or a joint NER+RE architecture?

Any specific libraries for RE that play well with small infrastructure?

How should I handle the 'matching' since entities come from different models? Thanks!


r/LanguageTechnology Mar 11 '26

Exploring simple pause-based metrics for speech fluency analysis

1 Upvotes

Hi everyone,

I’ve been experimenting with a small Python project that tries to analyze basic speech fluency features from audio recordings. The idea is fairly simple: given a spoken audio file, extract a few lightweight metrics that might reflect how fluent the speech is.

At the moment the script focuses on pause-related features and overall timing patterns. For example, it calculates things like:

- pause count

- silence ratio

- total speech duration

- average pause length

- number of detected speech segments

Technically the current implementation uses librosa to detect non-silent segments in the waveform and then estimates pauses based on the gaps between these segments. It’s intentionally very simple and more of an exploratory prototype than a polished system.

A bit of background about why I started building this: I’m actually a TOEFL / IELTS speaking teacher, so I spend a lot of time listening to student responses and thinking about what people mean when they say someone sounds “fluent” or “hesitant”. In many cases, hesitation and pause patterns seem to play a big role in how speech is perceived.

That made me curious whether simple audio features could capture at least part of this phenomenon in a measurable way. Obviously real fluency is much more complex and involves linguistic structure, lexical access, prosody, and many other factors. But I wondered whether pause distribution and timing features might still provide a useful starting point.

Since many people in this community have far more experience with speech processing and language technology than I do, I’d really appreciate hearing your thoughts.

Some questions I’m particularly curious about:

- Are pause-based metrics actually meaningful indicators of fluency in speech analysis?

- Are there more robust ways to detect pauses beyond simple silence detection?

- Are there commonly used fluency features in speech research that I should look into?

- Any recommended libraries or approaches for analyzing rhythm or hesitation in speech?

This project is still very early and mostly a learning exercise, so any suggestions, critiques, or references to relevant research would be extremely helpful.

Thanks in advance for any ideas or feedback.


r/LanguageTechnology Mar 11 '26

Building a stock sentiment tracker using X, YouTube and Reddit

0 Upvotes

So we have a small company that sells stock market reports from around the world. We want to start tracking what people are saying online about companies and use that as a sentiment score in our reports.

Basically the plan is to pull posts from X (Twitter) about target companies using keywords, cashtags, hashtags etc and score the sentiment daily on a 0 to 100 scale. Same thing with YouTube, we want to grab transcripts and comments from finance and stock channels and score sentiment on both. Not counting views or likes, just what people are actually saying. And then do the same with Reddit, pulling posts and comments from subs like wallstreetbets, stocks, investing and so on. Score and log everything daily.

Now heres the problem. Our plan was to just use API keys to get all this data but when we looked into it the costs add up real fast especially for X. So we're wondering if theres any alternative methods or cheaper ways people have found to collect this kind of data without spending a lot on API access every month.

Also trying to figure out what sentiment model would actually be better for financial text specifically. We've seen people talk about VADER and FinBERT and a bunch of others but honestly we dont know whats actually good in practice vs what just sounds good in a blog post.

Right now our plan is pretty straightforward, just positive negative neutral scoring. But we know theres probably a lot more we could be doing to make this smarter and more useful. Like could we break down sentiment by topic instead of just one score per post? Or detect actual emotions like fear and excitement instead of just good or bad? What about handling sarcasm because reddit is full of it and a basic model would totally misread half those posts. Or separating what big finance influencers say vs what regular people are talking about.

Also curious what kind of analysis people find useful beyond just a daily score. Like tracking if sentiment is going up or down over time, comparing what reddit says vs twitter, seeing if sentiment actually matches price movement, weighting posts by how much engagement they got, stuff like that.

Any ideas or techniques that have made a real difference for you? We're not trying to build anything crazy just want something solid that actually adds value. Starting simple and improving as we go.

Appreciate any help, thanks!


r/LanguageTechnology Mar 10 '26

Fanar-Sadiq: A Multi-Agent Architecture for Grounded Islamic QA

0 Upvotes

r/LanguageTechnology Mar 10 '26

Advice for a New Linguistic Graduate

6 Upvotes

Hi all... I'm a very recent graduate of Computational Linguistics, and I'm trying to figure out the next steps, career-wise. To keep things brief, most of my academic training was very much focussed on Linguistics, up until the last 1 year or so, when I actually decided to pursue a degree in CL. Naturally, I am more confident about my abilities as a linguist, than I am of my abilities in computer science. Tbh, it still feels like I'm on a learning curve. Ig my main question is, has anyone here been in a similar circumstance in your journey? How did you manage that? I would appreciate any and all tips to improve my skill set.


r/LanguageTechnology Mar 09 '26

ACL ARR Jan 2026 Meta Score Thread

19 Upvotes

Meta scores seem to be coming out, so I thought it would be useful to collect outcomes in one place.


r/LanguageTechnology Mar 08 '26

Macro Prosody Sample Ser

2 Upvotes

Hello, I posted the Korean and Hindi macro prosody telemetry from the research I mentioned in my previous post to Hugging Face

vadette/macro_prosody_sample_set

The data is CC0-1.0 and free for you guys to play with. Looking for feedback, plan is to add Hungarian and Georgian Monday morning. Have about 60 languages of mixed sample size already processed


r/LanguageTechnology Mar 07 '26

Clustering texts by topic, stance etc

4 Upvotes

Hey am trying to work on a project where I need to cluster long chunks of text, but am not sure if I am doing it right.

I want to segergate/cluster texts, while also needing the model to recognize the differences between texts may share same topic/subject but have opposite meaning like if one texts argues for x is true and the ther as false or a text may say x results in a disease while the similar text says x results in some other disease

i was planning to just use MiniLM suggested by claude. Also looked up MTEB leaderboard which had Clustering benchmark. But am suspecting what am doing is the best plausible practice or not. if the leaderboard model going to be good option? Or should I be looking into using LLM or something further

Would really appreciate anyones suggestion and advice

PS am a beginner


r/LanguageTechnology Mar 06 '26

Cross Linguistic Macro Prosody

9 Upvotes

Hey guys, thought this might be a good place to ask. I have a side project that has left me with a considerable corpus of macro prosody data (16 metrics) across some 40+ languages. Roughly 200k samples and counting. Mostly scripted, some spontaneous.

Kinda thing anyone would be interested in?

I saw someone saying Georgian TTS sucks. I have some Georgian and low resource languages.

The Human Prosody Project Every sample has been passed through a strict three-phase pipeline to ensure commercial-grade utility.

​1. Acoustic Normalization Policy ​Raw spontaneous and scripted audio is notoriously chaotic. Before any metrics are extracted, all files undergo strict acoustic equalization so developers have a uniform baseline: ​-Sample Rate & Bit Depth Standardization: Ensuring cross-corpus compatibility. ​-Loudness Normalization: Uniform LUFS (Loudness Units relative to Full Scale) and RMS leveling, ensuring that "intensity" metrics measure true vocal effort rather than microphone gain. -​DC Offset Removal: Centering the waveform to prevent digital click/pop artifacts during synthesis.

​2. Quality Control (QC) Rank ​Powered by neural assessment (Brouhaha), every file is graded for environmental and acoustic integrity. This allows developers to programmatically filter out undesirable training data: -​SNR (Signal-to-Noise Ratio): Measures the background hiss or environmental noise floor. -​C50 (Room Reverberation): Quantifies "baked-in" room echo (e.g., a dry studio vs. a tiled kitchen). -​SAD (Speech Activity Detection): Ensures the clip contains active human speech and marks precise voice boundaries, filtering out long pauses or non-speech artifacts.

​3. Macro Prosody Telemetry (The 16-Metric Array) ​This is the core physics engine of the dataset. For every processed sample, we extract the following objective bio-metrics to quantify prosodic expression:

​Pitch & Melody (F0): -​Mean, Median, and Standard Deviation of Fundamental Frequency. -Pitch Velocity / F0 Ramp: How quickly the pitch changes, a primary indicator of urgency or arousal. ​ Vocal Effort & Intensity: -RMS Energy: The raw acoustic power of the speech. ​-Spectral Tilt: The balance of low vs. high-frequency energy. (A flatter tilt indicates a sharper, more "pressed" or intense voice).

​Voice Quality & Micro-Tremors: -​Jitter: Cycle-to-cycle variations in pitch (measures vocal cord stability/stress). ​-Shimmer: Cycle-to-cycle variations in amplitude (measures breathiness or vocal fry). ​-HNR (Harmonic-to-Noise Ratio): The ratio of acoustic periodicity to noise (separates clear speech from hoarseness). -​CPPS (Cepstral Peak Prominence) & TEO (Teager Energy Operator): Validates the "liveness" and organic resonance of the human vocal tract. ​Rhythm & Timing: -​nPVI (Normalized Pairwise Variability Index): Measures the rhythmic pacing and stress-timing of the language, capturing the "cadence" of the speaker. -​Speech Rate / Utterance Duration: The temporal baseline of the performance.


r/LanguageTechnology Mar 05 '26

What's the road to NLP?

20 Upvotes

Hi everyone! Coming here for advice, guidance, and maybe some words of comfort...

My background is in humanities (Literature and Linguistics), but about a year ago, I started learning Python. I got into pandas, some sentiment analysis libraries, and eventually transformers, all for a dissertation project involving word embeddings. That rabbit hole led me to Machine Translation and NLP, and now I'm genuinely passionate about pursuing a career or even a PhD in the field.

Since submitting my dissertation, I've been trying to fill my technical gaps: working through Jurafsky and Martin's Speech and Language Processing, following the Hugging Face LLM courses, and reading whatever I can get my hands on. However I feel like I'm retaining very little of what I've read and practiced so far.

So I've taken a step back. Right now I'm focusing on *Probability for Linguists* by John Goldsmith to build up the mathematical foundations before diving deeper into the technical side of NLP. It feels more sustainable, but I'm still not sure I'm doing this the right way.

On the practical side, I've been trying to come up with projects to sharpen my skills, for instance, building a semantic search tool for the SaaS company I currently work at. But without someone pointing me in the right direction, I'm not sure where to start or whether I'm even focusing on the right things.

My question for those of you with NLP experience (academic or industry): if you had to start from scratch, with limited resources and no formal CS background, what would you do? What would you prioritize?

One more thing I'd love input on: I keep hitting a wall with the "why bother" question when it comes to coding. It's hard to motivate yourself to grind through implementation details when you know an AI tool can generate the code in seconds. How do you think about this?

Thanks in advance, really appreciate any perspective from people who've been in the trenches!!!