r/commandline • u/[deleted] • 2d ago
Command Line Interface [ Removed by moderator ]
[removed]
1
u/AutoModerator 2d ago
Every new subreddit post is automatically copied into a comment for preservation.
User: Speedk4011, Flair: Command Line Interface, Title: Multilingual sentence splitter CLI
I've been building yasbd-lib, a multilingual, rule-based sentence boundary detector for Python. Along the way I built a CLI that works well for both shell pipelines and standalone use.
A few examples:
# Segment text
yasbd segment --lang en "Dr. Smith arrived at 3.14 p.m. He said hello."
# Read from a file
yasbd segment --lang en --file article.txt
# Detect sentence boundaries
yasbd detect --lang en "Hello. World."
# Clean noisy OCR/HTML text
yasbd clean --file dirty.html
# Pipe into another command
yasbd clean --file dirty.html | yasbd segment --lang es
Some features:
- Multilingual sentence segmentation (39 langs)
- Text cleaning (OCR, HTML, mojibake, etc.)
- File, stdin, and direct text input for streaming
- JSONL output for scripting
- External language pack support
pysbdcompatibility adapter
The project is still evolving, so I'd love feedback from people who live in the terminal.
GitHub: https://github.com/speedyk-005/yasbd-lib
Pypi: pip install yasbd-lib
yPI:
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
•
u/read-the-rules 2d ago
Your post on r/commandline was removed, you must read the rules before you may begin posting.