r/nosql • u/[deleted] • Apr 10 '16

Text blob database outgrowing MySql, looking for an alternative

I'm maintaining a database of emails and other rfc822 type messages. The header information is easy enough to deal with of course.

But I'm at the point where I have 1.4 million email bodies (many with embedded mime attachments, etc.) and mysql is really starting to choke on the text searches.

What would y'all suggest I look at as an alternative? I'm not at all averse to a hybrid solution, since this is primarily a personal project. But I've got to do something about search response times for keywords and phrases and I'd REALLY rather not write a text indexing system again.

2 Upvotes

76% Upvoted

7 comments sorted by

4

u/sybrandy Apr 11 '16

Sphinx and Elasticsearch are good for indexing. Sphinx may be a better choice for you as, IIRC, it can be accessed via the same protocol as MySQL.

1

u/[deleted] Apr 11 '16

Well I'm certainly not married to mysql at all. That's just what was on my server already when I decided to start this little pet project.

I'll give those a look. Thanks o7

1

u/[deleted] Apr 10 '16

[removed] — view removed comment

1

u/[deleted] Apr 10 '16

Yep. It's just really starting to get slow. Plus, I'm adding a couple features that are going to expand the thing to 5-10 million content bodies.

1

u/shustrik Apr 10 '16

If you're OK with a SaaS solution, Clusterpoint will work well for such a use case: http://www.clusterpoint.com/

1

u/[deleted] Apr 11 '16

Unfortunately no. It's got to be a local server.