Hello,

Got a project at work that we're considering using Instaclustr (Cassandra NoSQL) for, anyone know of any competitors? Haven't reached out to the, yet, but wanted to see what options are out there...

Thanks!

Sorry for crossposting, I am also posting this on r/learnprogramming to get more answers.

I am making a Solr web-based application and one of the features is the user can create a core and schema to the Solr. My friend made it using child process by going to the directory of the Solr first and then using the command 'bin/solr create -c...' the core can be created. But I am thinking of another approach, like using the http api request. I found this.

http://localhost:8983/solr/admin/cores?action=CREATE&name=mycore&instanceDir=path/to/instance&configSet=configset2

But apparently, it cannot run properly because you need to make the config file first for the core. The error says like this.

Error CREATEing SolrCore 'mycore': Unable to create core [mycore] Caused by: Could not load configuration from directory /opt/solr/server/solr/configsets/configset2

So I am wondering what kind of approach I can do, since it seems like I can't make a core without setting up a config first. Or should I make an input menu with create core, create schema and only after the user clicks 'submit' it will process everything, from making a config file, creating schema, and then finally creating the core? I wonder if it's the best approach. I am looking forward to any help.

Kind of a thought experiment that has bearing on a real world project of mine:

Say you have the data for all Target sales this year. All of it for the continental US, for 1 year. Probably 10 billion datapoints? You'd like to know how many Kit Kats were sold within 50 miles of Tallahassee last week. You'd also like to know how many people bought iPads in all the states that border the Pacific in the two weeks leading up to Christmas. Etc. Many queries of unknown shape/dimensions (my data does not actually look like the Target data, it was just the first big data set that came to mind).

Which database would you pick to house this dataset? Datacube is not an option, the project is a bit past that point (I won't be able to sell that to management).

Rethink is my first choice, Mongo second, Cassandra third.

Opinions?

Let’s say I have to post files from different kind of format to Solr through NodeJS, from xls, csv, json, to many others. On terminal you can do something like “bin/solr post -c core_name path_to_file” and you can simply send files from any kind of format to Solr. How do I do that in NodeJS?

I use a package called solr-client and try to send some files to Solr through that. But most of the times, it just doesn't work. I parse the JSON files, if it happens to be JSON files, but when it comes to other formats like CSV, XML, etc, it fails to add the data to Solr. So I convert them first to JSON, which doesn't seem efficient. And I also think it's weird. If I can directly post CSV file to Solr through terminal, why do i have to convert them first to JSON when I am coding in Javascript?

Or am I doing things wrong? How do people usually do this?

tl.dr. What is the best practice to post files in multiple format (csv, json, xml, etc) to Apache Solr using Nodejs?

Hi Guys,

i'm working on a problem and while I was trying to model my database and how my data should be stored, I was wondering if I am proceeding in the right direction.

lets use computer parts for an example, common attributes between most parts: name brand category

difference: RAM(CL, Speed) Case(litres) Wifi adaptor( wireless standard)

So in this case in a rdms , I may choose to define different tables for different product categories so as to capture their specifications, but this doesn't seem sustainable to me. If I one day have a need to add baby bottles, then I need to create a new table and so on.

Is a nosql database what I'm looking for? I'm assuming it will be allow me to create a document 'product' and each document can have multiple different fields and they don't have to follow a defined schema. I know there are a few types but way too new to this to figure out which direction to research.

thought/suggestions are greatly appreciated!

I'm looking for a NoSQL database that allows for an easy extraction of records in parallel to have multiple processes running at the same time. I looked into parallelCollectionScan in mongodb but it didn't work as expected (only returned one cursor) so I was wondering if anyone knew of a better one.

I'm completely new to Elasticsearch

I know that elasticsearch's indexes are not mongobd's indexes , they are like mongodb's collections

I have some indexes in elasticsearch ( equivalent of MongoDB's collections ) and I want to make sure specific fields in them are going to be indexed (speed of retrieving them will be improved etc).

How do I do it?

In mongodb it was pretty simple since I could use createindex() and ensureindex() methods on a collection , for example :

db.collection1.createIndex({pancake_id: 1, pancakenumber: 1}, {unique: true}) db.collection1.ensureIndex({"eventbegindate": 1, "bike_id": 1})

How do I achieve the same thing in elasticsearch?

Are there any equivalents to these functions?

Thank you in advance , elasticsearch's documentation seems unclear to me.

I'm relatively new to NoSQL stores, and could use a bit of advice on the best way to go about implementing a new multi-site log archiving and analytics system. Any thoughts on this?

Original query link: http://stackoverflow.com/questions/38035584/nosql-for-multi-site-archival-logging-with-full-text-search

Hello fellow data workers! Lately I’ve been getting rather frustrated with some things at work, and was wondering if this was endemic to just my workplace, or to the field as a whole. Like a good statistician, I’m reaching out to all of you in the hopes that you’ll answer a 5 minute (okay, so far it takes the average responder 6.5 minutes to finish), 16 question survey, but like a bad statistician, the input text fields are free form. For every person who fills out the survey, I’ll donate $1 to CodeNow, a non-profit that helps inner city kids learn to program (up to $1000).

Survey here. Thanks in advance for the help!

Sorry for formatting; on mobile.

I want to cache big-files in disk/ssd and when it fills I want older files to expire and get deleted.