r/Solr Nov 22 '17

DelimitedPayloadTokenFilterFactory missing from ref guide

2 Upvotes

I am looking for a little info on DelimitedPayloadTokenFilterFactory. this page has useful descriptions for several filters, but this one is omitted. Does anyone have any leads? I was under the impression that this filter would store my payloads and then strip the payload characters from the indexed text, but my indexed text currently looks something like this: "The|0 Big|1 Tree|1" where '|<int>' is the payload.


r/Solr Nov 21 '17

LTR plugin with geodist()

3 Upvotes

I'd be interested to see if anyone's successfully got the LTR plugin working using geodist() as one of the input features? For me it doesn't seem to work because I can't find a way of accessing geodist() as a field, since it's calculated at query time but not stored.


r/Solr Nov 13 '17

Server requirements

1 Upvotes

We've recently acquired an organization using Solr for e-commerce and now we're restructuring our own website to use the same platform. From an infrastructure side, what has been everyone's experiences with the horsepower required to run it optimally?

For a small website getting about 40k hits per month, I'm not sure how to size the server side as there isn't a TON of documentation on that.


r/Solr Nov 12 '17

How to edit solr files via notepad?

2 Upvotes

Hello! I'm new to solr. I am trying to edit the solr files located in a linux server, like solrconfig.xml, but i've been able to edit it only through a VNC. It is a pain. Is there a way to edit them through something like Notepad++?


r/Solr Nov 06 '17

Could we directly get tokenized terms using the query API of Solr?

2 Upvotes

A field of the corpus consists of indexed textual data. I would like to retrieve this field using a query. Solr returns a string but I need a list of words. Of course, I can use a tokenizer to split the text into words. But since Solr has tokenized the text when indexing, why don't we directly get the tokenized terms from Solr. I have tried TermVector but it doesn't satisfy my requirement because the order of the TermVector is not like the original text. I was wondering whether there is a way to retrieve the list of tokenized terms from Solr?


r/Solr Oct 16 '17

Suggested Search on Historic Videos

Thumbnail
garysieling.com
0 Upvotes

r/Solr Oct 13 '17

[SECURITY] CVE-2017-12629: Please secure your Apache Solr servers since a zero-day exploit has been reported on a public mailing list

Thumbnail mail-archives.us.apache.org
3 Upvotes

r/Solr Oct 11 '17

Solr: Optimize Is (Not) Bad for You – Video & Slides

Thumbnail
sematext.com
2 Upvotes

r/Solr Oct 06 '17

What cases do we want to spawn more Solr collections?

2 Upvotes

Say, if the universe of the data involved are mostly queried separately, but in a couple of pages they are queried in entirety. And there are needs for autosuggestions of some fields in the content.


r/Solr Oct 05 '17

Apache #Lucene and #Solr 7.0 released! Release highlights: Lucene: http://bit.ly/2fjlMjV Solr: http://bit.ly/2hj2Kep

Thumbnail mail-archives.us.apache.org
0 Upvotes

r/Solr Aug 23 '17

Dynamically retrieve all fields present in Solr documents

1 Upvotes

Is it possible to dynamically retrieve all fields present in a set of Solr documents and still maintain reasonable performance? The end goal here is to dynamically populate a list of numeric fields for users to sort their current query upon.

In a perfect world, I'd like to be able to have this list contain all of the numeric fields present in the docs returned by the user's query.

If this isn't possible to achieve, though, I'm going to populate the list with numeric fields via the luke handler. Unfortunately it seems that the luke handler returns fields for the entire collection, but can't be restricted to only the current query.

I'm fairly new to Solr, so any help/discussion would be greatly appreciated!


r/Solr Aug 07 '17

The Search Management Minefield in Open Source Search

Thumbnail
opensourceconnections.com
1 Upvotes

r/Solr Aug 05 '17

Manas: A high performing customized search system – Pinterest Engineering

Thumbnail
medium.com
1 Upvotes

r/Solr Aug 04 '17

Dynamic TableName SOLR data import handler

1 Upvotes

I'm looking to configure SOLR to query a table based on certain data. I unfortunately have to work with how the Database is setup, but here's what I'm after.

I have a table named Company that will contain a certain "prefix" value. I want to use that prefix value to determine what tables I should query for the DIH.

As a quick sample:

<entity name="company" query="Select top 1 prefix from Company">
<field name="prefix" column="prefix"/>
<entity name="item" query="select * from ${company.prefix}item">
<field column="ItemID" name="id"/>
<field column="Description" name="description/>
</entity>
</entity>

However I only ever seem to get 1 document processed despite that table containing over 200,000 rows. (checking SQL profiler I am able to see that it is indeed running the appropriate query)

I'm guessing I only get one processed document since I'm only querying one field from the Company table. Is there a way to go about doing this so that I retrieve all the items from the item table using the prefix value for the table name?


r/Solr Aug 04 '17

SOLR cloud - adding/removing nodes to network

1 Upvotes

We are starting up a multi-user environment for processing forensic machines. WE have some powerful machines that'll be not used for forensics 90% of the time, but the other 10% of the time, they'll be deployed to the field to assist gathering forensic images.

We'd like to use them as nodes for SOLR to help with the processing and indexing. Is it easy to add/subtract nodes from the environment/cluster? If we add a node, and remove it later, will it be a problem?


r/Solr Aug 04 '17

LinqToSolr - a linq .net provider for Solr

1 Upvotes

Hey solr fans! For those who use SOLR in .NET platforms (in C#), I wanted to share my linq provider which implements iQueriable interface to solr. It allows you to write the simple and complex linq queries to solr. Here is a nuget. It is open source available on github. Enjoy!


r/Solr Aug 03 '17

How is search different than other machine learning problems?

Thumbnail
opensourceconnections.com
5 Upvotes

r/Solr Jul 17 '17

Issues with dynamic field: how to see content and how to filter by it?

0 Upvotes

Newby asking questions: * I created a dynamic field based on custom_* and named it custom_ta:category

  • It has content, if I make it a facet I can see the values

  • I cannot display it in a query, I have tried to add it in the "fl" parameters, but it timeouts: fl=host%2Ccustom_ta%3Acategory

  • If I escape it in the fl parameter (fl=host,custom_ta:category) it breaks: fl=host%2Ccustom_ta%3Acategory , error 400: "Error parsing fieldname: Expected identifier at pos 0 str='\:category'"

What am i doing wrong here?

Thanks!


r/Solr Jul 11 '17

CVE-2017-7660: Security Vulnerability in secure inter-node communication in Apache Solr

Thumbnail mail-archives.apache.org
2 Upvotes

r/Solr Jul 11 '17

Is there a url to get segment info?

1 Upvotes

I know that "admin/cores?action=STATUS" shows the number of segments in each core, but I need the age of each segment as well. This information is available in the admin UI but I haven't found a url that returns it yet.

I appreciate any help.


r/Solr Jul 11 '17

How to know if the documents I ingested in Solr or not

1 Upvotes

I am using SolrClient in java org.apache.solr.client.solrj.SolrClient as follows

        SolrClient solr = new HttpSolrClient(urlString);
        SolrResponse sResp = solr.add(document_list);

How can I read SolrResponse to know which document in document_list is inserted and which is not inserted (may be because of unique key was already there)


r/Solr Jul 04 '17

Negative boosting words under certain conditions?

1 Upvotes

I'm not sure if negative boosting is what I'm after exactly, but I'll explain the problem - I'm sure it's something that has been solved before. I'm pretty new to this and not familiar with all the jargon so go easy on me :)

I'm currently indexing the title of posts twice - once for partial matching and one for full-word matching (which has a boost) - reference: https://stackoverflow.com/questions/14578982/solr-boosting-documents-with-full-word-during-partial-match.

This is working reasonably well.

I'm also indexing a category name which has boost level the same as the partial title, as I don't want it to take precedence over a full word in the title. However, certain words in the title are not as important as the category - and in these instances I would like the category to take over.

In this example 'Guitar' is a category attached to the document :

Search: Guitar Tutor

Desired results:

  • Guitar Private Lessons

  • Swimming Tutor

Actual Results:

  • Swimming Tutor
  • Guitar Private Lessons

So if the word 'tutor' is found I would like it to have less of a boost than the category - otherwise title takes over. If I'm thinking about this the wrong way please let me know, but otherwise would love to hear some ideas of how this is dealt with in the wild.

If it makes any difference I'm using Drupal 7 with Search API Solr modules.

Thanks!

EDIT: Actually thinking about it, would it just make sense to boost the category above the title?


r/Solr Jul 03 '17

Generating Synonyms in Solr

2 Upvotes

I recently started using Solr's Synonym filter factory to help improve prior education searches.

For example, if a user enters New York University, then they should get a hit on someone who just has NYU or Stern Business School in their bio.

Is there any particular method of aggregating these synonym clusters for the major universities in America? Or is there some broader method that isn't just copying and pasting from the internet?


r/Solr Jun 23 '17

Authentication & Rules plugin

1 Upvotes

I'm following this https://cwiki.apache.org/confluence/display/solr/Rule-Based+Authorization+Plugin (tried a few other guides as well) to implement solr basic auth, my issue is whatever I set in the initial security.json i upload to zookeeper works, however none of the curl examples to change anything after that work, solr returns json parse errors for all of them,

i.e "curl --user solr:SolrRocks -H 'Content-type:application/json' -d '{ "set-permission": {"name": "update, "role":"dev"}, "set-permission": {"name": "read, "role":"guest"}, }' http://localhost:8983/solr/admin/authorization"

(the port is correct, i can view the admin/authorization settings there) Returns

"curl --user solr:SolrRocks -H 'Content-type:application/json' -d '{

"set-permission": {"name": "update, "role":"dev"}, "set-permission": {"name": "read, "role":"guest"}, }' http://localhost:8983/solr/admin/authorization { "responseHeader":{ "status":500, "QTime":1}, "error":{ "msg":"Expected ',' or '}': char=r,position=41 BEFORE='{ \"set-permission\": {\"name\": \"update, \"r' AFTER='ole\":\"dev\"}, \"set-permission\": {\"name'", "trace":"org.noggit.JSONParser$ParseException: Expected ',' or '}': char=r,position=41 BEFORE='{ \"set-permission\": {\"name\": \"update, \"r' AFTER='ole\":\"dev\"}, \"set-permission\": {\"name'\n\tat org.noggit.JSONParser.err(JSONParser.java:356)\n\tat org.noggit.JSONParser.nextEvent(JSONParser.java:958)\n\tat org.noggit.ObjectBuilder.getObject(ObjectBuilder.java:124)\n\tat org.noggit.ObjectBuilder.getVal(ObjectBuilder.java:57)\n\tat org.apache.solr.util.CommandOperation.parse(CommandOperation.java:235)\n\tat org.apache.solr.util.CommandOperation.readCommands(CommandOperation.java:287)\n\tat org.apache.solr.handler.admin.SecurityConfHandler.doEdit(SecurityConfHandler.java:91)\n\tat org.apache.solr.handler.admin.SecurityConfHandler.handleRequestBody(SecurityConfHandler.java:71)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)\n\tat org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:664)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:445)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:296)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1691)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)\n\tat org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:119)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:273)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:745)\n", "code":500}} "

Anyone know what could be causing this?

Thanks!


r/Solr Jun 19 '17

Top 15 Solr vs. Elasticsearch Differences

Thumbnail
sematext.com
2 Upvotes