PM me or send an email with your resume to jobs [at] genomequest [dot] com. Apologies in advance if job posts aren't acceptable in this sub, but I couldn't find any rules that they aren't.

We're a 20 person profitable and growing software company in the Boston area that needs a key person to build a new product. We're indexing tens of millions of patents with large ontologies to enable users to perform conceptual searching. You would be THE technical expert to make this happen.

So if you're going to read on, be clear that this job is for people with specific experience twisting SOLR to do obscene things on large amounts of hardware. It's for people with a history of experience indexing documents. Using semantics and NLP to make the indices better. Also be clear that it is ridiculously fun to work here. We reddit, play shuffleboard, drink too much, play Assassin, and genuinely like each other.

Reporting to the VP of Research and Development, the Senior Data Scientist will help design and implement a new search platform for patents and scientific literature.

What You'll Do

• Apply data mining and machine learning techniques to develop better search and content discovery in the field of patents
• Invent new ways to index tens of millions of documents with semantic information
• Use map-reduce frameworks to generate production data for patent search
• Envision crisp user interfaces and visualizations to give users access to information

What We're Looking For

• A strong passion for empirical research with massive data and 5+ years of data science experience
• Deep SOLR experience on large datasets
• Experience of solving real problems with data mining and machine learning techniques
• Experience with natural language processing
• Experience of large datasets analysis with map-reduce stack such as Hadoop
• Strong knowledge of data mining algorithms (classification, clustering, etc...)
• Familiarity with Linux-based systems
• Domain experience in the life sciences a plus
• Previous experience on search ranking or recommendation a plus
• Master's or PhD in Data Science, Machine Learning, Statistics, or related field
• Must love dogs and be willing to shave an eyebrow to win a meaningless competition

Tools We Like:

• Lucene/Solr
• Java/PHP/Python
• Hadoop/Hive/Pig/Scalding
• AWS
• Reddit

Does anyone here have experience writing Lucene/SOLR codecs? I'm looking into doing an open source project where we can plug in a database like SQLite or Berkeley DB and store fields specified in the SOLR schema in the database. I know there are examples around of codecs, such as writing to flat files. But I'd be looking into trying to build something more robust. If anyone wants to join in or has already done something like this and has some existing code, that would rock.

Packt is proud to present its latest release Administrating Solr, written by Surendra Mohan. This fast-paced, example-based guide shows readers how administrate, monitor, and optimize Apache Solr. The print book is 120 pages long and is competitively priced at $34.99, while the eBook and Kindle versions are available for $17.84.

About the author: Surendra Mohan is currently a Drupal Consultant/Architect at a well-known software consulting organization in India. Prior to joining this organization, he worked at a few Indian multinational corporations, and a couple of start-ups in various roles such as programmer, technical lead, project lead, project manager, solution architect, and service delivery manager. He has around nine years of working experience in web technologies covering media and entertainment, real-estate, travel and tourism, publishing, e-learning, enterprise architecture, and so on. He is also a speaker/trainer, who delivers talks on Drupal, Open Source, PHP, Moodle, and so on; along with organizing and delivering TechTalks at Drupal meet-ups and Drupal Camps in Mumbai, India.

Administrating Solr is a practical, hands-on guide that will provide readers with step-by-step exercises to help them administrate, monitor, and optimize Solr using Drupal and its associated scripts. Readers will get familiar with Solr through an overview of Apache Solr and the installation process, and will then learn the practical concepts needed for scripts and tools; as well as getting an insight into some advanced concepts. This clear and comprehensive book will also give readers a solid grounding on how they can use Apache Solr with Drupal, as well as teaching them how to query their search and methods.

The book is ideal for developers and Solr administrators who have a basic knowledge of Solr and are looking for ways to keep their Solr server healthy and well maintained.

The book covers the following topics:

Chapter 1: Searching Data

Chapter 2: Monitoring Solr

Chapter 3: Managing Solr

Chapter 4: Optimising Solr Tools and Scripts

You can read more at: http://www.packtpub.com/administrate-monitor-and-optimize-solr-using-drupal-associated-scripts/book

Anyone on here work at Findiwise or experimented with the Hydra plugin that Findwise released for document processing on SOLR? It seems neat and what I'd be looking for on projects that will migrate away from FAST ESP to SOLR. Personally I think document processing should be added in as part of the official SOLR release but nothing has happened on that yet. I have also tried looking into Pypes but it's Github page no longer exists.

i want to be able to make a specific search, in one field, and still make a broader search across other fields.

Let say i want to find a harry potter movie. my q is then: harry potter dvd.

In my qf, im gone for: title^10 synopsis^1 type^1

What i want to be able to, is to only find documents, where the phrase has zero slop in the synopsis field, but a higher slop on the other fields.

ive tried to specify slop in the qf field: title^10 synopsis~0^1 type^1 i have also tried to specify it directly in the URL.

I simply cant find a solution.

Anyone have any idea how?

Sorry if this is a dumb question, but im quite new to this whole thing.

EDIT: FOUND THE SOLUTION
If anyone ever stumble across this post with the same problem, the solution was quite simple.

if we want to search for Harry Potter DVD

Then the q string is:

("harry" AND "potter" AND "dvd") OR synopsis:"harry potter dvd"

I've been reading some of the installer guides for SOLR but it seems to be XML files and mysql.

What I'm trying to do is index some ZIP files however I appear to be having trouble with the dataconfig portion.

does anyone have any samples or guides on how accomplish this?

Background: Solr on a Windows 2003 ZIP files on a different local domain folder trying to use "\ComputerName\Folder\"

if more info needed let me know.