Solr committers Anshum Gupta and Tim Potter tell us about the upcoming Solr 5 release. We discuss making Solr “easy to start, easy to finish” while continuing to add improvements and stability for experienced users. Hear more about SolrCloud hardening, clusterstate improvements, the schema and solrconfig APIs, easier ZooKeeper management, improved flexible and schemaless indexing, and overall ease-of-use improvements.
In this episode Solr committer, Shalin Mangar, discusses the CAP theorem (Consistency, Availability,
Partition tolerance) and the durability of SolrCloud in the face of
network partitions and other service interruptions typical of
distributed systems. In particular, Shalin describes his work in testing
Solr and ZooKeeper with Jepsen, a framework built in Clojure by Kyle Kingsbury to “[break] distributed systems so you don’t have to”. Tune in
to learn about how SolrCloud handles the hazards of distributed
computing as a highly scalable, fault-tolerant search and NoSQL engine.
Lucene/Solr Committers Steve Rowe and Tim Potter
are back on SolrCluster to discuss how Lucidworks and the community are
making changes and improvements to Solr to increase usability and add
ease to the getting started experience. Steve and Tim discuss new
features such as data-driven schema, start-up scripts, launching
SolrCloud, and more.
This week, the SolrCluster team is joined by Rishi Easwaran
from the AOL mail team. AOL has been known for their large-scale Solr
deployment, with over 150B documents and 1.2B searches per day. Rishi
shares AOL’s reasons for choosing Solr for mail search, an overview of
their multicore architecture before migrating to SolrCloud, and their
new hybrid SolrCloud architecture, its performance, scalability, cost
benefits, and lessons learned throughout the process.
Rishi is a principal software engineer at AOL. He has worked with the
AOL mail team since 2008, as the tech lead for the existing mail search
infrastructure and re-architecture efforts to implement a multi-tiered
high availability, large scale hybrid SolrCloud solution. Over the
years, his entire team has focused on performance, availability, and
scalability of Solr. In efforts to accomplish this, they’ve delved into
the source code [...]
Steve Rowe, Lucene/Solr Committer, PMC Member and Lucidworks Sr. Engineer, joins the SolrCluster team for a follow up discussion to the webinar
he was recently featured in. Steve talks about how Solr 4 has evolved
since its release in 2012, some of the major features and changes in
4.7, 4.8 and 4.9, and the trajectory of future Solr releases. Steve also
gives insight into what he’s been working on for Lucidworks, side
projects he’s involved in and what he’s excited about.
See the “What’s New in Solr” webinar replay here.
Find out more about Steve’s side project, JFlex, here.
Check out the Solr Reference Guide
This week, we have Tim Potter, Senior Engineer at Lucidworks, Solr Committer and co-author of Solr in Action, back on the show. Tim shares with us his experience working with Solr at scale, and what led to the recent development of the Solr Scale Toolkit.
The Solr Scale Toolkit is an open source project, sponsored by
Lucidworks, which provides tools and guidance for deploying and managing
SolrCloud in cloud-based platforms such as Amazon EC2.
Read Tim’s recent blog post, Introducing the Solr Scale Toolkit.Download the Solr Scale Toolkit from GitHub her [...]
On this week’s episode of SolrCluster, the team talks about Project Blacklight—an open source, front-end, discovery interface for Apache Solr—and how Blacklight is now a part of Project Hydra,
a collaboration to help institutions around the world preserve,
maintain and give access to their knowledge repositories and assets. Bess Sadler
from the Stanford University Digital Library, a co-founder of Project
Blacklight, joins us to discuss her involvement in the project, her
vision for its future use and what she’s working on now.
Bess Sadler is the Manager for Application Development in the Digital
Library Systems group at Stanford University Library. She is one of the
co-founders of Project Blacklight and Project Hydra, two open source
software projects which are widely [...]
This week on SolrCluster, we are joined by Ravi Mynampaty and Katia Muser from Harvard Business School (HBS). Ravi and Katia share with us their experience migrating the Harvard Business School Alumni Website from Endeca to Lucidworks Search,
Lucidworks’ commercial distribution of Solr. They explain how choosing
the Solr approach saved them a ton of custom development and enabled
them to offer end users features such as personalization, faceted search
and navigation of various types of content (e.g., people, events,
alumni stories) and autocomplete. The HBS search team chose Lucidworks
Search because of the admin UI and ability to prototype very quickly.
Members of the search team who did not have pre [...]
This week, the SolrCluster crew is joined by Lucidworks Chief of Product, Will Hayes, and Sematext Founder & President, Otis Gospodnetić.
Working with Solr since its origin in 2006, Otis has a wealth of
experience around trends that have come about related to search and big
data technologies. Otis and Will discuss tools that Sematext has built
to help monitor Solr and other stacks, manage and analyze logs, and analyze search trends,
as well as the general direction that industry leaders are moving
toward around data acquisition and discovery as data increasingly grows.
Otis Gospodnetić is a co-author of Lucene in Action (1st
and 2nd editions). He has bee [...]
This week, the SolrCluster team is joined by Trey Grainger, Director of
Engineering for Search at CareerBuilder, and Timothy Potter, Lucene/Solr
Committer and Senior Engineer at Lucidworks, to discuss their recently
released co-authored book, Solr in Action. Solr in Action is a
comprehensive guide to implementing scalable search with Lucene/Solr,
based on the real-world applications that Tim and Trey have worked on
throughout the course of their careers in Solr. Tim and Trey share with
us the challenges they faced, accomplishments they achieved, and what
they learned in the process of co-authoring their first book.