Solr

Solr
Name	Solr
Developer	Apache Software Foundation
Initial release	2004
Programming language	Java
Operating system	Cross-platform
License	Apache License 2.0

Solr is an open-source enterprise search platform developed for high-performance, full-text search, faceted navigation, real-time indexing, and distributed querying. It originated from a project by a commercial company and later became a top-level project of a major open-source organization, receiving contributions from a wide ecosystem of companies and researchers. Solr is implemented in Java and commonly deployed in data centers, cloud platforms, and on-premises clusters.

Overview

Solr was created to provide scalable search capabilities for large collections such as those handled by Google, Yahoo!, Amazon (company), Microsoft, Facebook, and Twitter. Influential projects and technologies related to its evolution include Apache Lucene, Hadoop, Apache Cassandra, MongoDB, PostgreSQL, MySQL, and Elasticsearch. Contributors and adopters range from academic institutions like Stanford University, Massachusetts Institute of Technology, University of California, Berkeley, and Carnegie Mellon University to enterprises such as IBM, Oracle Corporation, Intel, Netflix, and LinkedIn. Solr interoperates with tooling from vendors and open-source initiatives including Kubernetes, Docker, Ansible, Puppet, Chef (software), Amazon Web Services, Google Cloud Platform, and Microsoft Azure.

Architecture

Solr's architecture builds on core components originated by Apache Lucene and integrates with distributed systems and orchestration tools like ZooKeeper and Kubernetes. Its core process model runs on the Java Virtual Machine, leveraging libraries from Apache Commons and patterns common to Spring Framework and Guava (software). Storage and replication strategies can be aligned with backends such as Apache Zookeeper, Apache Kafka, Cassandra, HBase, and Redis, while schema management and configuration often reference standards from XML, JSON, and YAML. Operational monitoring and observability commonly use stacks including Prometheus, Grafana, ELK Stack, Splunk, and Nagios.

Indexing and Querying

Indexing pipelines often integrate with extractors and parsers such as Apache Tika, Logstash, and Fluentd, and with ingestion systems like Apache NiFi, Kafka Connect, and AWS Kinesis. Querying patterns borrow from information retrieval research by groups at Stanford University, CMU, Princeton University, and University College London, and can implement ranking models related to work by scholars associated with TREC, ACL (association), and SIGIR. Query-time features often interoperate with relevancy tuning tools used by teams at Spotify, eBay, Airbnb, and Uber (company), while advanced analytics tie into libraries such as Apache Mahout, Scikit-learn, TensorFlow, and PyTorch.

Features and Extensions

Solr supports faceting, highlighting, spell checking, suggestions, and geospatial search, with extensions and plugins developed alongside projects like Lucene.NET, Nutch, OpenSearch, and SIREn. Ecosystem components and connectors provided by commercial and open-source vendors include integrations for Salesforce, SAP, ServiceNow, Drupal, and WordPress. Security and authentication in Solr deployments are often integrated with OAuth, LDAP, Kerberos, and identity providers such as Okta, Ping Identity, and Keycloak. Performance and query optimization frequently use tools and patterns from Google BigQuery, Presto (software), Apache Spark, and Druid.

Deployment and Scaling

Clustered deployments use orchestration and service discovery from Kubernetes, Docker Swarm, and Apache Mesos, and may rely on coordination systems like Apache ZooKeeper and etcd. Storage strategies and data lifecycle integration align with object stores and filesystems such as Amazon S3, Google Cloud Storage, HDFS, and Ceph. Enterprises integrate Solr into CI/CD pipelines using Jenkins, GitLab CI/CD, GitHub Actions, and machinery from Bamboo (Atlassian). Large-scale operators include companies such as Twitter, Pinterest, Bloomberg L.P., Comcast, and Walmart.

Use Cases and Integrations

Common use cases include site search for platforms like eBay, Etsy, Walmart, and Alibaba Group, enterprise search for organizations such as NASA, European Space Agency, World Health Organization, and United Nations, and log or metrics indexing for observability stacks used by Uber, Airbnb, and Lyft. Solr is integrated into content management and digital asset workflows with systems like Adobe Experience Manager, Drupal, Joomla!, and Contentful. Vertical applications span legal discovery for firms linked with LexisNexis and Thomson Reuters, biomedical literature search used by PubMed and European Bioinformatics Institute, and e-discovery in compliance workflows at institutions such as Goldman Sachs and JPMorgan Chase.

Category:Search engines