Amazon Simple Queue Service (SQS) vs. Apache Lucene

If you are looking to build something that just requires a simple queue service (as the name implies) this is great for it. You might look elsewhere though if you get into more complicated needs. This is also very well suited if you are already using other services with AWS and intend to fully build whatever you are building in AWS. If you are looking for a mixed environment -- SQS is not for you

Incentivized

Apache Lucene is a perfect text search implementation where the heap space usage needs to be kept to its minimal. It also enables search based on various search fields and most importantly the search and index process can happen simultaneously. The only scenario where it might be less appropriate would be when the index size grows too big. We have witnessed few scalable issues where the search would take a while when the index size is too large.

Incentivized

• It provides an always-available serverless queue for workflows or mission-critical processes.
• Is extremely low cost and overall costs to our environments have been negligible.

Incentivized

• We found Apache Lucene to be extremely performant in querying large amounts of data and retrieving the correct files based on the metadata provided.
• The online community offers great support for the product. Even though it is an open source tool, it is not difficult to find help online for it.
• When we were creating a proof of concept application, we found that the software worked just as well, while being run locally on a resource-limited PC.

Incentivized

• Almost all of the functionality has been covered by SQS, but they could improve the throughput time.
• Also, they could provide built-in Cloud Watch, so that we can easily configure it without any external efforts.

Incentivized

• User interface for setup and maintenance would be helpful.
• Easier cloud/cluster setup.
• Better, centralized documentation.

Incentivized

Online blogging and documentation for SQS is great. There are many examples of implementing it and if you look hard enough, more than likely there are examples that meet the exact case with which you are working

Incentivized

The most comparable products are RabbitMQ, and perhaps ActiveMQ. Until recently, AWS did not offer a managed ActiveMQ product. Running RabbitMQ will never be to my team's competitive advantage; we wanted a managed service.

Incentivized

The search and index performance of [Apache] Lucene is excellent and the quality of results is good, if not better. For implementing it with small scale applications it is a no brainer, Lucene is the best and most cost effective solution. Learning curve is not too steep either.

Incentivized

• Positive impact - time allocation towards different features
• Negative impact - too many resources dedicated towards debugging
• Positive impact - less manual labor during testing

Incentivized

• Being an open source project we did not have to pay any licensing fees for using Apache Lucene. It has greatly improved our search functionality in our web apps.

Incentivized