Google Cloud Pub/Sub vs. SnapLogic

If you want to stream high volumes of data, be it for ETL streaming or event sourcing, Google Cloud Pub/Sub is your go-to tool. It's easy to learn, easy to observe its metrics and scales with ease without additional configuration so if you have more producers of consumers, all you need to do is to deploy on k8s your solutions so that you can perform autoscaling on your pods to adjust to the data volume. The DLQ is also very transparent and easy to configure. Your code will have no logic whatsoever regarding orchestrating pubsub, you just plug and play. However, if you are not in the Google Cloud Pub/Sub environment, you might have trouble or be most likely unable to use it since I think it's a product of Google Cloud.

Snaplogic is unique from other IPASS tools if you're very sensitive about data security as they have an on-premise option where your data never needs to leave your data center. And data pipelines can be quickly created if Snaplogic has the requisite connector to your data sources. On the downside, if you're transforming a large amount of data for example in training machine learning models, a tool with elastic compute capability is more appropriate.

• With a pub/sub architecture the consumer is decoupled in time from the publisher i.e. if the consumer goes down, it can replay any events that occurred during its downtime.
• It also allows consumer to throttle and batch incoming data providing much needed flexibility while working with multiple types of data sources
• A simple and easy to use UI on cloud console for setup and debugging
• It enables event-driven architectures and asynchronous parallel processing, while improving performance, reliability and scalability

Incentivized

• Easy access to any type of source system. Data could be in any format.
• Very beautiful visual representation of transforms that makes it super easy to use it by any non developer.
• It can be run in cloud or on-premise. helping you choose your comfort of security.
• Has pretty good customer support and have recently started their community forum as well.

Incentivized

• Would be nice if the queue could be extended beyond 7 days.
• We found it a bit tricky replay unacknowledged messages when needed.

Incentivized

• They need to have a way to connect to GitHub to allow the users to maintain their version control in GitHub. This is a missing functionality.
• As pipelines become complex, it's difficult to have all the snaps stitched together - just like to see it done differently.
• They do not have a way to start/stop a preview. This is hard to use, especially if you have to stop an accidental preview invocation.

Incentivized

It serves all of our purposes in the most transparent way I can imagine, after seeing other message queueing providers, I can only attest to its quality.

This has been hands down the BEST software company I have ever used and dealt with. I am a 25 year IT veteran at this college. They go above and beyond in soliciting our feedback/input and proactively follow up about bugs, issues, etc. I have given multiple potential clients my thoughts and after seeing the SL demo they all sign up. I appreciate their support model, it's REFRESHING!

Incentivized

It is easy to create Google Cloud Pub/Sub topics from both Web Console and CLI commands.

Google Cloud Pub/Sub supports creation of one or more subscriptions.

By supporting a BigQuery Pub/Sub subscription to automatically write to a BigQuery table it simplifies development by avoiding implementation of a custom micro service for writes to BigQuery.

Incentivized

It is very powerful but has a steep learning curve

Incentivized

I have never faced a single problem in 4 years.

It's very fast, can be even better if you use protobuf.

They have decent documentation, but you need to pay for support. We weren't able to answer all our questions with the documentation and didn't have time to setup support before we needed it so I can't give it a higher rating but I think it tends to be a bit slow unless you're a GCP enterprise support customer.

Incentivized

They can be prompt but they have not been as useful as I've wanted. We had a bug that affected many of our customers through an API connection between SnapLogic and our platform. Eventually they were able to figure it out, but it took a long time of negotiating between our engineering team and theirs. Additionally, we installed the SnapLogic groundplex for our customers and we've run into a bunch of problems of connectivity. If SnapLogic offered to be on those calls with our clients to troubleshoot how to fix these problems, I would give them a better grade here.

Incentivized

The groundplex in our VPC is very nice for security reasons and the SnapLogic team was extremely helpful during our implementation

Incentivized

Having used Amazon Web Services SNS & SQS I can say that even if the latter may offer more features, Google Cloud Pub/Sub is easier to use. On the other hand, usage of SNS & SQS as well as documentation and troubleshooting is easier with the AWS solution. Since we are not using GCP only for Pub/Sub the choice depends on other variables.

Incentivized

We opted for SnapLogic due its ease of use and the flexibility it offers, it was the platform that was strongest in both application integration and data integration and both were use cases we wanted to be able to cover.

You can just plug in consumers at will and it will respond, there's no need for further configuration or introducing new concepts. You have a queue, if it's slow, you plug in more consumers to process more messages: simple as that.

• Increased Efficiency with reliable and Google managed services up all the time wit Disaster Recovery in place as well
• Definitely Lower costs being a cloud based solution and easier to setup
• Faster Project delivery and go to market plan for the business use cases basis this technology at the back end

Incentivized

• We have cut development time down by at least 70%
• The software was more on the expensive side at renewal which required some further approvals to be sought for the spend
• More developers are able to build and use Snaplogic pipelines in their projects

Incentivized