Google Cloud Datastore vs. Qubole

I feel like Google Cloud Datastore is well suited when the data models are simple and the possible filtering and sorting operation are not complex. With more complex filtering, the amount of required indexes increase, and so does the costs.

Incentivized

I find Qubole is well suited for getting started analyzing data in the cloud without being locked in to a specific cloud vendor's tooling other than the underlying filesystem. Since the data itself is not isolated to any Qubole cluster, it can be easily be collected back into a cloud-vendor's specific tools for further analysis, therefore I find it complementary to any offerings such as Amazon EMR or Google DataProc.

Incentivized

• It is hosted in GCP, our primary cloud provider.
• It integrates with all the services we use in GCP.

Incentivized

• From a UI perspective, I find Qubole's closest comparison to Cloudera's HUE; it provides a one-stop shop for all data browsing and querying needs.
• Auto scaling groups and auto-terminating clusters provides cost savings for idle resources.
• Qubole fits itself well into the open-source data science market by providing a choice of tools that aren't tied to a specific cloud vendor.

Incentivized

• Part of the Google Cloud Platform walled garden.
• Pay for read/writes to the datastore, in addition to storage.
• Not many libraries exist.

Incentivized

• Providing an open selection of all cloud provider instance types with no explanation as to their ideal use cases causes too much confusion for new users setting up a new cluster. For example, not everyone knows that Amazon's R or X-series models are memory optimized, while the C and M-series are for general computation.
• I would like to see more ETL tools provided other than DistCP that allow one to move data between Hadoop Filesystems.
• From the cluster administration side, onboarding of new users for large companies seems troublesome, especially when trying to create individual cluster per team within the company. Having the ability to debug and share code/queries between users of other teams / clusters should also be possible.

Incentivized

I give Google Cloud a full score because it satisfies our needs so well. We host most of our infrastructure on Google Cloud and using Google Cloud Datastore helps us to solve our NoSQL storage problem. and Google Cloud Datastore is so scalable and elastic. It saves us lots of time to maintain and saves us money.

Incentivized

Personally, I have no issues using Amazon EMR with Hue and Zeppelin, for example, for data science and exploratory analysis. The benefits to using Qubole are that it offers additional tooling that may not be available in other cloud providers without manual installation and also offers auto-terminating instances and scaling groups.

Incentivized

The simple implementation, together with the Google Cloud dashboard that allows data inspection, editing and querying, makes Google Cloud Datastore a comprehensive choice when it comes to NoSQL databases.

Incentivized

If deploying an application in Google Cloud Platform, using Google Cloud Datastore is a no brainer because of the simplicity of setup. Other options would require more setup and configuration, and do not come with the same level of guaranteed uptime as Google Cloud Datastore. In our case, we've been using Google Cloud Datastore for 4 years without any issues and have never had to think about it.

Incentivized

Qubole was decided on by upper management rather than these competitive offerings. I find that Databricks has a better Spark offering compared to Qubole's Zeppelin notebooks.

Incentivized

• It solves our NoSQL database problem.
• It it highly scalable and available to meets our needs.

Incentivized

• We like to say that Qubole has allowed for "data democratization", meaning that each team is responsible for their own set of tooling and use cases rather than being limited by versions established by products such as Hortonworks HDP or Cloudera CDH
• One negative impact is that users have over-provisioned clusters without realizing it, and end up paying for it. When setting up a new cluster, there are too many choices to pick from, and data scientists may not understand the instance types or hardware specs for the datasets they need to operate on.

Incentivized