Anaconda vs. Databricks Data Intelligence Platform

I have asked all my juniors to work with Anaconda and Pycharm only, as this is the best combination for now. Coming to use cases: 1. When you have multiple applications using multiple Python variants, it is a really good tool instead of Venv (I never like it). 2. If you have to work on multiple tools and you are someone who needs to work on data analytics, development, and machine learning, this is good. 3. If you have to work with both R and Python, then also this is a good tool, and it provides support for both.

Incentivized

Medium to Large data throughput shops will benefit the most from Databricks Spark processing. Smaller use cases may find the barrier to entry a bit too high for casual use cases. Some of the overhead to kicking off a Spark compute job can actually lead to your workloads taking longer, but past a certain point the performance returns cannot be beat.

Incentivized

• Anaconda is a one-stop destination for important data science and programming tools such as Jupyter, Spider, R etc.
• Anaconda command prompt gave flexibility to use and install multiple libraries in Python easily.
• Jupyter Notebook, a famous Anaconda product is still one of the best and easy to use product for students like me out there who want to practice coding without spending too much money.

Incentivized

• Process raw data in One Lake (S3) env to relational tables and views
• Share notebooks with our business analysts so that they can use the queries and generate value out of the data
• Try out PySpark and Spark SQL queries on raw data before using them in our Spark jobs
• Modern day ETL operations made easy using Databricks. Provide access mechanism for different set of customers

Incentivized

• It can have a cloud interface to store the work.
• Compatible for large size files.
• I used R Studio for building Machine Learning models, Many times when I tried to run the entire code together the software would crash. It would lead to loss of data and changes I made.

Incentivized

• Sometimes, when multiple jobs depend on each other in different environments, it is not always easy to see the full workflow in one place.
• It is sometimes difficult to determine which job or cluster contributes more to the overall cost.
• For beginners, cluster configuration may be a little difficult. So more recommendation in the platform can help.

Incentivized

It's really good at data processing, but needs to grow more in publishing in a way that a non-programmer can interact with. It also introduces confusion for programmers that are familiar with normal Python processes which are slightly different in Anaconda such as virtualenvs.

Incentivized

I am giving this rating because I have been using this tool since 2017, and I was in college at that time. Initially, I hesitated to use it as I was not very aware of the workings of Python and how difficult it is to manage its dependency from project to project. Anaconda really helped me with that. The first machine-learning model that I deployed on the Live server was with Anaconda only. It was so managed that I only installed libraries from the requirement.txt file, and it started working. There was no need to manually install cuda or tensor flow as it was a very difficult job at that time. Graphical data modeling also provides tools for it, and they can be easily saved to the system and used anywhere.

Incentivized

Because it is an amazing platform for designing experiments and delivering a deep dive analysis that requires execution of highly complex queries, as well as it allows to share the information and insights across the company with their shared workspaces, while keeping it secured.

in terms of graph generation and interaction it could improve their UI and UX

Incentivized

Anaconda provides fast support, and a large number of users moderate its online community. This enables any questions you may have to be answered in a timely fashion, regardless of the topic. The fact that it is based in a Python environment only adds to the size of the online community.

Incentivized

One of the best customer and technology support that I have ever experienced in my career. You pay for what you get and you get the Rolls Royce. It reminds me of the customer support of SAS in the 2000s when the tools were reaching some limits and their engineer wanted to know more about what we were doing, long before "data science" was even a name. Databricks truly embraces the partnership with their customer and help them on any given challenge.

I have experience using RStudio oustide of Anaconda. RStudio can be installed via anaconda, but I like to use RStudio separate from Anaconda when I am worin in R. I tend to use Anaconda for python and RStudio for working in R. Although installing libraries and packages can sometimes be tricky with both RStudio and Anaconda, I like installing R packages via RStudio. However, for anything python-related, Anaconda is my go to!

Incentivized

The most important differentiating factor for Databricks Lakehouse Platform from these other platforms is support for ACID transactions and the time travel feature. Also, native integration with managed MLflow is a plus. EMR, Cloudera, and Hortonworks are not as optimized when it comes to Spark Job Execution. Other platforms need to be self-managed, which is another huge hassle.

Incentivized

• It has helped our organization to work collectively faster by using Anaconda's collaborative capabilities and adding other collaboration tools over.
• By having an easy access and immediate use of libraries, developing times has decreased more than 20 %
• There's an enormous data scientist shortage. Since Anaconda is very easy to use, we have to be able to convert several professionals into the data scientist. This is especially true for an economist, and this my case. I convert myself to Data Scientist thanks to my econometrics knowledge applied with Anaconda.

Incentivized

• The ability to spin up a BIG Data platform with little infrastructure overhead allows us to focus on business value not admin
• DB has the ability to terminate/time out instances which helps manage cost.
• The ability to quickly access typical hard to build data scenarios easily is a strength.

Incentivized