Dataiku vs. pandas

Dataiku is an awesome tool for data scientists. It really makes our lives easier. It is also really good for non technical users to see and follow along with the process. I do think that people can fall into the trap of using it without any knowledge at all because so much is automated, but I dont think that is the fault of Dataiku.

Incentivized

Pandas are great for quick and relatively simple analytics and visualizations

Pandas work well for exploratory ad-hoc analytic work

But , We had little success in implementing complicated predictive analytics. And large data sizes can be a problem.

Incentivized

• Allows users to collaborate and monitor individual tasks
• Caters to both types of analysts, coders and non-coders, alike
• Integrate graphs and plots with visualization tools such as Tableau

Incentivized

• It is easy to do statistical analysis
• It is easy to clean the data
• It is easy to produce graphs and charts to visualize

Incentivized

• The integrated windows of frontend and backend in web applications make it cumbersome for the developer.
• When dealing with multiple data flows, it becomes really confusing, though they have introduced a feature (Zones) to cater to this issue.
• Bundling, exporting, and importing projects sometimes create issues related to code environment. If the code environment is not available, at least the schema of the flow we should be able to import should be.

Incentivized

• There are a lot of libraries and ways to do visualization. Sometimes it is very confusing.
• Error handling can be a challenge. Sometimes the error messages do not provide valuable clues for the debugging.
• In our case, there are a bunch of different frameworks and libraries working together. I would rather work with one framework, well tuned for my use case

Incentivized

The user experience is very good. Everything feels intuitive and "flows" (sorry excuse the pun) so nicely, and the customization level is also appropriate to the tool. Even as a newer data scientist, it felt easy to use and the explanations/tutorials were very good. The documentation is also at a good level

Incentivized

Over the years, we tried a lot of different frameworks and tools, homegrown and commercial. Pandas provide the best results.

It is lightweight, flexible and easy to implement.

Incentivized

The open source user community is friendly, helpful, and responsive, at times even outdoing commercial software vendors. Documentation is also top notch, and usually resolves issues without the need for human interactions. Great product design, with a focus on user experience, also makes platform use intuitive, thus reducing the need for explicit support.

Incentivized

Anaconda is mainly used by professional data scientists who have profound knowledge of Python coding, mainly used for building some new algorithm block or some optimization, then the module will be integrated into the Dataiku pipeline/workflow. While Dataiku can be used by even other kinds of users.

Incentivized

All these frameworks are great for gathering data and providing some initial analysis. But for real performance debugging work one needs more than tools provided by this tools. That's where the pandas excel.

Incentivized

• Customer satisfaction
• Timely project delivery

Incentivized

• Performance debugging was time consuming and mostly poorly automated exploratory process. Once we started use pandas for these tasks, it really moved the needle. Pandas are instrumental to provide actionable insights. As a result we were able to improve notably cloud software resource utilization and performance
• Analytics implemented with pandas allow us to detect and. address problems in our APIs before they are notable to our customers

Incentivized