Dataiku vs. Jupyter Notebook vs. TensorFlow

Dataiku is an awesome tool for data scientists. It really makes our lives easier. It is also really good for non technical users to see and follow along with the process. I do think that people can fall into the trap of using it without any knowledge at all because so much is automated, but I dont think that is the fault of Dataiku.

Incentivized

I've created a number of daisy chain notebooks for different workflows, and every time, I create my workflows with other users in mind. Jupiter Notebook makes it very easy for me to outline my thought process in as granular a way as I want without using innumerable small. inline comments.

Incentivized

TensorFlow is great for most deep learning purposes. This is especially true in two domains: 1. Computer vision: image classification, object detection and image generation via generative adversarial networks 2. Natural language processing: text classification and generation. The good community support often means that a lot of off-the-shelf models can be used to prove a concept or test an idea quickly. That, and Google's promotion of Colab means that ideas can be shared quite freely. Training, visualizing and debugging models is very easy in TensorFlow, compared to other platforms (especially the good old Caffe days). In terms of productionizing, it's a bit of a mixed bag. In our case, most of our feature building is performed via Apache Spark. This means having to convert Parquet (columnar optimized) files to a TensorFlow friendly format i.e., protobufs. The lack of good JVM bindings mean that our projects end up being a mix of Python and Scala. This makes it hard to reuse some of the tooling and support we wrote in Scala. This is where MXNet shines better (though its Scala API could do with more work).

Incentivized

• Allows users to collaborate and monitor individual tasks
• Caters to both types of analysts, coders and non-coders, alike
• Integrate graphs and plots with visualization tools such as Tableau

Incentivized

• Simple and elegant code writing ability. Easier to understand the code that way.
• The ability to see the output after each step.
• The ability to use ton of library functions in Python.
• Easy-user friendly interface.

Incentivized

• A vast library of functions for all kinds of tasks - Text, Images, Tabular, Video etc.
• Amazing community helps developers obtain knowledge faster and get unblocked in this active development space.
• Integration of high-level libraries like Keras and Estimators make it really simple for a beginner to get started with neural network based models.

Incentivized

• The integrated windows of frontend and backend in web applications make it cumbersome for the developer.
• When dealing with multiple data flows, it becomes really confusing, though they have introduced a feature (Zones) to cater to this issue.
• Bundling, exporting, and importing projects sometimes create issues related to code environment. If the code environment is not available, at least the schema of the flow we should be able to import should be.

Incentivized

• Need more Hotkeys for creating a beautiful notebook. Sometimes we need to download other plugins which messes [with] its default settings.
• Not as powerful as IDE, which sometimes makes [the] job difficult and allows duplicate code as it get confusing when the number of lines increases. Need a feature where [an] error comes if duplicate code is found or [if a] developer tries the same function name.

Incentivized

• RNNs are still a bit lacking, compared to Theano.
• Cannot handle sequence inputs
• Theano is perhaps a bit faster and eats up less memory than TensorFlow on a given GPU, perhaps due to element-wise ops. Tensorflow wins for multi-GPU and “compilation” time.

The user experience is very good. Everything feels intuitive and "flows" (sorry excuse the pun) so nicely, and the customization level is also appropriate to the tool. Even as a newer data scientist, it felt easy to use and the explanations/tutorials were very good. The documentation is also at a good level

Incentivized

Jupyter is highly simplistic. It took me about 5 mins to install and create my first "hello world" without having to look for help. The UI has minimalist options and is quite intuitive for anyone to become a pro in no time. The lightweight nature makes it even more likeable.

Incentivized

Support of multiple components and ease of development.

Incentivized

The open source user community is friendly, helpful, and responsive, at times even outdoing commercial software vendors. Documentation is also top notch, and usually resolves issues without the need for human interactions. Great product design, with a focus on user experience, also makes platform use intuitive, thus reducing the need for explicit support.

Incentivized

I haven't had a need to contact support. However, all required help is out there in public forums.

Incentivized

Community support for TensorFlow is great. There's a huge community that truly loves the platform and there are many examples of development in TensorFlow. Often, when a new good technique is published, there will be a TensorFlow implementation not long after. This makes it quick to ally the latest techniques from academia straight to production-grade systems. Tooling around TensorFlow is also good. TensorBoard has been such a useful tool, I can't imagine how hard it would be to debug a deep neural network gone wrong without TensorBoard.

Incentivized

Use of cloud for better execution power is recommended.

Incentivized

Anaconda is mainly used by professional data scientists who have profound knowledge of Python coding, mainly used for building some new algorithm block or some optimization, then the module will be integrated into the Dataiku pipeline/workflow. While Dataiku can be used by even other kinds of users.

Incentivized

With Jupyter Notebook besides doing data analysis and performing complex visualizations you can also write machine learning algorithms with a long list of libraries that it supports. You can make better predictions, observations etc. with it which can help you achieve better business decisions and save cost to the company. It stacks up better as we know Python is more widely used than R in the industry and can be learnt easily. Unlike PyCharm jupyter notebooks can be used to make documentations and exported in a variety of formats.

Incentivized

Keras is built on top of TensorFlow, but it is much simpler to use and more Python style friendly, so if you don't want to focus on too many details or control and not focus on some advanced features, Keras is one of the best options, but as far as if you want to dig into more, for sure TensorFlow is the right choice

Incentivized

• Customer satisfaction
• Timely project delivery

Incentivized

• Positive impact: flexible implementation on any OS, for many common software languages
• Positive impact: straightforward duplication for adaptation of workflows for other projects
• Negative impact: sometimes encourages pigeonholing of data science work into notebooks versus extending code capability into software integration

Incentivized

• Learning is s bit difficult takes lot of time.
• Developing or implementing the whole neural network is time consuming with this, as you have to write everything.
• Once you have learned this, it make your job very easy of getting the good result.

Incentivized