IBM Streams

I use IBM Streaming Analytics as a data analytics tool for a graduate class for business students in my university's college of business. It is used as a tool to teach big data analysis for data in motion. These students have no prior programming experience. The tool offers a visual programming interface that is very intuitive to learn so the user can focus more on business applications. After only one tutorial session, students are able to use the tool in building an application for monitoring the bike distractions in the city of Chicago using DIVVY datasets. It is a part of a class business project for improving business shares and efficiency for DIVVY.

It is being used by more than one department. Able to look at streaming data and enrich information and store information. It helps with the problem of looking at live data and being able to filter and make calls. Like the ability to be able to read from various sources and be able to write to many as well.

Streams was considered for SENS IoT platform for analytics of real time data from mobile phones, WiFi access points and devices in Sensitel SENS platform. We used the on premise version and evaluated the cloud version as well.

I am currently working as a Data Analyst for ATG travel group. We are currently moving our database to IBM Cloud. I am using Streaming Analytics to pull the data from the cloud and manipulating the data to answer research questions. Streaming Analytics will also be able to help my company to make dashboards from the data that I will be using.

IBM Streaming Analytics is being used to analyze real time data. This is limited to the IT Department in analyses of logs and problem determination, analysis and resolution. Error logs are redirected to a stream of text DISK_ERRx (X, can be 1, 2, 3, or 4). Errors are either temporary or permanent. We are able to address the problem of determining and grouping errors into classes.

I used IBM Streams to design a lab at a university used for analyzing streaming data from IoT devices. The students had to implement signal processing algorithms using the IBM Streams API.

Clusterization and compaction of customer data; used mainly by the department responsible for data preprocessing before further analysis.

I'm using IBM DSx, which is now known as Watson Studio. Honestly speaking, this platform is updating quite often, which make it hard to learn all functions. IBM Streams is one of them and I haven't figured out all possibilities it got. And tutorials are rather hard to find and some tutorials are out of date. I hope there could be more tutorials for different application examples.

IBM Streams allows me to solve problems for my clients that would be difficult, impossible, or too expensive to do with other technologies. Most of the applications areas for which I have been applying it have been real-time in nature with a requirement for low end-to-end latency. Lately, a common use case has been to use Streams to ingest and transform incoming events into a form more suitable for storing for subsequent long-term analysis such as model training. For example, ingesting complex nested JSON documents and transforming and enriching that data into a flattened columnar format to be persisted in Spark, Event Store, Parquet files, etc. With this pattern, Streams is one element in an overall data processing pipeline where multiple technologies are optimally employed to do what they do best. Some of the features provided by the IBM Streams platform are particularly well suited for implementing dynamic microservices than can quickly be developed and deployed to provide valuable agility for evolving problem spaces.