|||

Sentiment Analysis & RapidMiner

This year, in late October, Rapidminer released an update to their Wordnet Extension. Granted, it’s December and I’m just getting around to playing with it now, but this particular update incorporated the SentiWordnet dictionary as a new operator.

This is really cool because it gives Rapidminer a deeper access to the world of Opinion Mining. Rapidminer has always been able to do Sentiment Analysis from a statistical approach but accessing the realm of Opinion Mining always required you to call processes (i.e. Sentiwordnet) outside of Rapidminer and integrate them into the workflow.

So how do you use it? First you need to have the latest Wordnet Extension installed and download the latest Wordnet (3.0.0) dictionary onto your machine. When you process your text files, it will generate a new sentiment column with numerical attributes ranging from -1 to +1. What these values mean can best explained here.

Below are some screenshots of a simple Twitter process searching for iPhone6 tweets and generates sentiment based on the tweet itself.

Overall Process

2014-12-05-Senti_Image12014-12-05-Senti_Image1

The New SentiWordnet Operator

2014-12-05-Senti_Image22014-12-05-Senti_Image2

Results

2014-12-05-Senti_Image32014-12-05-Senti_Image3

Bear in mind, the results I show here are very rudimentary and Tweets are generally very messy. What you would need to do is evaluate the results and apply the appropriate ETL (i.e. remove Tweetbots) or modeling in another process, but you get the idea here. For another great look at the new SentiWordnet operator, check out this post by Andrew.

Up next Photos from Germany The Journey This has been truly an exciting year for @RapidMiner and I’m humbled that I’m part of the team. Working at RapidMiner is like embarking on a new
Latest posts The Ye Old Blog List Motorola: Then and Now EWM Redux Testing for mean reversion with Python & developing simple VIX system - Talaikis unsorted - Tadas Talaikis Blog Steps to calculate centroids in cluster using K-means clustering algorithm - Data Science Central Basics of Statistical Mean Reversion Testing - QuantStart Algorithmic trading in less than 100 lines of Python code - O’Reilly Media Interpreting Machine Learning Models Microsoft the AI Powerhouse Investing in the S&P500 still beats AI Trading Microsoft makes a push to simplify machine learning | TechCrunch 10 Great Articles On Python Development — Hacker Noon Introduction to Keras Democratising Machine learning with H2O — Towards Data Science Getting started with Python datatable | Kaggle Phone Addiction Version 12 Launches Today! Machine Learning Making Pesto Tastier 5 Dangerous Things You Should Let Your Kids Do The Pyschology of Writing Investing in 2019 and beyond TensorFlow and High Level APIs Driving Marketing Performance with H2O Driverless AI Machine Learning and Data Munging in H2O Driverless AI with datatable Making AI Happen Without Getting Fired Latest Musings from a Traveling Sales Engineer The Night before H2O World 2019 Why Forex Trading is Frustrating Functional Programming in Python Automatic Feature Engineering with Driverless AI Ray Dalio's Pure Alpha Fund