Fraud Analytics in RapidMiner

This is a great video presentation on Fraud Analytics use case with RapidMiner. See my notes below.

##Some key concepts

  • More complex model, the lower the training error but higher test error.
  • Simple models are better, try explaining them to children.
  • Data Scientists understand the technical aspect, need to communicate results with analysts.
  • Sell results to businesses. Tie $ to the results.
  • Speak same language with business. Map performance metrics to business related figures.
  • AUC and recall doesn’t necessarily mean $ to the business, show how.
  • A/B testing method widely used in Marketing. Also consider a do nothing” model and compare with implementing data science solution.
  • Don’t fear sharing best practices and ideas with similar businesses.
  • Fraud model follows traditional validation method. 80% Training and 20% as Holdout.
  • Both training/holdout sets taken across same time period.
  • Handy trick, use sum of transactions as example weights. (this is cool)
  • Apply $ value to your true/false positive/negatives.
  • Compare with Default model (no model).
  • Generate a money plot!

##Some questions

  • How does this relate to regression?
  • If a simple model not good enough, how do you sell a complex one like Deep Learning?
  • Is it better to have the Data Science team be embedded in the Business Unit or as a separate team?
  • How do you try to explain the uncertainty of prediction intervals to business stakeholders?
  • How do you account for seasonal drift?
  • The model will drift overtime, should the model be updated or retrained over time?
  • Do you build a model to optimize business results or is it a byproduct of the prediction?
Up next Jupyter Notebooks Everywhere It would appear that many of the cloud providers are now leveraging Jupyter Notebooks. I predominately use them with Python (3.6+) and Julia but Bitcoin is in a bubble Precisely for what this guy is writing about. Bitcoin is not a bubble, contrary to the dishonest and non-factual claims of bank executives. There
Latest posts The Ye Old Blog List Motorola: Then and Now EWM Redux Testing for mean reversion with Python & developing simple VIX system - Talaikis unsorted - Tadas Talaikis Blog Steps to calculate centroids in cluster using K-means clustering algorithm - Data Science Central Basics of Statistical Mean Reversion Testing - QuantStart Algorithmic trading in less than 100 lines of Python code - O’Reilly Media Interpreting Machine Learning Models Microsoft the AI Powerhouse Investing in the S&P500 still beats AI Trading Microsoft makes a push to simplify machine learning | TechCrunch 10 Great Articles On Python Development — Hacker Noon Introduction to Keras Democratising Machine learning with H2O — Towards Data Science Getting started with Python datatable | Kaggle Phone Addiction Version 12 Launches Today! Machine Learning Making Pesto Tastier 5 Dangerous Things You Should Let Your Kids Do The Pyschology of Writing Investing in 2019 and beyond TensorFlow and High Level APIs Driving Marketing Performance with H2O Driverless AI Machine Learning and Data Munging in H2O Driverless AI with datatable Making AI Happen Without Getting Fired Latest Musings from a Traveling Sales Engineer The Night before H2O World 2019 Why Forex Trading is Frustrating Functional Programming in Python Automatic Feature Engineering with Driverless AI Ray Dalio's Pure Alpha Fund