Neural Market Trends |||

Flux: A Machine Learning Framework for Julia

There was a HUGE announcement on the Julia blog a few days ago. The convergence of a language for machine learning and marrying it with a compiler just got a bit closer. Julia announced Flux, a machine learning frame work for Julia. 

Julia Language started out with the goal to create a language that was elegant for computations (i.e. math and machine learning), easy to code, and can take advantage of all that a hardware can offer by a specialized compiler. This isn’t python, which can be everything to anyone. It offers a Just In Time (JIT) compiling of your code so can get a helluva amount of speed over other dynamically typed code.

Julia Benchmarks from

From the bechmarking above, Julia beats the pants off’ the commonly used languages and software for Machine Learning and Data Science. Granted, it’s not as fast as C in most cases but it gets awfully close. My guess is that this will narrow the better the compiler gets. 

Differential Programming from Julia

The early days of machine learning were rough. Platforms like KNIME and RapidMiner tried to make them easier by building GUIs over different algorithms. At the same time Python and R were being repurporsed for machine learning.  This works but at the expense of speed.  Java was way faster than R and Python, but machine learning specialists loved coding in R and Python. So we made do with a hodgepodge of languages and deployment schemes. 

Data Scientists and Machine Learning experts don’t like to sit still, so they started to automate things. created AutoML in their open source H2O, and the rest of the market followed. 

All this is working exceedingly well, but the need for speed ever drives us forth. Especially when we want to use computationally heavy algorithms and techniques like Deep Learning.  To do that, Yann LeCun (creator of CNNs) suggests we look at the problem differently.  He suggests we use the term differential programming. We look at machine learning as developing  a new kind of software” that is differentiable and optimizable.

Enter Flux: A Machine Learning Framework for Julia!

Since we originally proposed the need for a first-class language, compiler and ecosystem for machine learning (ML), there have been plenty of interesting developments in the field. Not only have the tradeoffs in existing systems, such as TensorFlow and PyTorch, not been resolved, but they are clearer than ever now that both frameworks contain distinct static graph” and eager execution”interfaces. Meanwhile, the idea of ML models fundamentally being differentiable algorithms — often called differentiable programming – has caught on.

via Julia Blog


What is Flux exactly? It’s…

… a language to write differentiable algorithms, and Flux takes Julia to be this language. Being designed from the ground up for mathematical and numerical computing, Julia is unusually well-suited for expressing ML algorithms. Meanwhile, its mix of modern design and new ideas in the compiler makes it easier to address the high performance needs of cutting edge ML.

via Julia Blog

Granted, this is in it’s nascent form right now but Julia is really pushing forward with new libraries. I was unaware that Julia can easily compile on GPUs and TPUs. So, I must check this out.

Going forward, I think I need to stick with Python to automate the boring stuff and start looking at Julia for my future machine learning needs. 

Stay tuned. 

Up next Getting Started in Data Science Part 2 I’m finally getting around to writing Part 2 of Getting Started in Data Science. The first part can be found here. I made suggestions for Automate Feed Extraction and Posting it to Twitter I wrote a small Python script to automate feed extraction and posting it to Twitter. The feed? My feed burner feed for this site. The script is
Latest posts Phone Addiction Version 12 Launches Today! Machine Learning Making Pesto Tastier 5 Dangerous Things You Should Let Your Kids Do The Pyschology of Writing TensorFlow and High Level APIs Driving Marketing Performance with H2O Driverless AI Machine Learning and Data Munging in H2O Driverless AI with datatable Making AI Happen Without Getting Fired Latest Musings from a Traveling Sales Engineer The Night before H2O World 2019 Why Forex Trading is Frustrating Functional Programming in Python Automatic Feature Engineering with Driverless AI Ray Dalio's Pure Alpha Fund What's new in Driverless AI? Latest Writings Elsewhere - December 2018 House Buying Guide for Millennials Changing Pinboard Tags with Python Automate Feed Extraction and Posting it to Twitter Flux: A Machine Learning Framework for Julia Getting Started in Data Science Part 2 Makers vs Takers How Passive Investing Saved My Life Startups and Open Source The Process of Writing H2O AI World 2018 in London Ray Dalio's Pure Alpha Fund Isolation Forests in Living the Dream? Humility and Equanimity in Sales