# 10 Challenging Machine Learning Time Series Forecasting Problems

Machine learning methods have a lot to offer for time series forecasting problems.

A difficulty is that most methods are demonstrated on simple univariate time series forecasting problems.

In this post, you will discover a suite of challenging time series forecasting problems. These are problems where classical linear statistical methods will not be sufficient and where more advanced machine learning methods are required.

If you are looking for challenging time series datasets to practice machine learning techniques, you are in the right place.

Kick-start your project with my new book Time Series Forecasting With Python, including step-by-step tutorials and the Python source code files for all examples.

Let’s dive in.

Challenging Machine Learning Time Series Forecasting Problems
Photo by Joao Trindade, some rights reserved.

## Overview

We will take a closer look at 10 challenging time series datasets from the competitive data science website Kaggle.com.

Not all datasets are strict time series prediction problems; I have been loose in the definition and also included problems that were a time series before obfuscation or have a clear temporal component.

They are:

• How Much Did It Rain? I and II
• Online Product Sales
• Rossmann Store Sales
• Walmart Recruiting – Store Sales Forecasting
• Acquire Valued Shoppers Challenge
• Melbourne University AES/MathWorks/NIH Seizure Prediction
• AMS 2013-2014 Solar Energy Prediction Contest
• Global Energy Forecasting Competition 2012 – Wind Forecasting
• EMC Data Science Global Hackathon (Air Quality Prediction)
• Grupo Bimbo Inventory Demand

This is not all of the time series datasets hosted on Kaggle.
Did I miss a good one? Let me know in the comments below.

### Stop learning Time Series Forecasting the slow way!

Take my free 7-day email course and discover how to get started (with sample code).

Click to sign-up and also get a free PDF Ebook version of the course.

## How Much Did It Rain? I and II

Given observations and derived measures from polarimetric radar, the problem is to predict the probability distribution of the hourly total in a rain gage.

The temporal structure (e.g. hour to hour) was removed as part of obfuscating the data, which would have made it an interesting time series problem.

The competition was run twice in the same year with different datasets:

The second competition was won by Aaron Sim, who used a very large recurrent neural network algorithm.

## Online Product Sales

Given details of the product and the product launch, the problem is to predict the next 12 months of sales figures.

This is a multi-step forecast, or sequence forecast, without a history of sales from which to extrapolate.

I could not find any good write-ups of top performing solutions. Can you?

## Rossmann Store Sales

Given historical daily sales for more than one thousands stores, the problem is to predict 6 weeks of daily sales figures for each store.

This provides both an opportunity to explore store-wise multi-step forecasts, as well as the ability to exploit cross-store patterns.

Top results were achieved with careful feature engineering and the use of gradient boosting.

## Walmart Recruiting – Store Sales Forecasting

Given historical weekly sales data for multiple departments in multiple stores, as well as details of promotions, the problem is to predict sales figures for store departments.

This provides both an opportunity to explore department-wise and even store-wise forecasts, as well as the ability to exploit cross-department and cross-store patterns.

Top performers made heavy use of ARIMA models and careful handling of public holidays.

See a write-up of the winning solution here, and second place solution here.

## Acquire Valued Shoppers Challenge

Given historical shopping behavior, the problem is to predict which customers will likely repeat purchase (become acquired) after taking up a discount offer.

The large number of transactions make this a big data download, nearly 3 gigabytes.

The problem provides an opportunity to model the time series of specific or aggregated customers and predict the probability of customer conversion.

I could not find any good write-ups of top performing solutions. Can you?

## Melbourne University AES/MathWorks/NIH Seizure Prediction

Given a trace of human brain activity observed with an intracranial EEG for months or years, the problem is to predict whether 10-minute segments indicate the probability of a seizure or not.

A 4th place solution is described that made use of statistical feature engineering and gradient boosting.

Update: The dataset has since been taken down.

## AMS 2013-2014 Solar Energy Prediction Contest

Given historical meteorological forecasts at multiple sites, the problem is to predict the total daily solar energy at each site for one year.

The dataset provides an opportunity to model spatial and temporal time series by site and across sites and make multi-step forecasts for each site.

## Global Energy Forecasting Competition 2012 – Wind Forecasting

Given historical wind forecasts and power generation at multiple sites, the problem is to predict hourly power generation for the next 48 hours.

The dataset provides an opportunity to model the hourly time series for individual sites as well as across-sites.

I could not find any good write-ups of top performing solutions. Can you?

## EMC Data Science Global Hackathon (Air Quality Prediction)

Given eight days of hourly measurements of air pollutants, the problem is to forecast pollutants at specific times over the following three days.

The dataset provides an opportunity to model a multivariate time series and perform a multi-step forecast.

A good write-up of the top performing solution describes the use of an ensemble of random forest models trained on lagged variables.

## Summary

In this post, you discovered a suite of challenging time series forecasting problems.

These are problems that provided the foundation for competitive machine learning on the site Kaggle.com. As such, each problem also provides a great source of discussion and existing world-class solutions that can be used as inspiration and a starting point.

If you are interested in better understanding the role of machine learning for time series forecasting, I would recommend selecting one or more of these problems as a starting point.

Have you worked on one or more of these problems?
Share your experiences in the comments below.

Is there a time series problem on Kaggle.com that was not mentioned in this post?
Let me know about it in the comments below.

## Want to Develop Time Series Forecasts with Python?

#### Develop Your Own Forecasts in Minutes

...with just a few lines of python code

Discover how in my new Ebook:
Introduction to Time Series Forecasting With Python

It covers self-study tutorials and end-to-end projects on topics like: Loading data, visualization, modeling, algorithm tuning, and much more...

#### Finally Bring Time Series Forecasting to Your Own Projects

Skip the Academics. Just Results.

### 18 Responses to 10 Challenging Machine Learning Time Series Forecasting Problems

1. Andrei March 1, 2017 at 7:46 pm #

Thank you for gathering and sharing those time series forecasting problems.
It really seems challenging but it is worth a try.

• Jason Brownlee March 2, 2017 at 8:11 am #

Thanks Andrei, let me know how you go!

2. Sebastian March 2, 2017 at 9:04 am #

Would be really cool if you did a blog on the wind forecasting problem!

• Jason Brownlee March 3, 2017 at 7:38 am #

Thanks for the suggestion Sebastian.

3. leo March 2, 2017 at 5:42 pm #

What method do you recommend for wind frecasting?
Moreover, kagglers use machine learning methods instead of time series methods like aroma, exponential smoothing etc.

• Jason Brownlee March 3, 2017 at 7:42 am #

I am not familiar with the specific domain of wind forecasting, but generally, I would recommend spot checking as many methods as you can get your hands on then double down on whatever shows promise.

A great thing about meteorology is that it is based in physics we understand and can simulate. Ensemble meteorological models run on supercomputers are the state of the art for things like temperature and severe weather like cyclones (what I used to work on). Not sure about general wind forecasts.

4. Keert October 21, 2017 at 12:31 am #

What model would be appropriate for doing Sales Forecasting based on Weather. I have a dataset that has sales for last 2 years per store and I would like to add weather parameters

5. sherry September 10, 2018 at 8:19 pm #

Hi Jason,

I have some 2443 gif images of historical daily precipitation maps, and I want to build a model to forecast maps for one week.

Could you direct me how I can get started, and if you know any resources online.

Highly appreciate it. Thank you very much.

6. Reema September 27, 2019 at 7:19 am #

Thanks so much Mr.Jason ,

I would like to work on Rossmann stores challenge as my master capstone but I confused about its type is it considered multivariate & multiple time series problem ?

If you have any useful recourse on that topic or better suggestion for my capstone in time series simpler than this challenge would be much appreciated

Regards,

7. Jake April 27, 2020 at 5:01 am #

I’m new in machine learning and have a time series forecasting project that needs to forecast all products sales during next 5 minutes. Is LSTM a proper solution for my project? Are there recommended books ? Thanks.

8. Emad Fathy May 19, 2020 at 7:01 am #

What about Predictive Maintenance, most of the data is time series based from plant sensors? Are these techniques apply?

• Jason Brownlee May 19, 2020 at 7:29 am #

Yes, you could model it as time series classification – e.g. is there a fault in the interval.