How to Make Predictions with Long Short-Term Memory Models in Keras

The goal of developing an LSTM model is a final model that you can use on your sequence prediction problem.

In this post, you will discover how to finalize your model and use it to make predictions on new data.

After completing this post, you will know:

  • How to train a final LSTM model.
  • How to save your final LSTM model, and later load it again.
  • How to make predictions on new data.

Let’s get started.

How to Make Predictions with Long Short-Term Memory Models with Keras

How to Make Predictions with Long Short-Term Memory Models with Keras
Photo by damon jah, some rights reserved.

Step 1. Train a Final Model

What Is a Final LSTM Model?

A final LSTM model is one that you use to make predictions on new data.

That is, given new examples of input data, you want to use the model to predict the expected output. This may be a classification (assign a label) or a regression (a real value).

The goal of your sequence prediction project is to arrive at a final model that performs the best, where “best” is defined by:

  • Data: the historical data that you have available.
  • Time: the time you have to spend on the project.
  • Procedure: the data preparation steps, algorithm or algorithms, and the chosen algorithm configurations.

In your project, you gather the data, spend the time you have, and discover the data preparation procedures, algorithm to use, and how to configure it.

The final model is the pinnacle of this process, the end you seek in order to start actually making predictions.

There is no such thing as a perfect model. There is only the best model that you were able to discover.

How to Finalize an LSTM Model?

You finalize a model by applying the chosen LSTM architecture and configuration on all of your data.

There is no train and test split and no cross-validation folds. Put all of the data back together into one large training dataset and fit your model.

That’s it.

With the finalized model, you can:

  • Save the model for later or operational use.
  • Load the model and make predictions on new data.

For more on training a final model, see the post:

Need help with LSTMs for Sequence Prediction?

Take my free 7-day email course and discover 6 different LSTM architectures (with sample code).

Click to sign-up and also get a free PDF Ebook version of the course.

Start Your FREE Mini-Course Now!

Step 2. Save Your Final Model

Keras provides an API to allow you to save your model to file.

The model is saved in HDF5 file format that efficiently stores large arrays of numbers on disk. You will need to confirm that you have the h5py Python library installed. It can be installed as follows:

You can save a fit Keras model to file using the save() function on the model.

For example:

This single file will contain the model architecture and weights. It also includes the specification of the chosen loss and optimization algorithm so that you can resume training.

The model can be loaded again (from a different script in a different Python session) using the load_model() function.

Below is a complete example of fitting an LSTM model, saving it to a single file and later loading it again. Although the loading of the model is in the same script, this section may be run from another script in another Python session. Running the example saves the model to the file lstm_model.h5.

For more on saving and loading your Keras model, see the post:

Step 3. Make Predictions on New Data

After you have finalized your model and saved it to file, you can load it and use it to make predictions.

For example:

  • On a sequence regression problem, this may be the prediction of the real value at the next time step.
  • On a sequence classification problem, this may be a class outcome for a given input sequence.

Or it may be any other variation based on the specifics of your sequence prediction problem. You would like an outcome from your model (yhat) given an input sequence (X) where the true outcome for the sequence (y) is currently unknown.

You may be interested in making predictions in a production environment, as the backend to an interface, or manually. It really depends on the goals of your project.

Any data preparation performed on your training data prior to fitting your final model must also be applied to any new data prior to making predictions.

Predicting is the easy part.

It involves taking the prepared input data (X) and calling one of the Keras prediction methods on the loaded model.

Remember that the input for making a prediction (X) is only comprised of the input sequence data required to make a prediction, not all prior training data. In the case of predicting the next value in one sequence, the input sequence would be 1 sample with the fixed number of time steps and features used when you defined and fit your model.

For example, a raw prediction in the shape and scale of the activation function of the output layer can be made by calling the predict() function on the model:

The prediction of a class index can be made by calling the predict_classes() function on the model.

The prediction of probabilities can be made by calling the predict_proba() function on the model.

For more on the life-cycle of your Keras model, see the post:

Further Reading

This section provides more resources on the topic if you are looking go deeper.




In this post, you discovered how to finalize your model and use it to make predictions on new data.

Specifically, you learned:

  • How to train a final LSTM model.
  • How to save your final LSTM model, and later load it again.
  • How to make predictions on new data.

Do you have any questions?
Ask your questions in the comments below and I will do my best to answer.

Develop LSTMs for Sequence Prediction Today!

Long Short-Term Memory Networks with Python

Develop Your Own LSTM models in Minutes

…with just a few lines of python code

Discover how in my new Ebook:
Long Short-Term Memory Networks with Python

It provides self-study tutorials on topics like:
CNN LSTMs, Encoder-Decoder LSTMs, generative models, data preparation, making predictions and much more…

Finally Bring LSTM Recurrent Neural Networks to
Your Sequence Predictions Projects

Skip the Academics. Just Results.

Click to learn more.

22 Responses to How to Make Predictions with Long Short-Term Memory Models in Keras

  1. Klaas Brau August 30, 2017 at 2:03 am #

    Thanks Jason

    One question. Why should we finalize the model on the whole data. We would change the weights again right? The model which was trained on the training data is the one we tested on unseen data (test set). The new model (trained on all data) could be worse, overfitted,… not?

  2. ketan September 14, 2017 at 7:02 pm #

    I tried both keras and tensorflow. Tensorflow has more features.

  3. tieliu October 13, 2017 at 6:53 pm #

    thanks, Jason.

    I ran your sample code, but found the result as below, which seems not expected.

    … …
    Epoch 290/300
    6/6 [==============================] – 0s – loss: 0.0155
    Epoch 295/300
    6/6 [==============================] – 0s – loss: 0.0153
    Epoch 296/300
    6/6 [==============================] – 0s – loss: 0.0153
    Epoch 297/300
    6/6 [==============================] – 0s – loss: 0.0152
    Epoch 298/300
    6/6 [==============================] – 0s – loss: 0.0152
    Epoch 299/300
    6/6 [==============================] – 0s – loss: 0.0152
    Epoch 300/300
    6/6 [==============================] – 0s – loss: 0.0151
    [[ 0.28978038]
    [ 0.31878966]
    [ 0.3477335 ]
    [ 0.37631655]
    [ 0.4042924 ]
    [ 0.43146992]]

    Suppose input of X are 0 0.1 0.2 0.3 0.4 0.5, then predict value of y should be similar to 0.1 0.2… 0.6. but the result is such value as 0.28978038… … 0.43146992.

    can you check more about it?

  4. Fawad October 16, 2017 at 9:27 pm #

    Hi, I want to predict for a whole record of shape like (160, 72) for single time step. How would I shape my numpy array of features for test. For more clear understanding, I have trained my model on trainX with shape (235, 1, 72) and trainY with shape (235,). Now I want to predict a single timestep but for 160 rows. How to do that?

  5. joseph February 26, 2018 at 2:59 pm #

    Hi Jason,

    When performing model.predict, i do get some inconsistent outputs. Does that mean my model is wrong?as far as i know, possible scenario for inconsistent outputs is if i try to re-fit the model and not during prediction. Am i missing something? hope to get some comments from you. thank you very much

  6. Maryam March 18, 2018 at 8:36 am #

    Hi Jason,
    I am so grateful for the post U shared with us.
    I just want to load 3 finalized model namely RNN, CNN, LSTM in one script concurrently which have already saved as a finalized model in keras to using them in an ensemble model to gain an average result for predicting. Is it necessary to use dask data frame to load multi finalized (saved model) models?? or loading multi finalized model has the same commands as loading one finalized model?
    Thank U in advanced for taking your time to replying.

    • Jason Brownlee March 19, 2018 at 6:02 am #

      A Pandas DataFrame is not required. Each model can be saved and loaded to and from separate files and used in an ensemble.

  7. Delaram April 2, 2018 at 7:25 am #

    Hi Jason,
    I am really appreciated about this helpful tutorial.
    I train and then save a finalized cnn model in a script after that I load the finalized cnn model in another different script just used this command :(load_model(‘cnn_model.h5’) .
    In fact I have a test dataset which does not have any label and I wanna gain the proability of belonging of each sample to each class by this command : (model_cnn_final.predict_proba) but gave me this error:((AttributeError: ‘Model’ object has no attribute ‘predict_proba’) and also when I applied this command:[yhat=model.predict_classes(X) ] it gave me this error :(‘Model’ object has no attribute ‘predict_classes’).
    I have used the command :(yhat = model.predict(X)) and it worked fine.

    what is the problem with these commands which cuase error??
    how can I fixe the errors?

    • Jason Brownlee April 2, 2018 at 2:47 pm #

      I believe these methods are only supported on Sequential models, you may be using the functional Model API. In that case, you may be limited to the predict() function alone, which will return probabilities in the case of a softmax activation function in the output layer.

  8. Fredrik Nilsson April 4, 2018 at 6:27 am #


    This is super good Jason!

    Thanks your writings 🙂

  9. Bastien April 19, 2018 at 2:24 am #

    Hi Jason,

    Thank you for this really helpful tutorial.

    I have a question. I think I am missing something to make predictions. I don’t understand what should be the input on model.predict(X) to predict new data. Let’s say I have one year of data (sampled every hour) and I want to predict the following week. What should my X be ?

Leave a Reply