Search results for "Recurrent Neural Network"

DLWP2

Deep Learning with Python

Deep Learning with Python Tap the Power of TensorFlow and Keras, Develop Your First Model, Achieve state-of-the-Art Results Why Are Deep Learning Models So Powerful? …the secret is “Representation Learning“ Deep learning techniques are so powerful because they learn the best way to represent the problem while learning how to solve the problem. This is […]

Continue Reading
Popular Deep Learning Libraries

Popular Deep Learning Libraries

There are so many deep learning libraries to choose from. Which are the good professional libraries that are worth learning and which are someones side project and should be avoided. It is hard to tell the difference. In this post you will discover the top deep learning libraries that you should consider learning and using […]

Continue Reading
Machine Learning Mastery

Start Here with Machine Learning

Need Help Getting Started with Applied Machine Learning? These are the Step-by-Step Guides that You’ve Been Looking For! What do you want help with? The most common question I’m asked is: “how do I get started?” My best advice for getting started in machine learning is broken down into a 5-step process: Step 1: Adjust Mindset. […]

Continue Reading
transformer_cover

The Transformer Model

We have already familiarized ourselves with the concept of self-attention as implemented by the Transformer attention mechanism for neural machine translation. We will now be shifting our focus to the details of the Transformer architecture itself to discover how self-attention can be implemented without relying on the use of recurrence and convolutions. In this tutorial, […]

Continue Reading
attention_mechanism_cover

The Attention Mechanism from Scratch

The attention mechanism was introduced to improve the performance of the encoder-decoder model for machine translation. The idea behind the attention mechanism was to permit the decoder to utilize the most relevant parts of the input sequence in a flexible manner, by a weighted combination of all the encoded input vectors, with the most relevant […]

Continue Reading
Scatter Plot of Circles Dataset with Color Showing the Class Value of Each Sample

How to Reduce Generalization Error With Activity Regularization in Keras

Activity regularization provides an approach to encourage a neural network to learn sparse features or internal representations of raw observations. It is common to seek sparse learned representations in autoencoders, called sparse autoencoders, and in encoder-decoder models, although the approach can also be used generally to reduce overfitting and improve a model’s ability to generalize […]

Continue Reading
How to Grid Search Deep Learning Models for Time Series Forecasting

How to Grid Search Deep Learning Models for Time Series Forecasting

Grid searching is generally not an operation that we can perform with deep learning methods. This is because deep learning methods often require large amounts of data and large models, together resulting in models that take hours, days, or weeks to train. In those cases where the datasets are smaller, such as univariate time series, […]

Continue Reading
Deep Learning Books

Deep Learning Books

There are not many books on deep learning at the moment because it is such a young area of study. There are a few books available though and some very interesting books in the pipeline that you can purchase by early access. In this post, you will discover the books available right now on deep […]

Continue Reading