Search results for "attention"

A Gentle Introduction to Exponential Smoothing for Time Series Forecasting in Python

A Gentle Introduction to Exponential Smoothing for Time Series Forecasting in Python

Exponential smoothing is a time series forecasting method for univariate data that can be extended to support data with a systematic trend or seasonal component. It is a powerful forecasting method that may be used as an alternative to the popular Box-Jenkins ARIMA family of methods. In this tutorial, you will discover the exponential smoothing […]

Continue Reading

How to you stay up-to-date with machine learning?

A How to you stay up-to-date with machine learning? Generally, I don’t read the latest bleeding edge papers. This is for a few reasons: Most papers are not reproducible. Most papers are badly written. Most papers will not be referenced or used by next year. I try to focus my attention on the methods that […]

Continue Reading

In what order should I read your books?

A In what order should I read your books? What order should you read the books? That is a great question, my best suggestions are as follows: Consider starting with a book on a topic that you are most excited about. Consider starting with a book on a topic that you can apply on a […]

Continue Reading

Why do you focus on Python for machine learning?

A Why do you focus on Python for machine learning? I like to use different tools depending on the project. Recently I have been focusing more attention on Python-based tools and libraries. It seems that Python may be emerging as a dominant platform. Skills in Python for machine learning are in great demand. I am […]

Continue Reading

How do I get a job without a degree?

A How do I get a job without a degree? I teach a top-down and results-first approach to machine learning. This means that you very quickly learn how to work through predictive modeling problems and deliver results. As part of this process, I teach a method of developing a portfolio of completed projects. This demonstrates […]

Continue Reading
How to Think About Machine Learning

How to Think About Machine Learning

Machine learning is a large and interdisciplinary field of study. You can achieve impressive results with machine learning and find solutions to very challenging problems. But this is only a small corner of the broader field of machine learning often called predictive modeling or predictive analytics. In this post, you will discover how to change […]

Continue Reading
How to Configure an Encoder-Decoder Model for Neural Machine Translation

How to Configure an Encoder-Decoder Model for Neural Machine Translation

The encoder-decoder architecture for recurrent neural networks is achieving state-of-the-art results on standard machine translation benchmarks and is being used in the heart of industrial translation services. The model is simple, but given the large amount of data required to train it, tuning the myriad of design decisions in the model in order get top […]

Continue Reading
Encoder-Decoder Recurrent Neural Network Models for Neural Machine Translation

Encoder-Decoder Recurrent Neural Network Models for Neural Machine Translation

The encoder-decoder architecture for recurrent neural networks is the standard neural machine translation method that rivals and in some cases outperforms classical statistical machine translation methods. This architecture is very new, having only been pioneered in 2014, although, has been adopted as the core technology inside Google’s translate service. In this post, you will discover […]

Continue Reading
A Gentle Introduction to Neural Machine Translation

A Gentle Introduction to Neural Machine Translation

One of the earliest goals for computers was the automatic translation of text from one language to another. Automatic or machine translation is perhaps one of the most challenging artificial intelligence tasks given the fluidity of human language. Classically, rule-based systems were used for this task, which were replaced in the 1990s with statistical methods. […]

Continue Reading