Caption generation is a challenging artificial intelligence problem that draws on both computer vision and natural language processing. The encoder-decoder recurrent neural network architecture has been shown to be effective at this problem. The implementation of this architecture can be distilled into inject and merge based models, and both make different assumptions about the role […]
Search results for "translation"
Encoder-Decoder Models for Text Summarization in Keras
Text summarization is a problem in natural language processing of creating a short, accurate, and fluent summary of a source document. The Encoder-Decoder recurrent neural network architecture developed for machine translation has proven effective when applied to the problem of text summarization. It can be difficult to apply this architecture in the Keras deep learning […]
What is Teacher Forcing for Recurrent Neural Networks?
Teacher forcing is a method for quickly and efficiently training recurrent neural network models that use the ground truth from a prior time step as input. It is a network training method critical to the development of deep learning language models used in machine translation, text summarization, and image captioning, among many other applications. In […]
How to Prepare News Articles for Text Summarization
Text summarization is the task of creating a short, accurate, and fluent summary of an article. A popular and free dataset for use in text summarization experiments with deep learning methods is the CNN News story dataset. In this tutorial, you will discover how to prepare the CNN News Dataset for text summarization. After completing […]
Encoder-Decoder Deep Learning Models for Text Summarization
Text summarization is the task of creating short, accurate, and fluent summaries from larger text documents. Recently deep learning methods have proven effective at the abstractive approach to text summarization. In this post, you will discover three different models that build on top of the effective Encoder-Decoder architecture developed for sequence-to-sequence prediction in machine translation. […]
A Gentle Introduction to Text Summarization
Text summarization is the problem of creating a short, accurate, and fluent summary of a longer text document. Automatic text summarization methods are greatly needed to address the ever-growing amount of text data available online to both better help discover relevant information and to consume relevant information faster. In this post, you will discover the […]
How to Use Small Experiments to Develop a Caption Generation Model in Keras
Caption generation is a challenging artificial intelligence problem where a textual description must be generated for a photograph. It requires both methods from computer vision to understand the content of the image and a language model from the field of natural language processing to turn the understanding of the image into words in the right […]
A Gentle Introduction to Deep Learning Caption Generation Models
Caption generation is the challenging artificial intelligence problem of generating a human-readable textual description given a photograph. It requires both image understanding from the domain of computer vision and a language model from the field of natural language processing. It is important to consider and test multiple ways to frame a given predictive modeling problem […]
A Gentle Introduction to Calculating the BLEU Score for Text in Python
BLEU, or the Bilingual Evaluation Understudy, is a score for comparing a candidate translation of text to one or more reference translations. Although developed for translation, it can be used to evaluate text generated for a suite of natural language processing tasks. In this tutorial, you will discover the BLEU score for evaluating and scoring […]
How to Prepare a Photo Caption Dataset for Training a Deep Learning Model
Automatic photo captioning is a problem where a model must generate a human-readable textual description given a photograph. It is a challenging problem in artificial intelligence that requires both image understanding from the field of computer vision as well as language generation from the field of natural language processing. It is now possible to develop […]