Natural Language Processing Machine Translation and Sequence-to-Sequence Models 2

Question 1

What is text summarization in NLP?

Accepted Answer

The task of automatically producing a shorter version of a document that retains the most important information

Answer

The task of classifying a document into one of several topic categories

Answer

The process of extracting all named entities from a document

Answer

A method for detecting duplicate sentences in a corpus

Question 2

What is the difference between extractive and abstractive summarization?

Accepted Answer

Extractive summarization selects existing sentences from the source, while abstractive summarization generates novel sentences that may not appear verbatim in the source

Answer

Extractive summarization is always better quality than abstractive

Answer

Abstractive summarization cannot handle multi-document inputs

Answer

Extractive summarization requires a pre-trained language model while abstractive uses rules

Question 3

What is the ROUGE metric used for in NLP evaluation?

Accepted Answer

Evaluating text summarization quality by measuring n-gram recall overlap between generated and reference summaries

Answer

Evaluating machine translation using n-gram precision

Answer

Measuring named entity recognition accuracy

Answer

Assessing the grammaticality of generated text

Question 4

What is the copy mechanism in sequence-to-sequence models?

Accepted Answer

A mechanism that allows the decoder to directly copy tokens from the source input sequence rather than always generating from the vocabulary

Answer

A caching layer that stores previously computed hidden states

Answer

A method for duplicating training examples to balance classes

Answer

A technique for initializing decoder weights from the encoder

Question 5

What is the teacher forcing technique in training sequence-to-sequence models?

Accepted Answer

Feeding the ground-truth previous token as input to the decoder at each step during training, rather than the model's own previous prediction

Answer

Using a teacher model to supervise a student model during knowledge distillation

Answer

Forcing the model to attend to the teacher's annotations during training

Answer

Providing the model with extra labeled examples from human annotators

Question 6

What is dialogue state tracking in task-oriented dialogue systems?

Accepted Answer

Maintaining a structured representation of the conversation's goals and slot values across multiple turns

Answer

Generating the next system response at each dialogue turn

Answer

Detecting the user's intent from a single utterance

Answer

Evaluating the fluency of system responses using human raters