AI AI Engineer: NLP and Large Language Models 2

Question 1

What is 'hallucination' in the context of LLMs?

Accepted Answer

The model producing plausible-sounding but factually incorrect or fabricated information

Answer

LLM hallucination refers to the model confidently generating false, invented information not grounded in training data or retrieved context.

Question 2

What is the context window in a large language model?

Accepted Answer

The maximum number of tokens the model can process in a single input/output sequence

Answer

The context window defines the maximum number of tokens (input + output) an LLM can process at once, limiting how much text it can consider.

Question 3

Which parameter-efficient fine-tuning technique adds low-rank decomposition matrices to model layers instead of updating all weights?

Accepted Answer

LoRA (Low-Rank Adaptation)

Answer

LoRA freezes pretrained weights and injects trainable low-rank matrices, drastically reducing the number of parameters updated during fine-tuning.

Question 4

What is 'zero-shot prompting' when using an LLM?

Accepted Answer

Asking the model to perform a task without providing any examples in the prompt

Answer

Zero-shot prompting asks the LLM to complete a task using only instructions, relying entirely on knowledge from pretraining without in-context examples.

Question 5

What is 'embedding' in NLP, as used by transformer models?

Accepted Answer

A dense, fixed-size vector representation of a token or text that captures semantic meaning

Answer

Embeddings map discrete tokens (or entire texts) to dense vectors in a continuous space where semantically similar items are geometrically close.

AI - Engineer Practice Test

AI - Engineer Practice Test

AI AI Engineer: NLP and Large Language Models 2