CAIC CAIC Natural Language Processing & AI Applications 1

Question 1

Which NLP technique splits text into individual words or tokens for further processing?

Accepted Answer

Tokenization

Answer

Tokenization is the process of breaking text into individual words, phrases, or symbols called tokens.

Question 2

What does TF-IDF measure in text analysis?

Accepted Answer

Word importance relative to a document corpus

Answer

TF-IDF (Term Frequency–Inverse Document Frequency) quantifies how important a word is to a document relative to a collection of documents.

Question 3

Which model architecture introduced the concept of self-attention and became the foundation for large language models?

Accepted Answer

Transformer

Answer

The Transformer architecture, introduced in the 2017 paper 'Attention Is All You Need,' uses self-attention mechanisms and underpins modern LLMs.

Question 4

What is 'prompt engineering' in the context of AI consulting?

Accepted Answer

Designing input instructions to guide LLM outputs effectively

Answer

Prompt engineering is the practice of crafting and optimizing text inputs to elicit accurate, relevant, and controlled responses from large language models.

Question 5

Which evaluation metric is commonly used to assess the quality of machine-generated text against reference text?

Accepted Answer

BLEU score

Answer

BLEU (Bilingual Evaluation Understudy) score compares n-gram overlap between generated and reference text and is widely used for NLP tasks like translation.

(CAIC) Certified AI Consultant Practice Test

(CAIC) Certified AI Consultant Practice Test

CAIC CAIC Natural Language Processing & AI Applications 1