AI Engineer: Designing and Implementing an Azure [AI-100] 5 — Questions and Answers
Question 1: You want to implement Responsible AI principles in your solution by detecting bias in model predictions across demographic groups. Which Azure tool supports this?
- Azure Defender for AI
- Fairlearn integrated with Azure Machine Learning (Correct answer)
- Azure Policy initiative for AI
- Azure Advisor AI recommendations
Correct answer: Fairlearn integrated with Azure Machine Learning
Fairlearn, integrated into Azure Machine Learning, provides metrics and visualizations to assess and mitigate model unfairness across demographic groups.
Question 2: Your team needs to share and version ML datasets across multiple Azure ML workspaces. What is the recommended approach?
- Copy datasets manually between workspaces using AzCopy
- Register datasets in each workspace using Azure ML registered datasets pointing to the same storage (Correct answer)
- Use Azure Synapse Analytics as a shared dataset registry
- Store all datasets in a single Azure SQL Database
Correct answer: Register datasets in each workspace using Azure ML registered datasets pointing to the same storage
Registering datasets in Azure ML workspaces with versioning lets teams track, share, and reproduce data assets while the underlying data lives in shared storage.
Question 3: You are configuring an Azure Cognitive Search skillset and need to call a custom Python function to enrich documents. What feature enables this?
- Built-in Azure ML skill
- Custom Web API skill pointing to an Azure Function endpoint (Correct answer)
- Azure Data Factory custom activity
- Cognitive Search debug session
Correct answer: Custom Web API skill pointing to an Azure Function endpoint
The Custom Web API skill in Azure Cognitive Search lets you call any HTTP endpoint, such as an Azure Function, to apply custom enrichment logic.
Question 4: When designing an Azure AI solution, you want to ensure that the system can explain individual predictions to end users. Which technique is most applicable?
- Cross-validation
- Model interpretability using SHAP values in Azure ML (Correct answer)
- Hyperparameter tuning with HyperDrive
- Automated ML (AutoML) feature selection
Correct answer: Model interpretability using SHAP values in Azure ML
SHAP (SHapley Additive exPlanations) values, available through Azure ML's interpretability library, explain the contribution of each feature to individual predictions.
Question 5: Your Azure Bot sends proactive messages to users in Microsoft Teams. Which Bot Framework feature must be stored and reused to send proactive messages?
- The bot's App ID and password
- The conversation reference obtained from a previous turn (Correct answer)
- The Teams channel webhook URL
- The user's Azure AD object ID
Correct answer: The conversation reference obtained from a previous turn
A conversation reference captured during an active turn contains the service URL and conversation ID needed to initiate proactive messages later.
Question 6: You need to extract structured data from handwritten forms with variable layouts that are not covered by prebuilt Form Recognizer models. What should you use?
- The Form Recognizer layout model only
- A custom Form Recognizer model trained with labeled sample forms (Correct answer)
- Azure Computer Vision Read API
- Azure Text Analytics with custom categories
Correct answer: A custom Form Recognizer model trained with labeled sample forms
Custom Form Recognizer models learn field locations from labeled training documents, enabling accurate extraction from variable-layout forms.
Question 7: Your organization's AI policy requires that all Cognitive Services calls are logged for auditing. Which Azure service should you integrate to capture and store these logs?
- Azure Security Center
- Azure Monitor Diagnostic Settings routed to a Log Analytics workspace (Correct answer)
- Azure Service Bus
- Azure Application Gateway access logs
Correct answer: Azure Monitor Diagnostic Settings routed to a Log Analytics workspace
Enabling Diagnostic Settings on the Cognitive Services resource and routing logs to a Log Analytics workspace captures all request and response telemetry for auditing.
You want to implement Responsible AI principles in your solution by detecting bias in model predictions across demographic groups.
Which Azure tool supports this?