Data Processing Fundamentals — Questions and Answers

Question 1: What is Lambda architecture in big data systems?

A machine learning framework for large datasets
A design that combines batch processing for accuracy with stream processing for low latency (Correct answer)
A serverless cloud computing model for data pipelines
A type of database schema for time-series data

Correct answer: A design that combines batch processing for accuracy with stream processing for low latency

Lambda architecture uses a batch layer for comprehensive historical processing and a speed layer for real-time stream processing, with a serving layer merging both views.

Question 2: What is write-ahead logging (WAL) in databases?

A method that writes data to all replicas before acknowledging success
A strategy that buffers all writes in memory until a threshold is reached
A technique where changes are first written to a log before being applied to the database, ensuring durability (Correct answer)
A log that records only failed write operations for debugging

Correct answer: A technique where changes are first written to a log before being applied to the database, ensuring durability

Write-ahead logging records every change to a log file before applying it to the actual data, ensuring that committed transactions can be recovered after a crash.

Question 3: Inquiring about database-stored information is sometimes referred to as

Report
Record
Field (Correct answer)
Query

Correct answer: Field

When inquiring about database-stored information, the focus is often on retrieving specific pieces of data, which are organized into "fields" or columns. While the act of requesting information is a "query," the inquiry fundamentally targets and extracts data from these defined fields. Therefore, the process involves directly engaging with the fields to access the desired information.

Question 4: What is Apache Spark used for in big data?

Monitoring network traffic in real time
Managing relational database schemas
Fast, in-memory distributed data processing for batch and streaming workloads (Correct answer)
Scraping web pages for SEO analysis

Correct answer: Fast, in-memory distributed data processing for batch and streaming workloads

Apache Spark is a unified analytics engine that processes large-scale data in memory, making it significantly faster than disk-based MapReduce for iterative operations.

Question 5: What is the purpose of database caching?

Storing frequently accessed data in fast memory to reduce retrieval time (Correct answer)
Sorting query results before returning them
Creating backup copies of the entire database
Encrypting data before writing it to disk

Correct answer: Storing frequently accessed data in fast memory to reduce retrieval time

Database caching stores query results or frequently accessed data in fast in-memory storage, dramatically reducing database load and response times for repeated requests.

Question 6: Which term describes data that is incorrect, incomplete, or inconsistent?

Indexed data
Clean data
Normalized data
Dirty data (Correct answer)

Correct answer: Dirty data

Dirty data refers to any data that contains errors, duplicates, missing values, or inconsistencies that reduce its quality and reliability.

Question 7: What is a data warehouse's key characteristic compared to an operational database?

It only stores real-time streaming data
It is optimized for read-heavy analytical queries rather than transactional write operations (Correct answer)
It is always stored on a single machine for simplicity
It is updated continuously every millisecond

Correct answer: It is optimized for read-heavy analytical queries rather than transactional write operations

Data warehouses are designed for OLAP (Online Analytical Processing), optimizing complex read queries across large historical datasets, unlike OLTP databases built for fast transactional writes.

Question 8: What is a data steward responsible for?

Writing backend application code
Managing server hardware infrastructure
Designing network firewall rules
Overseeing data quality, governance, and policies for a specific data domain (Correct answer)

Correct answer: Overseeing data quality, governance, and policies for a specific data domain

A data steward owns the quality and governance of a specific domain's data, defining rules, resolving issues, and ensuring compliance.

Question 9: What is the primary purpose of a privacy policy?

To establish legal penalties for unauthorized data access incidents
To inform users how their personal data will be collected, used, and protected (Correct answer)
To restrict employee access to internal company systems and networks
To define the technical security measures used to protect databases

Correct answer: To inform users how their personal data will be collected, used, and protected

A privacy policy is a legal document that discloses how an organization collects, uses, stores, and shares personal data, informing users of their rights.

Question 10: What is the primary role of a firewall in data security?

Monitoring and controlling incoming and outgoing network traffic based on security rules (Correct answer)
Encrypting the contents of hard drives to prevent unauthorized access
Backing up databases to protect against data loss
Authenticating users before they can access the network

Correct answer: Monitoring and controlling incoming and outgoing network traffic based on security rules

A firewall monitors and controls network traffic based on predetermined security rules, acting as a barrier between trusted internal networks and untrusted external networks.

Question 11: What is phishing?

A method of bypassing firewall rules using specially crafted network packets
An attack that floods a server with traffic to cause a denial of service
A network technique used to intercept data packets in transit
A social engineering attack that tricks users into revealing sensitive information via fraudulent communications (Correct answer)

Correct answer: A social engineering attack that tricks users into revealing sensitive information via fraudulent communications

Phishing involves sending fraudulent communications — typically emails — that appear to come from legitimate sources to trick individuals into revealing passwords or sensitive information.

Question 12: What is the primary purpose of data profiling?

To analyze and understand the structure, content, and quality of data (Correct answer)
To encrypt data for secure storage
To sort data in ascending order
To compress large datasets for archiving

Correct answer: To analyze and understand the structure, content, and quality of data

Data profiling examines the content and structure of a dataset to identify quality issues, patterns, and anomalies before processing.

Question 13: What is eventual consistency in distributed data storage?

A model where all replicas will eventually converge to the same value given no new updates (Correct answer)
A storage strategy that prioritizes speed over durability
A backup policy that runs nightly to sync all nodes
A guarantee that all replicas are always identical at every moment

Correct answer: A model where all replicas will eventually converge to the same value given no new updates

Eventual consistency guarantees that if no new writes occur, all replicas of a distributed data store will eventually return the same value, trading immediate consistency for availability.

Question 14: When a data processing cycle fails midway, a 'checkpoint' mechanism allows the job to:

Restart from the beginning with a clean state
Alert operators and pause indefinitely
Discard all in-flight records and wait for the next scheduled run
Resume processing from the last successfully completed checkpoint rather than from scratch (Correct answer)

Correct answer: Resume processing from the last successfully completed checkpoint rather than from scratch

Checkpoints save progress state so that a restarted job can pick up where it left off, avoiding expensive full reprocessing.

Question 15: What is a null value in a database?

A value of zero
An encrypted placeholder
The absence of any value — unknown or missing data (Correct answer)
A negative integer

Correct answer: The absence of any value — unknown or missing data

NULL represents the absence of a value in a field — it is different from zero or an empty string and means the data is unknown or missing.

Question 16: What does 'data completeness' measure?

How fast data is processed
The proportion of required data that is present and not missing (Correct answer)
How many tables are in a database
The size of data files in gigabytes

Correct answer: The proportion of required data that is present and not missing

Data completeness measures whether all required data fields and records are present within the dataset.

Question 17: What is the CAP theorem in distributed systems?

A principle requiring all caches to clear after three minutes
A constraint that caps storage growth at a set percentage per year
A rule that limits database tables to a maximum of three columns
A distributed system can guarantee at most two of three properties: Consistency, Availability, and Partition tolerance (Correct answer)

Correct answer: A distributed system can guarantee at most two of three properties: Consistency, Availability, and Partition tolerance

The CAP theorem states that a distributed data system cannot simultaneously guarantee consistency, availability, and partition tolerance — only two can be fully achieved at once.

Question 18: What is a full-text search index?

An index that caches the results of the most recent queries
An index that enables searching for words within text fields across large document collections (Correct answer)
A compressed copy of a database stored for backup purposes
An index containing every row of a table in alphabetical order

Correct answer: An index that enables searching for words within text fields across large document collections

A full-text search index tokenizes and indexes the words within text fields, enabling fast keyword searches across large volumes of text content.

Question 19: What is a materialized view in database storage?

A precomputed and physically stored result of a query that is refreshed periodically (Correct answer)
A virtual table that is computed on demand each time it is queried
A compressed snapshot of a table stored for archival
A type of view visible only to database administrators

Correct answer: A precomputed and physically stored result of a query that is refreshed periodically

A materialized view stores the precomputed result of a query as a physical table that can be queried directly, improving performance at the cost of storage and periodic refresh overhead.

Question 20: What is stream processing in big data?

Importing data in large batches overnight
Continuously processing data as it arrives in real time (Correct answer)
Processing only structured data from relational systems
Storing data in sequential log files

Correct answer: Continuously processing data as it arrives in real time

Stream processing handles data continuously as it is generated, enabling real-time analysis and immediate actions on incoming data.

Question 21: What distinguishes batch processing from stream processing?

Batch processing is faster than stream processing
Batch processing only works with unstructured data
Stream processing stores data permanently; batch processing does not
Batch processing handles data in large collected groups at scheduled intervals; stream processing handles data continuously as it arrives (Correct answer)

Correct answer: Batch processing handles data in large collected groups at scheduled intervals; stream processing handles data continuously as it arrives

Batch processing accumulates data over a period and processes it all at once on a schedule, while stream processing ingests and analyzes data continuously in near-real-time.

Question 22: What are the three Vs traditionally used to define big data?

Virtual, Vertical, Variable
Volume, Verification, Visualization
Volume, Velocity, Variety (Correct answer)
Value, Validity, Visibility

Correct answer: Volume, Velocity, Variety

The three Vs of big data are Volume (large amounts of data), Velocity (high speed of data generation), and Variety (diverse data types and sources).

Question 23: What is two-factor authentication (2FA)?

A backup system that stores copies of data in two separate locations
A technique that validates data twice before it is stored in a database
A method of encrypting data using two separate cryptographic keys
A security process requiring two different forms of verification to grant access (Correct answer)

Correct answer: A security process requiring two different forms of verification to grant access

Two-factor authentication requires users to provide two distinct forms of verification — such as a password and a one-time SMS code — before access is granted.

Question 24: What is the role of a NameNode in Hadoop HDFS?

It stores the actual data blocks on local disk
It runs MapReduce job computations
It handles user authentication and authorization
It manages the file system namespace and tracks where data blocks are stored across DataNodes (Correct answer)

Correct answer: It manages the file system namespace and tracks where data blocks are stored across DataNodes

The NameNode is the HDFS master server that maintains the file system namespace, directory tree, and metadata about where each file's blocks are stored on DataNodes.

Question 25: What is the difference between structured and unstructured data?

Structured data is organized in predefined formats like tables; unstructured data has no predefined format (Correct answer)
Structured data is encrypted; unstructured data is not
Structured data is stored on hard drives; unstructured data is stored in the cloud
Structured data is always numeric; unstructured data is always text

Correct answer: Structured data is organized in predefined formats like tables; unstructured data has no predefined format

Structured data conforms to a predefined schema (like rows in a database), while unstructured data lacks a formal structure (like emails, images, or video files).

Question 26: What is Apache Hive used for in the Hadoop ecosystem?

Streaming real-time sensor data into Hadoop
Querying and analyzing large datasets stored in HDFS using a SQL-like language (Correct answer)
Training machine learning models on distributed data
Managing user access to HDFS directories

Correct answer: Querying and analyzing large datasets stored in HDFS using a SQL-like language

Apache Hive provides a SQL-like interface called HiveQL to query and analyze large structured datasets stored in HDFS, making it accessible to SQL-familiar analysts.

Question 27: What is a data breach?

A backup failure that results in permanent data loss
The process of migrating data between two systems
An incident where unauthorized individuals gain access to confidential data (Correct answer)
A scheduled maintenance window that interrupts data processing

Correct answer: An incident where unauthorized individuals gain access to confidential data

A data breach occurs when unauthorized individuals access, steal, or expose confidential data without permission from the data owner.

Question 28: What is a transaction in database processing?

A report generated from query results
A method for importing CSV files
A type of database index
A unit of work that is executed completely or not at all (Correct answer)

Correct answer: A unit of work that is executed completely or not at all

A database transaction is a sequence of operations treated as a single logical unit of work that must be fully completed or fully rolled back.

Question 29: What is the purpose of data profiling in a data processing workflow?

Analyzing data to understand its structure, content, and quality (Correct answer)
Encrypting data before storage
Partitioning data across multiple nodes
Compressing data to reduce file sizes

Correct answer: Analyzing data to understand its structure, content, and quality

Data profiling examines datasets to assess quality, identify anomalies, and understand structural characteristics.

Question 30: What is a distributed cache in big data frameworks?

A mechanism to make read-only files available locally on all worker nodes during a job (Correct answer)
A backup of HDFS data stored in cloud storage
A shared disk accessible by all nodes in a cluster
A distributed in-memory database for user sessions

Correct answer: A mechanism to make read-only files available locally on all worker nodes during a job

A distributed cache distributes read-only files (like lookup tables or configuration files) to all worker nodes at the start of a job, reducing repeated network transfers.

Question 31: Which of the following best describes personally identifiable information (PII)?

Information accessed using personal login credentials
Encrypted data belonging to registered users
Data stored on personal computers and mobile devices
Any data that can be used to identify a specific individual (Correct answer)

Correct answer: Any data that can be used to identify a specific individual

PII refers to any information that can be used alone or combined with other data to identify, contact, or locate a specific individual.

Data Processing Fundamentals

A foundational certification covering core data processing concepts including batch and real-time processing, big data technologies, data storage and retrieval systems, and data security and privacy practices.

Questions

35 min

Time Limit

70%

To Pass

Checking for saved progress...

Exam Rules

You can skip questions and return to them later
Flag questions for review before submitting
No feedback shown until you submit the entire exam
Unanswered questions count as wrong — answer everything
10 pretest questions are mixed in and don't affect your score
Timer auto-submits when time runs out
Your progress is auto-saved every 30 seconds