Data Warehousing on AWS Training ETL and Data Integration 1 — Questions and Answers
Question 1: Which AWS service is the primary recommended method for bulk-loading data into Amazon Redshift?
- INSERT statements
- COPY command (Correct answer)
- AWS Glue
- Kinesis Firehose
Correct answer: COPY command
The COPY command loads data in parallel from S3, DynamoDB, EMR, or SSH sources and is far faster than row-by-row inserts.
Question 2: Which file format provides the best performance when loading data into Redshift using the COPY command?
- CSV
- JSON
- Parquet (Correct answer)
- XML
Correct answer: Parquet
Parquet is a columnar format that Redshift can read efficiently, reducing the amount of data transferred and parsed during COPY.
Question 3: What is the recommended number of files when loading data into Redshift via COPY from S3?
- 1 large file
- A multiple of the number of slices in your cluster (Correct answer)
- Exactly 100 files
- One file per table column
Correct answer: A multiple of the number of slices in your cluster
Splitting data into a multiple of the cluster's slice count allows each slice to load data in parallel for maximum throughput.
Question 4: Which AWS service provides a fully managed ETL service that can move data into Amazon Redshift?
- AWS Data Pipeline
- AWS Glue (Correct answer)
- Amazon EMR
- AWS Batch
Correct answer: AWS Glue
AWS Glue is a fully managed serverless ETL service that can discover, catalog, and transform data before loading it into Redshift.
Question 5: What does the MANIFEST file do when used with the Redshift COPY command?
- Defines table schema for the COPY operation
- Specifies an explicit list of S3 files to load, ensuring exactly those files are loaded (Correct answer)
- Provides column-level encryption keys
- Maps source columns to destination columns
Correct answer: Specifies an explicit list of S3 files to load, ensuring exactly those files are loaded
A MANIFEST file lists exact S3 object paths to load, preventing accidental inclusion of unwanted files that match a prefix pattern.
Question 6: Which Amazon Kinesis service can deliver streaming data directly to Amazon Redshift for near real-time loading?
- Kinesis Data Streams
- Kinesis Data Analytics
- Kinesis Data Firehose (Correct answer)
- Kinesis Video Streams
Correct answer: Kinesis Data Firehose
Kinesis Data Firehose can buffer and batch streaming data before delivering it to Redshift via S3, with automatic COPY execution.
Data Warehousing on AWS Training ETL and Data Integration 1
Which AWS service is the primary recommended method for bulk-loading data into Amazon Redshift?