ACP ACP Data Engineering & Workflow Automation

Question 1

Which pandas method reads a CSV file into a DataFrame and can handle large files by specifying a `chunksize` parameter?

Accepted Answer

pd.read_csv()

Answer

pd.read_table()

Answer

pd.from_csv()

Answer

pd.load_csv()

Question 2

In an ETL pipeline using pandas, which operation is used to combine two DataFrames based on a shared key column (similar to a SQL JOIN)?

Accepted Answer

pd.merge()

Answer

pd.concat()

Answer

pd.join_tables()

Answer

pd.combine()

Question 3

Which Python library provides the `Pipeline` class to chain preprocessing steps and a final estimator into a single reusable workflow object?

Accepted Answer

scikit-learn

Answer

pandas

Answer

numpy

Answer

scipy

Question 4

When processing a large dataset in chunks to avoid memory overflow, which pandas parameter in `read_csv()` controls how many rows are loaded per iteration?

Accepted Answer

chunksize

Answer

batch_size

Answer

nrows

Answer

max_rows

Question 5

Which SQLAlchemy function is used alongside pandas `read_sql()` to connect to a database and execute SQL queries into a DataFrame?

Accepted Answer

create_engine()

Answer

connect_db()

Answer

open_session()

Answer

make_connection()

Question 6

In pandas, which method writes a DataFrame to a SQL database table using a SQLAlchemy engine?

Accepted Answer

df.to_sql()

Answer

df.to_database()

Answer

df.write_sql()

Answer

df.export_sql()