Databricks Data Engineer Professional Certification Sample Questions

01. A data engineer needs to use a Python package to process data. As a result, they need to install the Python package on all of the nodes in the currently active cluster. What describes a method of installing a Python package scoped at the notebook level to all nodes in the currently active cluster?
a) Use %pip install in a notebook cell
b) Use %sh pip install in a notebook cell
c) Run source env/bin/activate in a notebook setup script
d) Install libraries from PyPI using the cluster UI
e) Use b in a notebook cell

02. A Delta Lake table was created with the query:
- CREATE TABLE dev.my_table
- USING DELTA
- LOCATION "/mnt/dev/my_table"
Realizing that the table needs to be used by other and its name is misleading, the below code was executed:
- ALTER TABLE dev.my_table RENAME TO dev.our_table
Which result will occur after running the second command?
a) The table name change is recorded in the Delta transaction log.
b) The table reference in the metastore is updated and all data files are moved.
c) The table reference in the metastore is updated and no data is changed.
d) A new Delta transaction log is created for the renamed table.
e) All related files and metadata are dropped and recreated in a single ACID transaction.

03. What are dimensions in data warehousing?
a) Measurements of data processing speed
b) Data categories used for organization and filtering
c) The physical size of the database
d) The different levels of data redundancy

04. A data engineer is developing an ETL workflow that could see late-arriving, duplicate records from its single source. The data engineer knows that they can deduplicate the records within the batch, but they are looking for another solution.
Which approach allows the data engineer to deduplicate data against previously processed records as it is inserted into a Delta table?
a) VACUUM the Delta table after each batch completes.
b) Rely on Delta Lake schema enforcement to prevent duplicate records.
c) Set the configuration delta.deduplicate = true.
d) Perform a full outer join on a unique key and overwrite existing data.
e) Perform an insert-only merge with a matching condition on a unique key.

05. Which of the following features are provided by Databricks Repos?
(Choose all that apply)
a) Version control integration
b) Automated machine learning
c) Collaboration and code sharing
d) Continuous integration/continuous deployment (CI/CD) capabilities

06. A data engineering team is trying to transfer ownership from its Databricks Workflows away from an individual that has switched teams. However, they are unsure how permission controls specifically for Databricks Jobs work. Which statement correctly describes permission controls for Databricks Jobs?
a) The creator of a Databricks Job will always have "Owner" privileges; this configuration cannot be changed.
b) Databricks Jobs must have exactly one owner; "Owner" privileges cannot be assigned to a group.
c) Other than the default "admins" group, only individual users can be granted privileges on Jobs.
d) Only workspace administrators can grant "Owner" privileges to a group.
e) A user can only transfer Job ownership to a group if they are also a member of that group.

07. Which technologies are commonly used for stream processing?
(Choose all that apply)
a) Apache Kafka
b) Hadoop
c) Apache Spark
d) MongoDB

08. The data architect has mandated that all tables in the Lakehouse should be configured as external, unmanaged Delta Lake tables. Which approach will ensure that this requirement is met?
a) Whenever a table is being created, make sure that the LOCATION keyword is used.
b) When tables are created, make sure that the EXTERNAL keyword is used in the CREATE TABLE statement.
c) When the workspace is being configured, make sure that external cloud object storage has been mounted.
d) Whenever a database is being created, make sure that the LOCATION keyword is used.
e) Whenever a table is being created, make sure that the LOCATION and UNMANAGED keywords are used.

09. Why is log rotation important in log management?
a) To enhance system security
b) To prevent log files from becoming too large
c) To speed up the system
d) To improve user experience

10. Why is it important to have real-time monitoring in IT systems?
(Choose all that apply)
a) To immediately identify and respond to issues
b) To track historical data trends
c) To prevent data loss
d) To ensure system reliability and availability