Explanation:
Option B is the correct answer as it involves loading the DataFrame using a secure connection to the data source and applying column-level encryption to the sensitive columns. This approach ensures that the data is protected both in transit and at rest. Option A is partially correct but does not address encryption of sensitive columns. Option C is incorrect as it does not provide specific details on how the data is secured during the loading process. Option D is incorrect as it focuses on encryption at rest, but does not address the secure loading of the DataFrame.
Ultimate access to all questions.
No comments yet.
You are responsible for loading a DataFrame with sensitive information into an Azure Databricks cluster. Describe the steps you would take to ensure that the data is loaded securely and maintain its confidentiality.
A
Use Azure Databricks' built-in libraries to read the data from a secure source and apply encryption-in-transit.
B
Load the DataFrame using a secure connection to the data source, and apply column-level encryption to the sensitive columns.
C
Utilize Azure Databricks' data access APIs to securely load the data and store it in an encrypted format within the cluster.
D
Encrypt the data at rest using Azure Key Vault and load the encrypted DataFrame into the Azure Databricks cluster.