Databricks Certified Data Engineer - Associate
Get started today
Ultimate access to all questions.
A data engineer wants to create a relational object by pulling data from two tables. The relational object does not need to be used by other data engineers in other sessions. In order to save on storage costs, the data engineer wants to avoid copying and storing physical data.
Which of the following relational objects should the data engineer create?
Real Exam
Community
KKeng
A
Spark SQL Table
B
View
C
Database
D
Temporary view
E
Delta Table
Explanation:
Explanation
The correct answer is D. Temporary view.
Here's why:
-
Avoids copying and storing physical data: Temporary views are logical constructs that don't store physical data. They are defined by a query that references existing tables, so no additional storage is required.
-
Not needed by other data engineers in other sessions: Temporary views are session-scoped, meaning they only exist for the duration of the current Spark session and are not visible to other users or sessions.
-
Comparison with other options:
- A. Spark SQL Table: Tables store physical data, which would incur storage costs.
- B. View: While views don't store physical data, they are persistent and visible to other users/sessions, which is unnecessary for this use case.
- C. Database: A database is a container for tables/views, not a relational object that pulls data from tables.
- E. Delta Table: Delta tables store physical data in Delta Lake format, which would incur storage costs.
Key points:
- Temporary views are ideal for session-specific transformations that don't need persistence or sharing.
- They provide a cost-effective way to create relational objects without duplicating data.
- The syntax in Spark SQL would be:
CREATE TEMPORARY VIEW view_name AS SELECT ... FROM table1 JOIN table2 ...
Comments
Loading comments...