Answer-first summary for fast verification
Answer: Temporary view
A Temporary View is the appropriate choice in this case because it allows the data engineer to create a relational object based on pulling data from two tables without persisting the data to storage. Since the requirement is to avoid copying and storing physical data and the relational object does not need to be used by other engineers in other sessions, a Temporary View serves well as it is session-based and gets dropped when the session ends. Hence, storage costs are minimized.
Author: LeetQuiz Editorial Team
Ultimate access to all questions.
In the context of optimizing data processing and storage efficiency, a data engineer is tasked with creating a relational object by integrating data from two existing tables. This relational object is intended exclusively for the current session and will not be accessed by other data engineers in different sessions. To minimize storage costs, the data engineer prefers a method that avoids duplicating and storing physical data. Given these requirements, which type of relational object should the data engineer create?
A
Spark SQL Table
B
View
C
Database
D
Temporary view
No comments yet.