Ultimate access to all questions.
A data engineer attempts to delete a Spark SQL table named my_table
to remove both its metadata and data. After executing the command DROP TABLE IF EXISTS my_table;
, the table disappears from the list of tables, but the data files remain. What explains the persistence of the data files despite the metadata deletion?