To query data directly from JSON files using Databricks SQL, the prefix json is used after the FROM keyword, followed by the path to the JSON file. This indicates that the query should interpret the source data as JSON format, enabling SQL-like querying capabilities on semi-structured JSON data.