In a scenario where you need to create and execute queries using a compute solution that leverages SQL serverless and Spark clusters, describe the best practices you would follow to optimize query performance and resource utilization. Include considerations for data partitioning, indexing, and caching strategies.