In a scenario where you need to explore and tune state information using stream-static joins and Delta Lake, describe the steps you would take to optimize the state store. Include considerations for state retention, checkpointing, and the use of `mapGroupsWithState`.

Simulated

Use mapGroupsWithState without setting a state retention policy and avoid checkpointing.

4.6%

Set a state retention policy, use checkpointing to ensure fault tolerance, and optimize the state store by using mapGroupsWithState.

90.8%

Ignore state retention and checkpointing, and directly perform stream-static joins.

2.8%

Use a batch query to avoid dealing with state information.

1.8%

Databricks Certified Data Engineer - Professional