Bayesian optimization is identical to grid search but with a different name.

Bayesian optimization uses a surrogate model to approximate the performance of the model with different hyperparameters and an acquisition function to decide which hyperparameters to evaluate next, making it more efficient than grid search and random search.

Bayesian optimization is more complex than random search and grid search but offers no significant advantages.

Bayesian optimization is only used for tuning hyperparameters of deep learning models, not other types of models.