Ignore feature selection and focus solely on tuning the model's hyperparameters, as it does not have a significant impact on the model's performance.

Manually select a fixed set of features before running the hyperparameter tuning process, as incorporating feature selection into the optimization process is too complex.

Use Hyperopt to define a search space that includes both the model's hyperparameters and the feature selection process, allowing for joint optimization of both aspects.

Run separate hyperparameter tuning processes for different subsets of features and compare the results to determine the best combination of features and hyperparameters.