A data science team is using a Databricks cluster with the Databricks Runtime for Machine Learning to develop and deploy machine learning models. The team has identified a need for a new Python library that is not currently installed on the cluster. Describe the steps you would take to install this new library on the cluster so that it is available to all notebooks, and explain how you would ensure that the library is compatible with the existing environment.