Given a dataset with a mix of numerical and categorical features, describe how you would handle feature engineering within a Spark ML pipeline. Discuss the techniques you would use for transforming numerical features and encoding categorical features, and explain why these techniques are suitable. Additionally, outline any potential challenges in implementing these techniques and how you would mitigate them.