You are working on a project that requires creating data pipelines to move and process data. You have been asked to ensure the scalability and flexibility of the data pipeline. What measures should you consider when designing a data pipeline for scalability and flexibility?