You are working on a project that requires creating data pipelines to move and process data. You have been asked to configure the batch size for the data pipeline. What factors should you consider when configuring the batch size?