Parallelization in a distributed computing system refers to the simultaneous execution of multiple tasks or operations across distributed nodes. This approach divides larger tasks into smaller subtasks that can be processed concurrently on different nodes, leveraging parallel processing to enhance efficiency and speed.