How do you design data pipelines that scale with growing data volumes? What architectural patterns support scalability?

Sample answer preview

Scalable pipeline design ensures that performance does not degrade unacceptably as data volumes grow. The goal is linear or better scaling, where doubling data requires at most doubling resources rather than exponentially more. Partition data to enable parallel processing.