How do you design data pipelines to take advantage of spot instances and preemptible VMs? What workloads are suitable, and how do you handle interruptions?

Sample answer preview

Spot instances from AWS, preemptible VMs from GCP, and spot VMs from Azure offer compute capacity at sixty to ninety percent discounts compared to on-demand pricing. The trade-off is that the cloud provider can reclaim these instances with little notice, typically two minutes…