ProblemsML0034

One Partition, All the Stragglers

Medium

Problem

The nightly batch job keeps missing its deadline, and it's not for lack of instances; someone already scaled the fleet up to 15 instances and it's STILL slow. The real problem is upstream: all 2,000,000 records landed on a single oversized partition, so no matter how many instances are sitting around, only one of them is actually doing any work while the rest idle.

Required components

Click to add a component to the canvas.

Additional components

Browse by category. Click or drag a component onto the canvas.

Drag components from the library onto the canvas, then drag from a component's right handle to connect it to another.

100%

Design canvas

Sign up to start designing

Sign up free

Premium is free for 58 more days.

$0 / $1,300