ProblemsML0021

Same Code, Different Results

Medium

Problem

Two engineers ran the exact same training script, on the exact same commit, a week apart; and got meaningfully different models. Nobody had touched the code. It took three days of on-call digging to prove the model was fine and the data underneath it wasn't: the dataset was being overwritten in place every time new data landed, so "the training dataset" silently meant something different every day.

Required components

Click to add a component to the canvas.

Additional components

Browse by category. Click or drag a component onto the canvas.

Drag components from the library onto the canvas, then drag from a component's right handle to connect it to another.

100%

Design canvas

Sign up to start designing

Sign up free

Premium is free for 58 more days.