ProblemsML0040

One Slow Dependency Blocks a Healthy Request

Hard

Problem

The model server that answers one particular kind of prediction occasionally goes slow or fails outright; and because nothing isolates it, every core application request that happens to need it fails right along with it, even requests that have nothing to do with whatever's wrong. Add a circuit breaker between the core application tier and that model server so its failures stay contained: the core path degrades gracefully with a fallback instead of taking healthy requests down with it.

Required components

Click to add a component to the canvas.

Additional components

Browse by category. Click or drag a component onto the canvas.

Drag components from the library onto the canvas, then drag from a component's right handle to connect it to another.

100%

Design canvas

Sign up to start designing

Sign up free

Premium is free for 58 more days.

$0 / $1,200