gradient descent valleys

Aug 2, 2026

Great observation but the conclusion is wrong. Local minima are rare but valleys are super common. So there is no move you aren’t seeing that will get you unstuck.

To extend the analogy, you need smaller steps in high gradient directions and bigger steps in low gradient directions.

I’m not sure how this maps to life exactly. But probably:

- don’t do volatile stuff (quit, blow up a relationship, etc.) You don’t want to be bouncing between jobs/relationships/crash diets.

- build up momentum in a promising direction (e.g. by learning a new skill every day)

- take bigger steps along boring, non-volatile promising directions (ie get more ambitious). Ask the girl (or boy) out, get on a plane to meet the customer, take shots out of your league, etc.

- Don’t worry too much about going in the wrong direction. You won’t hit a wall and have to backtrack, in a high dimensional space there is always a way forward.

I have no idea if this is actually right, all the usual disclaimers apply.

50 View on X