Zen of Stochastic Gradient Descent Principle

Zen of Stochastic Gradient Descent Principle

All planning and estimation of cost function would go in vain if you see a tub of ice cream. So, keeping such distractions away from ones eye sight must also be considered a variable. Such variables – the ones that divert the direction of plan – actually must be of more importance. lol.

Analyse -> Choose direction -> Iterate

Makes sense for everything we intend to do. Information overload is a real issue these days. There seems to be so much to digest that it gets difficult to decide on something.

You’ve explained it perfectly: Steer clear of the unnecessary information, analyze the remaining information to choose the correct direction and do that every once in a while.