3. Optimizer/optimization algorithm
optimizer finds smallest value of cost function (= “optimal” transformation)
cost function F
x
local
minimum
global
example: gradient descent