3. Optimizer/optimization algorithm
optimizer finds smallest value of cost function (= “optimal” transformation)
cost function F
example: gradient descent
x
local
minimum
global