3. Optimizer/optimization algorithm
optimizer finds smallest value of cost function (= “optimal” transformation)
example: gradient descent
unction F
cost f
local
minimum
x
global