⊕
Gradient Descent
High School
Definition
An optimization algorithm that iteratively moves in the opposite direction of the gradient to find the minimum.
Formulas
x_n+1 = xₙ - α ∇ f(xₙ)
Gradient descent update rule
α
Learning rate (step size)
Examples
Example 1
Minimize f(x) = x² using gradient descent (x₀=5, α=0.1).
Applications
Machine Learning
Neural network training
Statistics
Maximum likelihood estimation
Economics
Cost minimization
Related Documents
Was this page helpful?