Gradient Descent

Calculate Gradent

Geometric form of the gradient descent

The figue below shows the purpose of the gradient descent and finds the minimum value of J(( heta))

In fact,the real goal graph of J(( heta)) is similar to the following,because it is convex function with only one global optimal solution,so don't worry about finding the local optimal solution as shown above.

Three steps of the Gradient Descent

1

2

3

To Be Continued