Logistic regression & Newton’s method

perceptron learning algorithm:

Newton’s method:

Hessian:

When Newton’s method is applied to maximize the logistic regression log likelihood function ℓ(θ), the resulting method is also called Fisher scoring.