Optimization-Algorithms

Implemented Numerical Optimization Algorithms For single variable and Multi variables linear regression with stop criteria:

1- Batch Gradient Descent (GD)

2- Mini-Batch GD

3- Stochastic GD

4- Momentum-Based GD

5- NAG

6- Adagrad, RMSProp, and Adam.