python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
How variable alpha changes SGDRegressor behavior for outlier?
I am using SGDRegressor with a constant learning rate and default loss function. I am curious to know how changing the alpha parameter in the function from 0.0001 to 100 will change regressor behavior...
Ross_you
Votes: 0
Answers: 1
Visualize Stochastic Gradient Descent using Contour plot in Python
I tried to implement the stochastic gradient descent method and apply it to my build dataset. The data set follows a linear regression ( wx + b = y).
The process has also somehow converged towards the...
pivive
Votes: 0
Answers: 0
Encountering a TypeError: can't multiply sequence by non-int of type 'float' when creating an SGD algorithm
# We first define the observations as a list and then also as a table for the experienced worker's performance.
Observation1 = [2.0, 6.0, 2.0]
Observation2 = [1.0, 5.0, 7.0]
Observation3 = [5.0, 2.0,...
NSM_2000
Votes: 0
Answers: 1
Why are the gradients not equivalent when using loss.backward() v.s torch.auto.grad?
I ran into this weird behavior when trying to "manually" optimize a network's parameters via SGD. When attempting to update the model's parameters using the following way, it works just fine...
Omar AlSuwaidi
Votes: 0
Answers: 1