Questions about rounding-error
Read more about rounding-error
python (65.2k questions)
javascript (44.3k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (13k questions)
Find least significant digit in a double in Python
I have a lot of financial data stored as floating point doubles and I'm trying to find the least significant digit so that I can convert the data to integers with exponent.
All the data is finite, e.g...
Spedley
Votes: 0
Answers: 2
How to calculate sum of reciprocals with integers?
I would like to calculate the sum of reciprocals of a list of integers (and see if it is larger or equal to 1):
I want to work with integers to avoid floating-point rounding issues. To do so, I want ...
Rémi Baudoux
Votes: 0
Answers: 3
Why does calculated loss differs from logged loss in pytorch_lightning?
I am training a model and want to create a confusion matrix every time the validation loss improves. So, in validation_epoch_end I check if the loss of this epoch is better than any previous loss. I r...
HennyKo
Votes: 0
Answers: 0
Is there a better Google Sheets rounding/floating point error workaround?
I have a Sheet that gives me a rounding error:
Rounding 0.415 to 2 places should result in 0.42, which it does when given the number directly. But the red line gives 0.41. The intermediate result bef...
William Morris
Votes: 0
Answers: 1