Search code examples
lossless conversion of float to string and back: is it possible?...


stringfloating-pointfloating-accuracy

Read More
Is every 32-bit floating-point number is exactly representable with 64-bit floating number...


floating-pointieee-754floating-accuracy

Read More
Exponential limits for C and Matlab...


cmatlabfloating-accuracydigits

Read More
Equality of floating point numbers after storing/loading/moving...


floating-pointcpu-architecturefloating-accuracy

Read More
Fast Exp calculation: possible to improve accuracy without losing too much performance?...


c#performancefloating-accuracyexp

Read More
Multiplication of large numbers python...


pythonpython-3.xfloating-accuracy

Read More
Avoiding float rounding imprecision...


precisionfloating-accuracy

Read More
Program giving inaccurate value...


dartfloating-accuracy

Read More
Addressing polynomial multiplication and division "overflow" issue...


numpyfloating-accuracypolynomialspolynomial-math

Read More
Accurate computation of principal branch of the Lambert W function with standard C math library...


calgorithmmathfloating-pointfloating-accuracy

Read More
Why `0.4/2` equals to `0.2` meanwhile `0.6/3` equals to `0.19999999999999998` in python?...


pythonfloating-pointfloating-accuracyieee-754

Read More
What needs to be modified in the code to achieve a desired accuracy of floating point result?...


pythonfloating-accuracy

Read More
Prevent Libreoffice converted CSV from stripping trailing zero?...


export-to-csvprecisionlibreofficefloating-accuracylibreoffice-calc

Read More
Floating-point equality unexpectedly working...


javafloating-pointprecisionfloating-accuracy

Read More
How to correctly set the 'rtol' and 'atol' in scipy integration module 'solve_iv...


scipyodefloating-accuracyode45

Read More
tuple to numpy, data accuracy...


pythonnumpyfloating-accuracy

Read More
Why rounding errors when casting float(53) to VARCHAR(MAX)...


t-sqlfloating-accuracy

Read More
How many arithmetic operations should it take to calculate trig functions?...


mathfloating-pointprecisiontrigonometryfloating-accuracy

Read More
Floating-point errors in cube root of exact cubic input...


pythonmathfloating-pointintegerfloating-accuracy

Read More
How to cast float to int in C# so that it outputs the same value as float.ToString()?...


c#floating-pointfloating-accuracy

Read More
Google Sheet yields infinitesimal number as remainder of an integer/whole number...


google-sheetssumfloating-pointmodulofloating-accuracy

Read More
Assembly differences between unrolled for-loops cause differing float results...


cassemblycompiler-optimizationfloating-accuracypowerpc

Read More
Understanding 32 bit floats...


architecturefloating-pointprecision32-bitfloating-accuracy

Read More
How do I avoid catastrophic cancellation for small numbers in f(x) = (1-cos(x))/x**2 in Python 3.7?...


pythonpython-3.xfunctiontrigonometryfloating-accuracy

Read More
Differences between format long and format long g...


matlabdecimalroundingfloating-accuracy

Read More
Increasing the number of observations have R throw random coefficients - Numerical stability problem...


rregressionlinear-regressionfloating-accuracynumerical-stability

Read More
Java (suggestion) - implement double as two integers?...


javafloating-pointprecisionfloating-accuracy

Read More
Why is double 0.1 more accurate than its long double version?...


numpyfloating-pointfloating-accuracylong-double

Read More
Double (IEEE754 Double precision 64-bit) binary representation...


javafloating-pointdoubleprecisionfloating-accuracy

Read More
How dangerous is it to compare floating point values?...


objective-cioscfloating-pointfloating-accuracy

Read More
BackNext