Tag precision - This is page 90 - GeneraCodice

Why does the order affect the rounding when adding multiple doubles in C#

https://www.generacodice.com/en/articolo/186605/why-does-the-order-affect-the-rounding-when-adding-multiple-doubles-in-c-sharp

c# - .net - compiler-construction - rounding - precision

Why is 24.0000 not equal to 24.0000 in MATLAB?

https://www.generacodice.com/en/articolo/184521/why-is-24-0000-not-equal-to-24-0000-in-matlab

floating-point - matlab - precision

The precision of the long double output is not correct. What might be wrong?

https://www.generacodice.com/en/articolo/184040/the-precision-of-the-long-double-output-is-not-correct-what-might-be-wrong

math - c++ - precision - long-double

Double Precision

https://www.generacodice.com/en/articolo/181488/double-precision

c# - double - precision

What range of numbers can be represented in a 16-, 32- and 64-bit IEEE-754 systems?

https://www.generacodice.com/en/articolo/181362/what-range-of-numbers-can-be-represented-in-a-16-32-and-64-bit-ieee-754-systems

floating-point - numerical - precision - ieee-754

SQL Server: Calculation with numeric literals

https://www.generacodice.com/en/articolo/173296/sql-server-calculation-with-numeric-literals

floating-point - sql-server-2005 - precision

Best algorithm for avoiding loss of precision?

https://www.generacodice.com/en/articolo/161163/best-algorithm-for-avoiding-loss-of-precision

precision - numerical-analysis

Is it safe to check floating point values for equality to 0?

https://www.generacodice.com/en/articolo/157292/is-it-safe-to-check-floating-point-values-for-equality-to-0

c# - floating-point - .net - precision - zero

MATLAB - floor question

https://www.generacodice.com/en/articolo/154855/matlab-floor-question

floating-point - matlab - rounding - precision

What is the precision of long double in C++?

https://www.generacodice.com/en/articolo/150542/what-is-the-precision-of-long-double-in-c

c++ - precision - long-double

«
87
88
89
90
91
92
»

Results found: 928