Tag floating-point-precision - This is page 30 - GeneraCodice

Power of number close to 1

https://www.generacodice.com/en/articolo/2174604/power-of-number-close-to-1
  floating-point  -  floating-point-precision  -  r  -  numerical-stability
StackOverflow StackOverflow

Widening precision with cast results in how much precision?

https://www.generacodice.com/en/articolo/2167376/widening-precision-with-cast-results-in-how-much-precision
  c++  -  floating-point-precision
StackOverflow StackOverflow

Coping with big ints in 32 bit PHP

https://www.generacodice.com/en/articolo/2019819/coping-with-big-ints-in-32-bit-php
  floating-point  -  PHP  -  int  -  floating-point-precision
StackOverflow StackOverflow

OpenSURF different output with same image when launching from Visual Studio or directly from .EXE

https://www.generacodice.com/en/articolo/1871696/opensurf-different-output-with-same-image-when-launching-from-visual-studio-or-directly-from-exe
  floating-point  -  visual-studio  -  floating-point-precision  -  surf
StackOverflow StackOverflow

Why do my float values lose precision and drop decimals? Example code below

https://www.generacodice.com/en/articolo/1757004/why-do-my-float-values-lose-precision-and-drop-decimals-example-code-below
  math  -  c++  -  floating-point-precision
StackOverflow StackOverflow

Strange Heroku float bit-precision error (ruby on rails)

https://www.generacodice.com/en/articolo/1748548/strange-heroku-float-bit-precision-error-ruby-on-rails
  floating-point  -  ruby-on-rails  -  postgresql  -  floating-point-precision  -  heroku
StackOverflow StackOverflow

gcc double printf precision - wrong output

https://www.generacodice.com/en/articolo/1741731/gcc-double-printf-precision-wrong-output
  floating-point  -  linux  -  printf  -  gcc  -  floating-point-precision
StackOverflow StackOverflow

How are the TI operating systems coded not to have floating point error?

https://www.generacodice.com/en/articolo/1734443/how-are-the-ti-operating-systems-coded-not-to-have-floating-point-error
  floating-point  -  floating-point-precision  -  ti-basic
StackOverflow StackOverflow

Measure floating-point error?

https://www.generacodice.com/en/articolo/1734305/measure-floating-point-error
  floating-point  -  floating-point-precision
StackOverflow StackOverflow

Set specific precision of a BigDecimal

https://www.generacodice.com/en/articolo/1716442/set-specific-precision-of-a-bigdecimal
  java  -  bigdecimal  -  floating-point-precision
StackOverflow StackOverflow
Results found: 321
scroll top