Tag floating-point-precision - This is page 3 - GeneraCodice

Anyone know why matlab would show many significant digits for no reason?

https://www.generacodice.com/en/articolo/13083340/anyone-know-why-matlab-would-show-many-significant-digits-for-no-reason

  matlab  -  floating-point-precision

StackOverflow

Octave 1/3 and 0.1 values

https://www.generacodice.com/en/articolo/13023562/octave-1-3-and-0-1-values

  floating-point-precision  -  rounding-error  -  precision  -  octave

StackOverflow

using real(A[,kind=]) in passing a single precision array as a double precision to a subroutine in Fortran 90/2003

https://www.generacodice.com/en/articolo/13015045/using-real-a-kind-in-passing-a-single-precision-array-as-a-double-precision-to-a-subroutine-in-fortran-90-2003

  arrays  -  heap-memory  -  floating-point-precision  -  fortran90

StackOverflow

Determine precision at runtime in c

https://www.generacodice.com/en/articolo/12934531/determine-precision-at-runtime-in-c

  c  -  floating-point-precision

StackOverflow

Error in float to string conversion

https://www.generacodice.com/en/articolo/12886975/error-in-float-to-string-conversion

  c++  -  c  -  java  -  floating-point-precision

StackOverflow

Rounding a floating number

https://www.generacodice.com/en/articolo/12838657/rounding-a-floating-number

  double  -  java  -  floating-point-precision

StackOverflow

Postgres decimal precision VS Excel

https://www.generacodice.com/en/articolo/12769378/postgres-decimal-precision-vs-excel

  types  -  postgresql  -  excel  -  floating-point-precision  -  floating-accuracy

StackOverflow

floating point accuracy in MIPS assembly

https://www.generacodice.com/en/articolo/12737086/floating-point-accuracy-in-mips-assembly

  floating-point  -  assembly  -  mips  -  floating-point-precision  -  floating-accuracy

StackOverflow

Less compiler uses different floating point precision on Linux vs OSX

https://www.generacodice.com/en/articolo/12695311/less-compiler-uses-different-floating-point-precision-on-linux-vs-osx

  floating-point-precision  -  less

StackOverflow

Python floating point error that has left me puzzled [duplicate]

https://www.generacodice.com/en/articolo/12688966/python-floating-point-error-that-has-left-me-puzzled-duplicate

  python  -  floating-point-precision

StackOverflow

• «
• 1
• 2
• 3
• 4
• 5
• 6
• »

Results found: 321