Tag floating-point-precision - Это страница 3 - GeneraCodice

Anyone know why matlab would show many significant digits for no reason?

https://www.generacodice.com/ru/articolo/13083340/anyone-know-why-matlab-would-show-many-significant-digits-for-no-reason
  matlab  -  floating-point-precision
StackOverflow StackOverflow

Octave 1/3 and 0.1 values

https://www.generacodice.com/ru/articolo/13023562/octave-1-3-and-0-1-values
  floating-point-precision  -  rounding-error  -  precision  -  octave
StackOverflow StackOverflow

using real(A[,kind=]) in passing a single precision array as a double precision to a subroutine in Fortran 90/2003

https://www.generacodice.com/ru/articolo/13015045/using-real-a-kind-in-passing-a-single-precision-array-as-a-double-precision-to-a-subroutine-in-fortran-90-2003
  arrays  -  heap-memory  -  floating-point-precision  -  fortran90
StackOverflow StackOverflow

Determine precision at runtime in c

https://www.generacodice.com/ru/articolo/12934531/determine-precision-at-runtime-in-c
  c  -  floating-point-precision
StackOverflow StackOverflow

Error in float to string conversion

https://www.generacodice.com/ru/articolo/12886975/error-in-float-to-string-conversion
  c++  -  c  -  java  -  floating-point-precision
StackOverflow StackOverflow

Rounding a floating number

https://www.generacodice.com/ru/articolo/12838657/rounding-a-floating-number
  double  -  java  -  floating-point-precision
StackOverflow StackOverflow

Postgres decimal precision VS Excel

https://www.generacodice.com/ru/articolo/12769378/postgres-decimal-precision-vs-excel
  types  -  postgresql  -  excel  -  floating-point-precision  -  floating-accuracy
StackOverflow StackOverflow

floating point accuracy in MIPS assembly

https://www.generacodice.com/ru/articolo/12737086/floating-point-accuracy-in-mips-assembly
  floating-point  -  assembly  -  mips  -  floating-point-precision  -  floating-accuracy
StackOverflow StackOverflow

Less compiler uses different floating point precision on Linux vs OSX

https://www.generacodice.com/ru/articolo/12695311/less-compiler-uses-different-floating-point-precision-on-linux-vs-osx
  floating-point-precision  -  less
StackOverflow StackOverflow

Python floating point error that has left me puzzled [duplicate]

https://www.generacodice.com/ru/articolo/12688966/python-floating-point-error-that-has-left-me-puzzled-duplicate
  python  -  floating-point-precision
StackOverflow StackOverflow
Результаты найдены: 321
scroll top