Question

When dividing by 1000 I sometime run across a bug that doesn't do the division "correctly". For example, when dividing 90.55 by 1000 instead of getting .09055 I get .090549999999.

<c:out value="${bean.paPrice / 1000}" />

Why is this happening? Is this a result of floating point math? A google search seemed to indicate that this may be a culprit, but I have found no concrete answer.

To fix this I can round the answer to 5 digits, but it seems like this is just a patch to a deeper problem.

<fmt:formatNumber type="number" maxFractionDigits="5" value="${bean.paPrice / 1000}" />
Was it helpful?

Solution

It's not a problem, it's just a natural result of the binary representation of floating point. Round your values and don't worry about it.

OTHER TIPS

Yes, this is a common floating-point format issue.

Licensed under: CC-BY-SA with attribution
Not affiliated with StackOverflow
scroll top