Discussion

PRPC calculation bug

I met an error: if I use an int to multiply another one, sometimes there will an wrong value which is a double value. Eg: 888 * 100 = 88799.999999999997

***Updated by moderator: Marissa to close post***
This post has been archived for educational purposes. Contents and links will no longer be updated. If you have the same/similar question, please write a new post.

Comments

Keep up to date on this post and subscribe to comments

March 25, 2009 - 11:44pm

are the properties used in the calculation defined as doubles? If so, this always occurs see www2.hursley.ibm.com/decimal/.