Message91020
An example of a case that's almost 3.5 ulps out (Python 2.6):
Python 2.6.2 (r262:71600, Jul 8 2009, 09:56:31)
[GCC 4.0.1 (Apple Inc. build 5490)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from __future__ import division
>>> m = 295147931372582273023
>>> n = 295147932265116303360
>>> m/n
0.99999999697597697
The correctly rounded result would be the float given by
0.9999999969759773. |
|
| Date |
User |
Action |
Args |
| 2009-07-28 22:29:07 | mark.dickinson | set | recipients:
+ mark.dickinson, tim.peters, terry.reedy, christian.heimes |
| 2009-07-28 22:29:06 | mark.dickinson | set | messageid: <[email protected]> |
| 2009-07-28 22:29:05 | mark.dickinson | link | issue1811 messages |
| 2009-07-28 22:29:05 | mark.dickinson | create | |
|