Database Management
Reference Manual
Expressions
: Precision of Comparisons
Precision of Comparisons
To allow for small losses of accuracy, the following tolerances are used.
Object
Tolerance
Number
Tolerance factor of 0.000001.
In other words, if the difference between two reals is not greater than 0.000001* (maximum of the two values) then the values are considered to be equal. e.g.
•
(1.000001 GT 1) is FALSE as it considers 1.000001; and 1 to be equal;
•
(1.000002 GT 1) is TRUE.
Position
Considered to be equal if within 0.5 mm of one another.
Direction or Orientation
Considered to be equal if values are within 0.005.
1974 to current year.
AVEVA Solutions Limited and its subsidiaries. All rights reserved.
