 Posted Wednesday, March 31, 2004 9:36 AM
|
|
|
|
How many significant digits does a matrix retain?
I am running calculations that require at least 6 decimal places, however, when I view the matrix contents in the debug window, only 3 decimal places are shown.
|
|
|
Posted Wednesday, March 31, 2004 9:42 AM
|
|
|
|
Matrix object retains 15 significant digits and 15 significant digits are used for all calculations.
GetString method, if it is used without any parameter, returns by default just 3 significant digits.
You may also use the GetString method with a parameter specifying the number of decimal digits to return e.g.
Debug.Print MatObj.GetString(6)
Debug.Print MatObj.GetString(9)
Trifon Triantafillidis | Lead Developer | 
|
|
|
|
|