You are here

Numbers change when use Edit as Table

I have been trying to use the Edit as table function for a graphical function. When I enter a number such as 22 for the value, hit ok, and then hit Edit as table again, I see that the number has change, if only slightly, to 22.029, or in another case to 21.9807. What is going on?

Sincerely, Dale

Reporter: 
daler6
Created: 
Mon, 20/04/2015 - 22:12
Updated: 
Tue, 21/04/2015 - 10:46

Comments

The sketch graph tool loads the values from the positions of the points on the graph, and entering numbers in the table form merely sets the points to the nearest available pixel so the numbers will not be reproduced exactly.

This tool is meant for cases where the general form of a relationship can be sketched and the precise values are not important. If the exact values are important, you should use the table function, or a file parameter (fixed array or time series) if there are more than a hundred or so data points.