Jump to content
Main menu
Main menu
move to sidebar
hide
Navigation
Main page
Recent changes
Random page
Help about MediaWiki
Special pages
Niidae Wiki
Search
Search
Appearance
Create account
Log in
Personal tools
Create account
Log in
Pages for logged out editors
learn more
Contributions
Talk
Editing
Microsoft Excel
(section)
Page
Discussion
English
Read
Edit
View history
Tools
Tools
move to sidebar
hide
Actions
Read
Edit
View history
General
What links here
Related changes
Page information
Appearance
move to sidebar
hide
Warning:
You are not logged in. Your IP address will be publicly visible if you make any edits. If you
log in
or
create an account
, your edits will be attributed to your username, along with other benefits.
Anti-spam check. Do
not
fill this in!
=== Numeric precision === {{main|Numeric precision in Microsoft Excel}} [[File:Excel fifteen figure.PNG|thumb|390px|Excel maintains 15 figures in its numbers, but they are not always accurate: the bottom line should be the same as the top line.]] Despite the use of 15-figure precision, Excel can display many more figures (up to thirty) upon user request. But the displayed figures are ''not'' those actually used in its computations, and so, for example, the difference of two numbers may differ from the difference of their displayed values. Although such departures are usually beyond the 15th decimal, exceptions do occur, especially for very large or very small numbers. Serious errors can occur if decisions are made based upon automated comparisons of numbers (for example, using the Excel ''If'' function), as equality of two numbers can be unpredictable.{{citation needed|date=August 2016}} In the figure, the fraction 1/9000 is displayed in Excel. Although this number has a decimal representation that is an infinite string of ones, Excel displays only the leading 15 figures. In the second line, the number one is added to the fraction, and again Excel displays only 15 figures. In the third line, one is subtracted from the sum using Excel. Because the sum in the second line has only eleven 1's after the decimal, the difference when 1 is subtracted from this displayed value is three 0's followed by a string of eleven 1's. However, the difference reported by Excel in the third line is three 0's followed by a string of ''thirteen'' 1's and two extra erroneous digits. This is because Excel calculates with about half a digit more than it displays. Excel works with a modified 1985 version of the [[IEEE 754-2008|IEEE 754 specification]].<ref name="microsoft_spec">Microsoft's overview is found at: {{cite web|url=http://support.microsoft.com/kb/78113/en-us|title=Floating-point arithmetic may give inaccurate results in Excel|work=Revision 8.2; article ID: 78113|publisher=Microsoft support|date=June 30, 2010|access-date=July 2, 2010|archive-date=May 14, 2011|archive-url=https://web.archive.org/web/20110514172904/http://support.microsoft.com/kb/78113/EN-US|url-status=live}}</ref> Excel's implementation involves conversions between binary and decimal representations, leading to accuracy that is on average better than one would expect from simple fifteen digit precision, but that can be worse. See the main article for details. Besides accuracy in user computations, the question of accuracy in Excel-provided functions may be raised. Particularly in the arena of statistical functions, Excel has been criticized for sacrificing accuracy for speed of calculation.<ref name="Altman"> {{cite book|title=Numerical issues in statistical computing for the social scientist|last1=Altman|first1=Micah|author-link1=Micah Altman|last2=Gill|first2=Jeff|author-link2=Jeff Gill (academic)|last3=McDonald|first3=Michael|year=2004|publisher=Wiley-IEEE|isbn=978-0-471-23633-7|chapter-url=https://books.google.com/books?id=j_KevqVO3zAC&pg=PA12|chapter=Β§2.1.1 Revealing example: Computing the coefficient standard deviation|page=12}} </ref><ref name="deLevie2">{{cite book|first=Robert|last=de Levie|title=''cited work''|isbn=978-0-19-515275-3|year=2004|pages=45β46|publisher=Oxford University Press}}</ref> As many calculations in Excel are executed using VBA, an additional issue is the accuracy of VBA, which varies with variable type and user-requested precision.<ref name="John_Walkenbach_0"> {{cite book|title=Excel 2010 Power Programming with VBA|chapter=Defining data types|pages=198 ''ff'' and Table 8β1|isbn=978-0-470-47535-5|first=John|last=Walkenbach|year=2010|publisher=Wiley|chapter-url=https://books.google.com/books?id=dtSdrjjVXrwC&pg=PA198}}</ref>
Summary:
Please note that all contributions to Niidae Wiki may be edited, altered, or removed by other contributors. If you do not want your writing to be edited mercilessly, then do not submit it here.
You are also promising us that you wrote this yourself, or copied it from a public domain or similar free resource (see
Encyclopedia:Copyrights
for details).
Do not submit copyrighted work without permission!
Cancel
Editing help
(opens in new window)
Search
Search
Editing
Microsoft Excel
(section)
Add topic