Skip to main content
gamedev.net
๐Ÿ”’ Locked

Perfect calculation

Started by walkingcarcass Jun 4, 2003 at 11:26 AM 2 replies 650+ views
Original Post
walkingcarcass
walkingcarcass
A processor has a numerical innacuracy, sin(0)=0.0000254 and things like that. My calculator just told me (sin(pi/3))^2=0.75 how come it isn''t 0.7499989984 or something? It can give perfect answers to (log_e(2+(-1+e^arctan(1))))/pi and 1-10^-0.5 etc. How? ******** A Problem Worthy of Attack Proves It''s Worth by Fighting Back
spraff.net: don't laugh, I'm still just starting...
Qw3r7yU10p!
Qw3r7yU10p!
This isn''t really something for discussion really, is it? You need an article or a book to explain it to you.

Have you tried searching the web or your college library?
Xiachunyi
Xiachunyi
Depends on how many sig figs are used in the calculation and how many fixed decimal places you want.

Topic Locked

This topic has been locked by a moderator. New replies are not allowed.

Sign in to reply to this topic.