-
×InformationFix Windows 10 Update Issues
Resolve Windows 10 related issues for your HP computers or printers by HP Windows 10 Support Center
-
-
×InformationFix Windows 10 Update Issues
Resolve Windows 10 related issues for your HP computers or printers by HP Windows 10 Support Center
-
- HP Community
- >
- Other Products
- >
- Calculators
- >
- Rounding too early
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page

Create an account on the HP Community to personalize your profile and ask a question

Rounding too early
03-07-2018 08:02 AM

Hi, I am a highschool student using this graphing calculator for my geometry class. This calculator is rounding numbers too soon in a string of numbers and that is causing problems. For example, when I tried to find the volume of a cone with a radius of 14 and a height of 14.3527000944, the calculator automatically rounded the 14.3527000944 to a 14.3527001 giving me the wrong answer and costing me valuable test points. Please help me to find a way to make the calculator more accurate. I tried using the floating setting for numbers like my geometry teacher recommended but that just rounded the answer up to 5 decimal places instead of 8 decimal places, and left the 14.3527001 unaffected.
03-07-2018 04:59 PM

Suggestion: set the Number Format (in Home Settings) to Standard, which shows ALL the internal digits. That way you can see exactly what the value in the calculator really is (in Home view, of course). You used Floating 8 mode, which shows at most 9 significant digits. Rounded 8 mode and Fixed 8 mode show at most 8 digits after the decimal point. But all these modes hide digits which are actually there, which is often a Bad Thing when doing real math. To see all the digits, use Standard mode, whose philosophy is "What You See Is Exactly What You Have".
Disclaimer: I don't work for HP. I'm just a high school math teacher who has enjoyed using HP calculators since 1976.
03-07-2018 07:09 PM

Note that no digits are acutally "lost" at all. That is purely a display setting and could not have impacted your final result.
How did you "lose points"? It wouldn't have been from rounding unless you teacher was grading on 12 digits or something????
Please put more details so you can get the help you want. What did you enter? What did the result say? What was your process?
Although I work for the HP calculator group as a head developer of the HP Prime, the views and opinions I post here are my own.
Didn't find what you were looking for? Ask the community