Simon Rasing

Simon Rasing

  • NA
  • 1
  • 2.2k

double precision problem

Feb 12 2012 8:14 AM
Question from a beginner. I used doubles in a program to calculate cable sag. The formula itself is pretty sophisticated, lots of math.tanh()'s and math.sqrt()'s. After analyzing the results i found out there's a slight precision problem. Doubles don't seem precise enough for this particulair problem. Is there a way to solve this? ---Posted from iPhone App---

Answers (1)