-
Notifications
You must be signed in to change notification settings - Fork 20
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve numerical stability of ground plane distance estimation #102
Comments
Suppose you have a pair Case 0: Case 1: Case 2: The only possibility for numerical instability is when To compute the perpendicular direction |
As a unit test for this system, I suggest starting with the extended normal |
Currently, I believe the main source of this numerical precision issue is in This isn't necessary because the plane's normal is multiplied by an isometry. I believe simply getting rid of the call to |
At sufficiently high elevations with respect to the ground plane, glitchy floating islands appear. This is likely due to exponential growth of the magnitude of the normal vector encoding the distance to the ground plane. We could mitigate the representation problem by throwing additional precision at the problem in the form of an explicit exponent: rather than the vector
v
, store the pair(v/(2^c), c)
. Further investigation (@MagmaMcFry?) is necessary to determine the details of computing distance/direction of the plane from this representation without running into the same issue again.The text was updated successfully, but these errors were encountered: