You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We typically expect norm to avoid spurious underflow. It looks like you already do so for RGB{Float64}, since norm([RGB(1e-300, 1e-300, 1e-300)]) correctly returns ≈ 1e-300 rather than underflowing to zero.
I would suggest doing norm computation in the precision of the output (Float64) rather than in the precision of the input, as well as being careful about scaling.
The text was updated successfully, but these errors were encountered:
From discourse:
We typically expect
norm
to avoid spurious underflow. It looks like you already do so forRGB{Float64}
, sincenorm([RGB(1e-300, 1e-300, 1e-300)])
correctly returns≈ 1e-300
rather than underflowing to zero.I would suggest doing
norm
computation in the precision of the output (Float64
) rather than in the precision of the input, as well as being careful about scaling.The text was updated successfully, but these errors were encountered: