-
Notifications
You must be signed in to change notification settings - Fork 53
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
exp
operator producing negative values when x
is a large negative number.
#505
Comments
This may be a good starting point to transition to an actual LUT |
While I am able to simulate the component and reproduce the error, I have no clue why it happens. The interpreter says there is an overflow:
So maybe we have a place to root-cause this. To reproduce, run |
When the type is signed and the value is less than zero, the Since this has no decimal places in it, we are computing A simple fix is to add a cut-off if |
Thanks for explaining the problem! One possible option is implementing “saturating” mathematical operators which, instead of overflowing, clamp the outputs to either a maximum or a minimum. So In this case, it’d clamp the value generated by the divider to 0. |
For anyone who wants to work on this issue, there are two possible options:
|
Program:
Data:
Output:
"-0.00189208984375"
This should be
0
.The text was updated successfully, but these errors were encountered: