Quantcast
Channel: Raspberry Pi Forums
Viewing all articles
Browse latest Browse all 8374

SDK • Re: Floating point bugs on RP2040 and RP235X ?

$
0
0
Pi 4B

Code:

00000000 is 0.0000000000FFFF is 0.00000080000000 is -0.0000008000FFFF is -0.0000007F800000 is inf7F80FFFF is nanFF800000 is -infFF80FFFF is -nan<-- Should be 'nan'

Code:

0000000000000000 is 0.000000000000000000FFFF is 0.0000008000000000000000 is -0.000000800000000000FFFF is -0.0000007FF0000000000000 is inf7FF000000000FFFF is nanFFF0000000000000 is -infFFF000000000FFFF is -nan<-- Should be 'nan'
RP2040
Depends on whether 32-bit or 64-bit is considered correct and whether 'nan' should be converted to 'inf' as the datasheet says.

Code:

00000000 is 0.0000000000FFFF is 0.00000080000000 is 0.0000008000FFFF is -0.000000<- Should be 0.000000 to match 64-bit7F800000 is inf7F80FFFF is nan<- Should be inf to match 64-bitFF800000 is -infFF80FFFF is nan<- Should be -inf to match 64-bit

Code:

0000000000000000 is 0.000000000000000000FFFF is 0.0000008000000000000000 is 0.000000800000000000FFFF is 0.0000007FF0000000000000 is inf7FF000000000FFFF is infFFF0000000000000 is -infFFF000000000FFFF is -inf
RP2235X ARM and/or RISC-V
Depends on whether 32-bit or 64-bit is considered correct

Code:

00000000 is 0.0000000000FFFF is 0.00000080000000 is 0.0000008000FFFF is -0.000000<- Should be 0.000000 to match 64-bit7F800000 is inf7F80FFFF is nanFF800000 is -infFF80FFFF is nan

Code:

0000000000000000 is 0.000000000000000000FFFF is 0.0000008000000000000000 is 0.000000800000000000FFFF is 0.0000007FF0000000000000 is inf7FF000000000FFFF is nanFFF0000000000000 is -infFFF000000000FFFF is nan

Statistics: Posted by hippy — Wed Jul 30, 2025 1:28 pm



Viewing all articles
Browse latest Browse all 8374

Trending Articles