Quantcast
Channel: All LabVIEW posts
Viewing all articles
Browse latest Browse all 202042

Re: Input array listing possible test results to generate all test scenarios

$
0
0

 wrote:

I'm assuming that integers compared to an integer within a double will still work.


I agree that you are probably right but the exponentiation operates purely on DBL (notice the coercion dots) and I have no idea what's under the hood (Intel MKL?) and if it is guaranteed that all possible integer inputs really result in true integers in DBL representation. For example if they internally use logarithms etc., all bets are off. I haven't tested this. Probably safer to set the output configuration of "-1" to I32. 😄

 

altenbach_0-1593638336899.png

 


Viewing all articles
Browse latest Browse all 202042

Trending Articles