Quantcast
Channel: All LabVIEW posts
Viewing all articles
Browse latest Browse all 203752

Difference in data conversion when provided as a single integer or in an array

$
0
0

I was trying to do some statistical analysis in python and wanted to implement it in LabVIEW. My results didn't match even with the same logic applied. This is when I found out that there is a difference in data conversion when provided as a single integer or in an array. I am providing double data and converting it to a signed 8-bit integer. See the conversion of 5.5, 9.5 as for a few examples. The array output is 5 but provided as a single integer for conversion it gives 6. Similar is the case for 9.5 and such other numbers. I have attached a test VI and also a SS of what I'm getting as output. The VI generates numbers 0 to 21 with a step of 0.1. I don't know what am I doing wrong or is there a bug in my LabVIEW. Please help.


Viewing all articles
Browse latest Browse all 203752

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>