Academic Company Events Community Support Solutions Products & Services Contact NI MyNI
4 ratings:
 3.5 out of 5   

Read from Spreadsheet File Does Not Return All Digits of Precision



Primary Software: LabVIEW Development Systems>>LabVIEW Professional Development System
Primary Software Version: 7.1
Primary Software Fixed Version: N/A
Secondary Software: LabVIEW Development Systems>>LabVIEW Full Development System, LabVIEW Development Systems>>LabVIEW Base Development System

Problem:
I have a text based spreadsheet file in which each entry has 17 digits of precision. When I try to read it using Read From Spreadsheet File.vi I only get 6 digits past the decimal place.

Solution:
As shipped, the Read From Spreadsheet File VI returns single precision numbers so it is only possible to return 17 digits of precision. The Read From Spreadsheet and Write From Spreadsheet VIs were written this way to minimize the memory cost of arrays which generally don't need more than the resolution provided by single precision floating points.
To allow Read From Spreadsheet File.vi to use more digits of precision perform the following:
  1. Open Read From Spreadsheet File.vi
  2. From the Block Diagram, find the terminal for the array of singles labeled "type (empty)"
  3. Right click on the array terminal and select Extended (EXT) from the representation menu
  4. Repeat this step for the two output arrays.
Your VI will now return up to 31 digits of precision!

Related Links:
KnowledgeBase 1RBDAG5P: Precision Errors Writing and Reading with Write to Spreadsheet File and Read from Spreadsheet File.vi
KnowledgeBase 34MDHKFQ: How Can I Display Spreadsheet Data with a Table Control in LabVIEW?

Attachments:





Report Date: 11/13/2001
Last Updated: 03/21/2014
Document ID: 2FC9DK2L

Your Feedback! poor Poor  |  Excellent excellent   Yes No
 Document Quality? 
 Answered Your Question? 
  1 2 3 4 5
Please Contact NI for all product and support inquiries.submit