The function datastore can be used to handle large collections of data. As an example, the modern multisensor core loggers for the automatic determination of physical and chemical properties of drill cores generates huge amounts of data within a very short time. An array with 80 variables, each with 50,000 measured values, is not unusual. In addition, the corresponding files contain mixtures of character strings for core section names, measurement dates and times, and comments from the laboratory technician who carried out the measurements, along with the actual numeric readings.
Continue reading “Using DATASTORE to Work with Large Collections of Data”