Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 222222
Loughborough University

IT Services : High Performance Computing

Data Control

Data control

Ensure that your data has a unique ID. You may wish to use source code control systems such as git for this, particularly if your data comprises many small files only some of which change, however git does not easily handle large data items due to issues with allocating the RAM required during processing, in which case keeping a hash of data may be useful.