Moving data to/from LUMI¶
For moving data to/from LUMI, we recommend the use of the
tools. See the data storage options page for an
overview of where to store your data on LUMI.
Copying files with
Copying files between different UNIX-like systems can be done with the
command. This command, which stands for Secure Copy Protocol, allows you to
transfer files between a local host and a remote host or between two remote
hosts. The basic syntax of the
scp command is the following:
<origin-path> is the path to the file you want to copy to the
destination defined by
To copy a file from a local machine to LUMI, on the local machine run (with
<username> replaced by your username):
and, correspondingly, to copy files from LUMI to a local machine, on the local machine run:
You may use the
-r switch to recursively copy an entire directory, e.g.
scp does not automatically find your private SSH key, you need to specify it manually using the
Copying files with
rsync tool, which stands for Remote Sync, is a remote and local file
synchronization tool. It has the advantage of minimizing the amount of data
copied by only copying files that have changed. The advantages over
- it allows for synchronization.
scpalways copies and transfer everything, while
rsyncwill only copy and transfer files that have changed.
- better for the transfer of large files as
rsyncwill save progress. If the transfer is interrupted it can be resumed from the point of interruption.
The basic syntax of the
rsync command is the following:
Below are some useful options to use with
- archive mode with the
--archiveoption. This option tells
rsyncto syncs directories recursively, transfer special and block devices, preserve symbolic links, access permissions and time stamps
- compresses the data with the
--compressoption. With this option
rsyncwill compress the data as it is sent to the destination machine.
- to keep the partially transferred files, use the
--partialoption. It is useful when transferring large files over slow or unstable network connections.
- if your goal is to achieve mirroring use the
--deleteoption. When this option is used,
rsyncdeletes extraneous files from the destination location.