MinIO

Here you will find an example of how to configure MinIO Client, a free S3 client for Linux, macOS and Windows.

S3 Connection on Linux or Windows Commandline

For interaction with S3 through the command line we recommend the open source application MinIO Client mc.

mc resembles commonly used linux commands like cp, ls, cat, head, mv, and rm on S3 compatible storage services.

Download mc

There are several download options available in the GitHub repository of mc e.g. binaries for Linux, macOS or Windows. Please make sure that the client is installed on the system from or to which you want to migrate data (e.g. installation also on a computing cluster).

Configure mc for a Resource

You need to set up a connection to a resource before it is available in mc.
Run

mc alias set <myResource> https://coscine-s3-01.s3.fds.rwth-aachen.de:9021

Enter Access Key and Secret Key as provided by the resource configuration in Coscine.

Info

The Secret Key is not displayed on the console.

List Files in a Resource

Run

mc ls myResource/{bucket name}

The resource id is displayed in the connection information of the resource in Coscine.

Upload a File into a Resource

Run

mc cp ./localFile.csv myResource/{bucket name}/

Download a File from a Resource

Run

mc cp myResource/{bucket name}/data.csv ./