Transferring files

Filezilla

This program is supported on Windows, MacOS, and Linux.
It can be downloaded at Filezilla.
Make sure to click Decline during the installation for Adaware Web Companion.

  1. Open File → Site Manager... → New site
  2. Type in HPC in place of the New site.
    • In General tab
      • Protocol: SFTP - SSH File Transfer Protocol
      • Host: sagehen.hpc.pomona.edu
      • Port: 22
      • Logon Type: Interactive
      • User: Input your username
      • Click Connect
  3. Type in your password, and click OK.
  4. On the DUO authentication, do not use 3. SMS passcodes since this will not work.
  5. Once DUO authenticates, you will see the files on the HPC.

Ondemand

Ondemand can also be use to upload, download, and edit files. This is not recommended when transferring large amount of files.

  1. Login to OnDemand
  2. Click on Files -> Home Directory
  3. Click on Upload or Download to transfer files.

VSCode

The guide can be found at VSCode

Command Line

This is supported on Windows, MacOS, and Linux.

Make sure that rsync is installed on your computer. MacOS, and Linux should already have this installed by default.

Below are some sample commands

#Transfer files/folders from computer to HPC
rsync -avhP file_or_directory_on_computer sagehen.hpc.pomona.edu:/rhome/username/some_path
#Transfer files/folders from HPC to computer
rsync -avhP sagehen.hpc.pomona.edu:/rhome/username/some_path path_on_computer

Rclone

This is to setup Onedrive and Box on the HPC using the command line.

Setup

This setup process need to be run everytime you add/renew a service.

Mac

Follow this guide on how to ssh using Mac.
In the second step of the guide, use this command instead ssh your_username@sagehen.hpc.pomona.edu -L 53682:localhost:53682

Windows

Follow this guide on how to ssh using Windows.
In the second step of the guide, use this command instead ssh your_username@sagehen.hpc.pomona.edu -L 53682:localhost:53682

VSCode

No setup is needed.

Box

This guide is to setup Box.

  1. Run module load rclone
  2. Run rclone config
  3. Then use the following settings
    • e/n/d/r/c/s/q>n
    • name> type in a name you want to give this service
    • Storage> select the number corresponding to Box
    • client_id> press Enter
    • client_secret> press Enter
    • box_config_file> press Enter
    • access_token> press Enter
    • box_sub_type> select the number corresponding to Rclone should act on behalf of a user (user)
    • y/n> press Enter
    • y/n> press Enter
    • You will see a message similar to the one below
      • NOTICE: If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth?state=xxxxx
      • NOTICE: Log in and authorize rclone for access
      • NOTICE: Waiting for code...
    • Copy the the http part to the end of it, example above would be http://127.0.0.1:53682/auth?state=xxxxx. Open up any web browser on your computer and paste the link.
    • Click on Use Single Sign On (SSO)
    • Type in your email address and click Authorize
    • It may ask you yo login to your email, enter your email credential and login.
    • Click on Grant access to Box
    • y/e/d> press Enter
    • e/n/d/r/c/s/q> q

Note for VSCode user: Make sure to go to the PORTS tab, and delete the 53682 listed under Port.
For all other connection type: You can disconect and reconnect again without using the -L 53682:localhost:53682 options

Onedrive setup

This guide is to setup Onedrive

  1. Run module load rclone
  2. Run rclone config
  3. Then use the following settings
    • e/n/d/r/c/s/q>n
    • name> type in a name you want to give this service
    • Storage> select the number corresponding to Onedrive
    • client_id> press Enter
    • client_secret> press Enter
    • region> type in the number for Microsfot Cloud Global \ (global)
    • y/n> press Enter
    • y/n> press Enter
    • You will see a message similar to the one below
      • NOTICE: If your browser doesn't open automatically go to the following link: http://127.0.0.1:53682/auth?state=xxxxx
      • NOTICE: Log in and authorize rclone for access
      • NOTICE: Waiting for code...
    • Copy the the http part to the end of it, example above would be http://127.0.0.1:53682/auth?state=xxxxx. Open up any web browser on your computer and paste the link.
    • You will need to enter your login credential for your email.
    • You will get a message saying to give rclone permission, click Accept
    • config_type> select the number corresponding to "OneDrive Personal or Business
    • config_driveid> press Enter
    • y/n> press Enter
    • y/e/d> press Enter
    • e/n/d/r/c/s/q> q

Note for VSCode user: Make sure to go to the PORTS tab, and delete the 53682 listed under Port.
For all other connection type: You can disconect and reconnect again without using the -L 53682:localhost:53682 options

Renew expiration

Rclone service expires every few months and you will need to reauthorize it.
You will see a prompt to run rclone config reconnect name:, replace name with the name you have given to Box or OneDrive. Note the colon :.
Run the command, say no on the first prompt

Already have a token - refresh?
y) Yes (default)
n) No
y/n> n

And follow the guide above for the service you are renewing.

How to use

Please go to the rclone official guide on how to use it.
When the guide mentions remote, replace it with the name you have given Box or OneDrive.