Versions Compared

Old Version 1

changes.mady.by.user sandeep.heer@cybera.ca

Saved on

compared with

New Version Current

changes.mady.by.user chad.garrovillas@cybera.ca

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

This tutorial will show you how to use rclone to back up your data to Amazon S3. Please note that you will need a valid Amazon / AWS account for this to work. In addition, AWS will charge you based on the amount of storage you use.


Table of Contents


Install Rclone on instance

rclone is a command line program to sync files and directories to and from cloud storage.

Quickstart Installation

  • Download the relevant binary.

  • Extract the rclone binary from the archive.

  • Run rclone config to set up.

Installation by using a script

Install rclone on Linux/macOS/BSD systems:

Code Block
curl https://rclone.org/install.sh | sudo bash

Configure rclone

After installing Rclone:

  1. Type rclone config 

  2. Type n for a New remote

  3. Give a name to your remote (AWS in this example)

  4. Select the type of storage to configure

Image Added

         5. Choose the S3 provider

Image Added

       6. Select the type of authentication method.       

Image Added

PLEASE NOTE:  Enter your secret AWSAccesskeyId and AWSSecretKey in case you selected false.

     7. Select the region to connect( Canada-Central Region in this example).

Image Added

      8. Select the Endpoint and Location constraint values.

Image Added

      9. Select the Type of Access Control and encrypt

Image Added

     10. Select the Redundancy type and verify all the remote config values

           before closing the rclone.

Image Added


Image Added

Create a S3 bucket using Rclone

Run the following command:

Code Block
$ rclone mkdir <remote name>:<bucket name>


Note

AWS S3 bucket names must be globally unique. It helps to create a bucket name using a unique name. For example, instead of calling a bucket "mysql_backups", call it "jdoe777_mysql_backups".


Once the remote is configured and the bucket is created you can use below commands to list the remotes and buckets:


Code Block
$ rclone listremotes
$ rclone lsd <remote name>:

Synching/Copying using rclone


Run the below command to sync your data to your AWS bucket:

Code Block
$ sudo rclone sync /path/to/local/data  <remote name>:<bucket name>


For example:

Code Block
$ sudo rclone sync /var/lib/mysql  aws:mysql_backups

rclone Copy 

To copy files from source to destination and skipping files that have already been copied:

Code Block
$ rclone copy /path/to/local/data <remote name>:<bucket name>