backup files – nixCraft

Shell script to mirror backups to another server in pull mode using rsync

in Automation & Management, Backup last updated April 28, 2017

A sample shell script to mirror remote server directory in pull mode for offsite backups using rsync command on Linux/Unix-like system.

Remote Server Rsync Backup Replication Shell Script

in Backup last updated April 24, 2008

You need to setup password less login using ssh keys; refer to following tutorials:
+ Howto Linux / UNIX setup SSH with DSA public key authentication (password less login)

+ SSH Public key based authentication – Howto

#!/bin/bash
# Remote Server Rsync backup Replication Shell Script 
# -------------------------------------------------------------------------
# Copyright (c) 2005 nixCraft project <http://cyberciti.biz/fb/>
# This script is licensed under GNU GPL version 2.0 or above
# -------------------------------------------------------------------------
# This script is part of nixCraft shell script collection (NSSC)
# Visit http://bash.cyberciti.biz/ for more information.
# ------------------------------------------------------------------------- 
# Local dir location
LOCALBAKPOINT=/disk3
LOCALBAKDIR=/remote/home/httpd/
# remote ssh server
# user
SSHUER=brootbeer 

# server IP / host
SSHSERVER=10.10.11.12 

#remote dir to backup
SSHBACKUPROOT=/disk2.backup/hot/ 

rsync --exclude '*access.log*' --exclude '*error.log*' -avz -e 'ssh ' ${SSHUER}@${SSHSERVER}:${SSHBACKUPROOT} ${LOCALBAKPOINT}${LOCALBAKDIR}

# log if backup failed or not to /var/log/messages file
[ $? -eq 0 ] && logger 'RSYNC BACKUP : Done' || logger 'RSYNC BACKUP : FAILED!'

# Replicate backup to /disk1 and /disk2
# You can also use format user@host:/path
# refer to rsync man page
SRC=${LOCALBAKPOINT}${LOCALBAKDIR}
DST="/disk1/remote /disk2/remote"
for d in $DST
do
 [ ! -d $d ] && mkdir -p $d || :
 rsync -avr $SRC $d
done

#!/bin/bash

# Remote Server Rsync backup Replication Shell Script

# -------------------------------------------------------------------------

# This script is licensed under GNU GPL version 2.0 or above

# -------------------------------------------------------------------------

# This script is part of nixCraft shell script collection (NSSC)

# Visit http://bash.cyberciti.biz/ for more information.

# -------------------------------------------------------------------------

# Local dir location

LOCALBAKPOINT=/disk3

LOCALBAKDIR=/remote/home/httpd/

# remote ssh server

# user

SSHUER=brootbeer

# server IP / host

SSHSERVER=10.10.11.12

#remote dir to backup

SSHBACKUPROOT=/disk2.backup/hot/

rsync --exclude '*access.log*' --exclude '*error.log*' -avz -e 'ssh ' ${SSHUER}@${SSHSERVER}:${SSHBACKUPROOT} ${LOCALBAKPOINT}${LOCALBAKDIR}

# log if backup failed or not to /var/log/messages file

[ $? -eq 0 ] && logger 'RSYNC BACKUP : Done' || logger 'RSYNC BACKUP : FAILED!'

# Replicate backup to /disk1 and /disk2

# You can also use format user@host:/path

# refer to rsync man page

SRC=${LOCALBAKPOINT}${LOCALBAKDIR}

DST="/disk1/remote /disk2/remote"

for d in $DST

[ ! -d $d ] && mkdir -p $d || :

rsync -avr $SRC $d

done

Shell script to create list of backup files in ~/.mybackup file. Use with mybackup shell script

in Backup last updated April 9, 2008

#!/bin/bash
# mybackupadd - Add file to ~/.mybackup file, then backup and email all
# file as tar.gz to your email a/c.
#
# Usage   : ./mybackupadd ~/public_html/
#
# Copyright (C) 2004 nixCraft project
# Email   : http://cyberciti.biz/fb/
# Date    : Aug-2004
# -------------------------------------------------------------------------
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU General Public License
# as published by the Free Software Foundation; either version 2
# of the License, or (at your option) any later version.
# -------------------------------------------------------------------------
# This script is part of nixCraft shell script collection (NSSC)
# Visit http://bash.cyberciti.biz/ for more information.
# -------------------------------------------------------------------------

FILE=~/.mybackup
MYH=~
CWD=`pwd`
SRC=$1

if [ "$SRC" == "" ]; then
  echo "Must supply dir or file name"
  exit 1
fi  
# if list $FILE does not exist
[ ! -f $FILE ] && touch $FILE || :

# make sure that file or dir exists to backup
if [ ! -f $SRC ]; then
   if [ ! -d $SRC ]; then
      echo "$SRC does not exists"
      exit 2
   fi
fi
# make sure we don't do add duplicate stuff
cat $FILE | grep -w $SRC > /dev/null
if [ "$?" == "0" ]; then
   echo "$SRC exists in $FILE"
   exit 3
fi 
# okay now add that to backup list
echo "$SRC" >> $FILE
echo "$SRC added to $FILE"

#!/bin/bash

# mybackupadd - Add file to ~/.mybackup file, then backup and email all

# file as tar.gz to your email a/c.

# Usage : ./mybackupadd ~/public_html/

# Email : http://cyberciti.biz/fb/

# Date : Aug-2004

# -------------------------------------------------------------------------

# This program is free software; you can redistribute it and/or

# modify it under the terms of the GNU General Public License

# as published by the Free Software Foundation; either version 2

# of the License, or (at your option) any later version.

# -------------------------------------------------------------------------

# This script is part of nixCraft shell script collection (NSSC)

# Visit http://bash.cyberciti.biz/ for more information.

# -------------------------------------------------------------------------

FILE=~/.mybackup

MYH=~

CWD=`pwd`

SRC=$1

if [ "$SRC" == "" ]; then

echo "Must supply dir or file name"

exit 1

# if list $FILE does not exist

[ ! -f $FILE ] && touch $FILE || :

# make sure that file or dir exists to backup

if [ ! -f $SRC ]; then

if [ ! -d $SRC ]; then

echo "$SRC does not exists"

exit 2

# make sure we don't do add duplicate stuff

cat $FILE | grep -w $SRC > /dev/null

if [ "$?" == "0" ]; then

echo "$SRC exists in $FILE"

exit 3

# okay now add that to backup list

echo "$SRC" >> $FILE

echo "$SRC added to $FILE"

Shell script to backup directories & files from your home directory and email them as .tar.gz file

in Backup last updated April 9, 2008

#!/bin/bash
# mybackup - Backup selected files & directories and email them as .tar.gz file to
# your email account.
# List of BACKUP files/dirs stored in file ~/.mybackup
#
# Usage   : ./mybackup
# 
# Notes   : Very handy tool to take backup (nowdays we have 1 gig+ email a/c)
# 
# Copyright (C) 2004 nixCraft project
# Email/Contact   : http://cyberciti.biz/fb/
# Date            : Aug-2004
# Last updated    : Aug-2005
# -------------------------------------------------------------------------
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU General Public License
# as published by the Free Software Foundation; either version 2
# of the License, or (at your option) any later version.
# -------------------------------------------------------------------------
# This script is part of nixCraft shell script collection (NSSC)
# Visit http://bash.cyberciti.biz/ for more information.
# -------------------------------------------------------------------------

FILE=~/.mybackup
NOW=`date +"%d-%m-%Y"`
OUT="`echo $USER.$HOSTNAME`.$NOW.tar.gz"
TAR=`which tar`

# mail setup
MTO="nixbackup@somedom.com"
MSUB="Backup (`echo $USER @ $HOSTNAME`) as on `date`"
MES=~/tmp/mybackup.txt
MATT=~/tmp/$OUT

# make sure we put backup in our own tmp and not in /tmp
[ ! -d ~/tmp ] && mkdir ~/tmp || :
if [ -f $FILE ]; then
	IN="`cat $FILE | grep -E -v "^#"`"
else
	echo "File $FILE does not exists"
	exit 3
fi

if [ "$IN" == "" ]; then
	echo "$FILE is empty, please add list of files/directories to backup"
	echo "Use mybackupadd script"
	 exit 2
fi

$TAR -zcf ~/tmp/$OUT $IN >/dev/null
# create message for mail
echo "Backup successfully done. Please see attached file." > $MES
echo "" >> $MES
echo "Backup file: $OUT" >> $MES
echo "" >> $MES

# bug fix, we can't send email with attachment if mutt is not installed
which mutt > /dev/null
if [ $? -eq 0 ]; then
	# now mail backup file with this attachment
	mutt -s "$MSUB" -a "$MATT" $MTO < $MES
else
	echo "Command mutt not found, cannot send an email with attachment"
fi

# clean up
/bin/rm -f $MATT
/bin/rm -f $MES

#!/bin/bash

# mybackup - Backup selected files & directories and email them as .tar.gz file to

# your email account.

# List of BACKUP files/dirs stored in file ~/.mybackup

# Usage : ./mybackup

# Notes : Very handy tool to take backup (nowdays we have 1 gig+ email a/c)

# Email/Contact : http://cyberciti.biz/fb/

# Date : Aug-2004

# Last updated : Aug-2005

# -------------------------------------------------------------------------

# This program is free software; you can redistribute it and/or

# modify it under the terms of the GNU General Public License

# as published by the Free Software Foundation; either version 2

# of the License, or (at your option) any later version.

# -------------------------------------------------------------------------

# This script is part of nixCraft shell script collection (NSSC)

# Visit http://bash.cyberciti.biz/ for more information.

# -------------------------------------------------------------------------

FILE=~/.mybackup

NOW=`date +"%d-%m-%Y"`

OUT="`echo $USER.$HOSTNAME`.$NOW.tar.gz"

TAR=`which tar`

# mail setup

MTO="nixbackup@somedom.com"

MSUB="Backup (`echo $USER @ $HOSTNAME`) as on `date`"

MES=~/tmp/mybackup.txt

MATT=~/tmp/$OUT

# make sure we put backup in our own tmp and not in /tmp

[ ! -d ~/tmp ] && mkdir ~/tmp || :

if [ -f $FILE ]; then

IN="`cat $FILE | grep -E -v "^#"`"

else

echo "File $FILE does not exists"

exit 3

if [ "$IN" == "" ]; then

echo "$FILE is empty, please add list of files/directories to backup"

echo "Use mybackupadd script"

exit 2

$TAR -zcf ~/tmp/$OUT $IN >/dev/null

# create message for mail

echo "Backup successfully done. Please see attached file." > $MES

echo "" >> $MES

echo "Backup file: $OUT" >> $MES

echo "" >> $MES

# bug fix, we can't send email with attachment if mutt is not installed

which mutt > /dev/null

if [ $? -eq 0 ]; then

# now mail backup file with this attachment

mutt -s "$MSUB" -a "$MATT" $MTO < $MES

else

echo "Command mutt not found, cannot send an email with attachment"

# clean up

/bin/rm -f $MATT

/bin/rm -f $MES