logo       

when run from cron, sometimes job does not complete, pid not removed: msg#00066

sysutils.backup.rsnapshot.general

Subject: when run from cron, sometimes job does not complete, pid not removed

Sorry for this long post, but I am copying my rsnapshot.conf and my log results.

Basically what happens is the sync stops working somewhere during the process, its not consistent, meaning it may back up 2 servers, or 1 1/2, or every now and then all of them.

If I run rsnapshot from the command line, it always runs correctly, so I am guessing its an issue when run from cron. Any ideas?   Thanks.

My cron job looks like:

6 * * * * /usr/bin/perl -w /usr/local/bin/rsnapshot -V hourly


Here is rsnapshot.conf and below that is a log file.




#######################
# CONFIG FILE VERSION #
#######################

config_version    1.2

###########################
# SNAPSHOT ROOT DIRECTORY #
###########################

# All snapshots will be stored under this root directory.
#
snapshot_root    /syncback/.snapshots/

# If no_create_root is enabled, rsnapshot will not automatically create the
# snapshot_root directory. This is particularly useful if you are backing
# up to removable media, such as a FireWire or USB drive.
#
#no_create_root    1

#################################
# EXTERNAL PROGRAM DEPENDENCIES #
#################################

# LINUX USERS:   Be sure to uncomment "cmd_cp". This gives you extra features.
# EVERYONE ELSE: Leave "cmd_cp" commented out for compatibility.
#
# Note: Linux users with gnu cp/coreutils version > 5.3, should leave
# cmd_cp commented out, since cp fails to create destination directories
# with a trailing slash for versions 5.3 or later.
#
# See the README file or the man page for more details.
#
cmd_cp        /bin/cp

# uncomment this to use the rm program instead of the built-in perl routine.
#
cmd_rm        /bin/rm

# rsync must be enabled for anything to work. This is the only command that
# must be enabled.
#
cmd_rsync    /usr/bin/rsync

# Uncomment this to enable remote ssh backups over rsync.
#
cmd_ssh    /usr/bin/ssh

# Comment this out to disable syslog support.
#
cmd_logger    /usr/bin/logger

# Uncomment this to specify the path to "du" for disk usage checks.
# If you have an older version of "du", you may also want to check the
# "du_args" parameter below.
#
cmd_du        /usr/bin/du

# Uncomment this to specify the path to rsnapshot-diff.
#
cmd_rsnapshot_diff    /usr/local/bin/rsnapshot-diff

# Specify the path to a script (and any optional arguments) to run right
# before rsnapshot syncs files
#
#cmd_preexec     
# Specify the path to a script (and any optional arguments) to run right
# after rsnapshot syncs files
#
#cmd_postexec    /path/to/postexec/script

#########################################
#           BACKUP INTERVALS            #
# Must be unique and in ascending order #
# i.e. hourly, daily, weekly, etc.      #
#########################################

interval    hourly    12
interval    daily    7
interval    weekly    4
interval    monthly    3

############################################
#              GLOBAL OPTIONS              #
# All are optional, with sensible defaults #
############################################

# Verbose level, 1 through 5.
# 1     Quiet           Print fatal errors only
# 2     Default         Print errors and warnings only
# 3     Verbose         Show equivalent shell commands being executed
# 4     Extra Verbose   Show extra verbose information
# 5     Debug mode      Everything
#
verbose        3

# Same as "verbose" above, but controls the amount of data sent to the
# logfile, if one is being used. The default is 3.
#
loglevel    3

# If you enable this, data will be written to the file you specify. The
# amount of data written is controlled by the "loglevel" parameter.
#
logfile    /var/log/rsnapshot

# If enabled, rsnapshot will write a lockfile to prevent two instances
# from running simultaneously (and messing up the snapshot_root).
# If you enable this, make sure the lockfile directory is not world
# writable. Otherwise anyone can prevent the program from running.
#
lockfile    /var/run/rsnapshot.pid

# Default rsync args. All rsync commands have at least these options set.
#
#rsync_short_args    -a
#rsync_long_args    --delete --numeric-ids --relative --delete-excluded

# ssh has no args passed by default, but you can specify some here.
#
#ssh_args 
# Default arguments for the "du" program (for disk space reporting).
# The GNU version of "du" is preferred. See the man page for more details.
# If your version of "du" doesn't support the -h flag, try -k flag instead.
#
#du_args    -csh

# If this is enabled, rsync won't span filesystem partitions within a
# backup point. This essentially passes the -x option to rsync.
# The default is 0 (off).
#
#one_fs        0

# The include and exclude parameters, if enabled, simply get passed directly
# to rsync. If you have multiple include/exclude patterns, put each one on a
# seperate line. Please look up the --include and --exclude options in the
# rsync man page for more details.
#
#include    ???
#include    ???
#exclude    ???
#exclude    ???

# The include_file and exclude_file parameters, if enabled, simply get
# passed directly to rsync. Please look up the --include-from and
# --exclude-from options in the rsync man page for more details.
#
#include_file    /path/to/include/file
#exclude_file    /path/to/exclude/file

# If your version of rsync supports --link-dest, consider enable this.
# This is the best way to support special files (FIFOs, etc) cross-platform.
# The default is 0 (off).
#
link_dest    0

# When sync_first is enabled, it changes the default behaviour of rsnapshot.
# Normally, when rsnapshot is called with its lowest interval
# (i.e.: "rsnapshot hourly"), it will sync files AND rotate the lowest
# intervals. With sync_first enabled, "rsnapshot sync" handles the file sync,
# and all interval calls simply rotate files. See the man page for more
# details. The default is 0 (off).
#
#sync_first    0

# If enabled, rsnapshot will move the oldest directory for each interval
# to [interval_name].delete, then it will remove the lockfile and delete
# that directory just before it exits. The default is 0 (off).
#
#use_lazy_deletes    0

###############################
### BACKUP POINTS / SCRIPTS ###
###############################

# LOCALHOST
backup    /etc/rsnapshot.conf    localhost/

# host14
backup    root@xxxxxxxxxxxxxxxxx:/home/user/    host14.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/etc/passwd    host14.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/backup/sql/    host14.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/var/www/html/    host14.domain.com/

# host16
backup    root@xxxxxxxxxxxxxxxxx:/etc/passwd    host16.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/backup/sql/    host16.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/home/servers/    host16.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/root/    host16.domain.com/

# host11
backup    root@xxxxxxxxxxxxxxxxx:/etc/passwd    host11.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/backup/sql/    host11.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/var/www/html/    host11.domain.com/

# host15
backup    root@xxxxxxxxxxxxxxxxx:/etc/passwd    host15.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/backup/sql/    host15.domain.com/
backup    root@xxxxxxxxxxxxxxxxx:/var/www/html/    host15.domain.com/






Typical log entry- Stops logging after a few servers, and does not finish, does not rm -f the .pid either:

[28/Jul/2006:13:06:00] /usr/local/bin/rsnapshot -V hourly: started
[28/Jul/2006:13:06:00] echo 20167 > /var/run/rsnapshot.pid
[28/Jul/2006:13:06:00] /bin/rm -rf /syncback/.snapshots/hourly.11/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.10/ /syncback/.snapshots/hourly.11/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.9/ /syncback/.snapshots/hourly.10/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.8/ /syncback/.snapshots/hourly.9/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.7/ /syncback/.snapshots/hourly.8/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.6/ /syncback/.snapshots/hourly.7/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.5/ /syncback/.snapshots/hourly.6/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.4/ /syncback/.snapshots/hourly.5/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.3/ /syncback/.snapshots/hourly.4/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.2/ /syncback/.snapshots/hourly.3/
[28/Jul/2006:13:06:03] mv /syncback/.snapshots/hourly.1/ /syncback/.snapshots/hourly.2/
[28/Jul/2006:13:06:03] /bin/cp -al /syncback/.snapshots/hourly.0 /syncback/.snapshots/hourly.1
[28/Jul/2006:13:06:09] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded /etc/rsnapshot.conf /syncback/.snapshots/hourly.0/localhost/
[28/Jul/2006:13:06:09] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@xxxxxxxxxxxxxxxxx:/home/user /syncback/.snapshots/hourly.0/host14.domain.com/
[28/Jul/2006:13:06:16] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@xxxxxxxxxxxxxxxxx:/etc/passwd /syncback/.snapshots/hourly.0/host14.domain.com/
[28/Jul/2006:13:06:17] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@xxxxxxxxxxxxxxxxx:/backup/file /syncback/.snapshots/hourly.0/host14.domain.com/
[28/Jul/2006:13:07:00] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@xxxxxxxxxxxxxxxxx:/var/www/html /syncback/.snapshots/hourly.0/host14.domain.com/
[28/Jul/2006:13:07:48] /usr/bin/rsync -av --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@xxxxxxxxxxxxxxxxx:/etc/passwd /syncback/.snapshots/hourly.0/host16.domain.com/









-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys -- and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV_______________________________________________
rsnapshot-discuss mailing list
rsnapshot-discuss@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/rsnapshot-discuss
<Prev in Thread] Current Thread [Next in Thread>
Google Custom Search

News | FAQ | advertise