Re: filesystem full - misconfiguration?

On Sun, Aug 20, 2006 at 05:04:00PM -0400, brian wrote:
> I've had rsnapshot running for a little while now and it seems to have 
> filled up my fileystem.
 
> [root@apollo snapshots]# rsnapshot du
> 5.5G    /snapshots/hourly.0/
> 138M    /snapshots/hourly.1/
> 120M    /snapshots/hourly.2/
> 222M    /snapshots/hourly.3/
> 226M    /snapshots/hourly.4/
> 90M     /snapshots/hourly.5/
> 289M    /snapshots/daily.0/
> 321M    /snapshots/daily.1/
> 194M    /snapshots/daily.2/
> 195M    /snapshots/daily.3/
> 259M    /snapshots/daily.4/
> 157M    /snapshots/daily.5/
> 411M    /snapshots/daily.6/
> 1.6G    /snapshots/weekly.0/
> 465M    /snapshots/weekly.1/
> 13G     total

If there is an odd one out there, it is weekly.0.  That suggests 1600M of
changed files between daily.6 and weekly.0, but only 400M between weekly.0
and weekly.1.

I take it from the fact that you don't have a weekly.2 that you have
only been running rsnapshot for about 3 weeks.

> As i understand it, using du through rsnapshot should give a proper 
> reading of what's going (given the hard links). But this doesn't look 
> right at all. I've certainly not been generating hundreds of Mb of 
> changes to the system every day.

It's the total size of changed files that counts, not just total of the
amounts changed within each file.  (In case that wasn't obvious from
Jim Gottlieb's message.)

If you don't have enough disk space free for 13G of snapshots, I'd
suggest reducing the number of snapshots you keep.  You might want 
to stop keeping the weekly and monthly snapshots.  Or stop doing
hourly snapshots and just do 7 daily and 4 weekly instead. 

> Side note: i tried getting a diff between snapshots but that didn't work.
> 
> [root@apollo snapshots]# rsnapshot diff daily.0 daily.1
> Unknown option: daily.0
> Please make sure all switches come before commands
> (i.e. 'rsnapshot -v hourly', not 'rsnapshot hourly -v')

This should work if you are using rsnapshot 1.2.9 (but won't work in
rsnapshot 1.2.3 or earlier).

If you have an earlier version of rsnapshot, you can use
        rsnapshot-diff /snapshots/daily.0 /snapshots/daily.1             
(Add -vi if you want more details.)

> Here's my config:

I don't see any obvious problems with your config (although I'm slightly
surprised you do the weekly rotation mid-week rather than on a weekend).

> 
> So, can anyone point me in the correct direction on this? And, to free 
> up disk space, can i safely just remove all of the snapshots, save for 
> daily.0?

If you are doing "hourly" snapshots, you would need to keep hourly.0.

If you want to ditch the hourly snapshots you probably want to move
hourly.0 to daily.0, remove the other hourly.X directories, and remove
hourly from rsnapshot.conf and crontab. 

Just removing snapshots won't solve your problem in the long term - 
once those snapshots are filled out again, you would probably be back
in the same boat, unless you reduce the number of snapshots or reduce
the total amount of changed files you backup.  Or get more disk space.

___________________________________________________________________________
 David Keegel <djk@xxxxxxxxxxxxxxxxxx>  http://www.cyber.com.au/users/djk/
 Cybersource P/L: Linux/Unix Systems Administration Consulting/Contracting

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642