Feature: Backup and sync script

[NathanDeckinga]

We need a way to backup the production database and a way to migrate data from one environment to another.

Things to note:

• Needs to allow migration outside of AWS/RDS
• Will only be a full backup (no partials/single tables or incrementals)
• Will backup a single database at a time (as opposed to the snapshot doing the entire server)
• Will completely overwrite the destination DB (possible application version mismatch)
• We should still utilize RDS specific tools for faster backup/restore and other things where it excels

Questions:

• Does this need to run automatically or just on demand?
• Do we have space locally on a server to store the backup or write it out to S3?
• Do we need to store multiple versions or just the latest?

[psineur]

Will only be a full backup (no partials/single tables or incrementals)

As long as it works within 1hr-2hr - it can be full backup.

Will backup a single database at a time (as opposed to the snapshot doing the entire server)

Yes, for manual I would like to be able to pick a DB to backup.

Will completely overwrite the destination DB (possible application version mismatch)

Restore should be a manual thing, with backup right before it to special name/place - just in case restore source is bad.

We should still utilize RDS specific tools for faster backup/restore and other things where it excels

Their snapshots come from the box, just let the thing work and while we're on AWS - let's use it as a first solution to DB management/restoration.

Does this need to run automatically or just on demand?

Both. I would like to see cron to S3 and cron on 2 trusted dev's local machines to their disks.

• Do we have space locally on a server to store the backup or write it out to S3?

  Lets put it to S3, backing up to same server can cause downtime when it runs out of disk space.

• Do we need to store multiple versions or just the latest?

  Last 7-14 days. I would prefer 14

[psineur]

I'm thinking about creating a cron script on my mac that will

 backup/dump prod DB to sql, download it to my computer and to some private s3  

and closing this. @NathanDeckinga anything else we need or you want to do? SInce we alrady have RDS backups

[NathanDeckinga]

It's actually more expensive and slower to go DB -> local then local -> S3. But we should be talking about pennies difference over the month/year and gives us an offsite (your computer) immediately. Go for it.