Projects tagged ‘backup’

Cloud Export

C

Analyzed 3 days ago

Cloud Export is a tool to automatically extract your data from web applications and save it to your local file system for backup purposes. Some applications will also support importing. Plans are based on http://www.dataliberation.org.

20.2K lines of code

0 current contributors

almost 8 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: No declared licenses

archive tweets to pdf + offline browsing

A

Analyzed 4 days ago

twitter backups to PDF,database,xml, html, txt .. a simple web ui . needs java runtime environment. (codebas is 8 java files+thirdparty libraries). a bug that some tweets are missed will be fixed in nov 09. (future= reorganize-tweets/flash/background/AI)

1.39K lines of code

0 current contributors

over 14 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Java

Licenses: No declared licenses

Tags application backup twitter web

MASGAU

Analyzed 1 day ago

MASGAU Automatic Save Game Archive Utility - A backup utility that automatically detects and archives saved games and can then restore them.

280K lines of code

0 current contributors

almost 9 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in C#

Licenses: gpl

Tags backup

FileUniq

F

Analyzed about 6 hours ago

FileUniq identifies duplicate files, and optionally removes them or replaces them with hard or soft links. It is designed to work well with heavily hard-linked cp -al / rsync backups. For more information please see http://fileuniq.sourceforge.net

874 lines of code

0 current contributors

over 12 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: gpl

Tags backup backups deduplication dupe dupes duplicate duplicates file file_management files hard link 4 more...

archivefs

A

Analyzed 1 day ago

AboutArchiveFS is a FUSE file system used for archiving and backup. Its primary function is to ensure that multiple copies of a file are only represented as a single file. The representation of the file system is intentionally kept simple and consists just of a single SQLite3 database file and ... [More] table (which can be dumped into a text file), together with a directory full of files. The file system is not intended for general purpose computing, but mostly for copying data in and out. It seems to be working reasonably well for backup, and even file system intensive operations like software builds seem to complete OK. Please give it a good try and workout, but don't blame me if you lose any data. UsageJust check out the source code. You do need the python-fuse and python-sqlite3 packages (Ubuntu) or their equivalents. To start it up, use a command like: $ python archivefs.py -o root=/somewhere/FSDATA /my/mountpoint $ echo hello world > /my/mountpoint/new-file $ cat /my/mountpoint/new-fileThe root directory must exist and be writable by you. The root directory contains the database file (DB), a working directory for temporary files (WORKING), and an archival directory containing the actual, permanent files (ARCHIVE). The file system will create those if they don't already exist. When you're done, you should unmount the directory as usual: $ fusermount -u /my/mountpointIt's intended to be used with something like: cp -av /home/tmb /backup/tmb-$(date)You can get some file metadata via getfattr and attr: attr -g _id file -- the unique file id attr -g _storage file -- the path to the actual file attr -g _instances file -- a list of all paths referring to this content Note the following points: file permissions aren't enforced (but are recorded) link counts are not preserved deleting a file only deletes its entry, it doesn't recover the space automatically There are a number of things I can't find good documentation and that I therefore don't quite understand in fuse-python: hardlinks and concurrent updates through different paths the degree of threading (apparently, not much, but enough to cause occasional problems) how mmap is handled You can reconstruct a directory tree easily from an md5sum dump and the contents of the archive disk; you don't need FUSE. To create such a dump manually, just write: $ find . -type f -print0 | xargs -0 md5sum > my.md5sums(I'll upload some scripts for this at some point.) HistoryThis code replaces (and is based on) a bunch of shell scripts I've been using for backup for a couple of decades that also used checksums for storage but stored the mapping in a plain text file. The reason why a file system is nicer than the scripts is because it's possible not only to copy into the archival tree, but also untar tar files in it directly, copy data in remotely, etc. With FUSE, it's finally easy and portable enough to do this (last time I looked into doing this, this still required a lot of painful kernel-level C programming.) InternalsIt's written in Python using the python-fuse package. The representation of the file system is pretty simple: root/DB -- sqlite3 database file containing metadata and ids root/ARCHIVE/xx/yy/xxyyzzzzz... -- the actual content, stored by id to keep directory size down, this has two levels of directories root/WORKING/zzzzzzzz... -- temporary working files TODOThere are a bunch of things to be done: important clean up the code write a text file dumper for the database smart command line tools for local and remote copies/sync garbage collecting defunct working files on startup garbage collecting defunct archival files on demand (after a big removal) automatic garbage collection of defunct archival files upon deletion add metadata handling and searchrecord checksum and discard) well-known checksums (just transparent gzip compression/decompression of chunks would be nice record-and-discard well-known checksum (can retrieve from the web, maybe store URL) by file name by mime type separate directory and file name columns to make dir listings faster tokenize directory names to save space id available via extended attribute speed it up by caching and other tricks better multithreading (maybe port to IronPython) record user ids in text form and resolve at runtime fix global scope for fs variable transparently handle files inside archives write a test suite and perform more extensive testing perform explicit in-memory buffering for checksumming and copying use a larger checksum to make collisions less likely add non-FUSE command line tools for storing and accessing the data handle extended attributes tools for reporting logical vs physical usage move small file operations in memory transparent mounting of the underlying file system long term ideas (maybe a different project) handle file parts by partitioning files at type-dependent boundaries e.g., paragraph boundaries, MP3 chunks, mbox message boundaries, etc. transparently disassemble and assemble archive formats S3 backend stick very small files into the database distributed storage across disks distributed storage across the network change tracking time-machine like functionality i.e. represent trees at different points in time explicitly also saves database space for frequent backups this needs to have a notion of a completed checkpoint, so... archivefs-open-replica old-tree new-tree rsync ... source new-tree archivefs-close-replica new-tree old-tree [Less]

486 lines of code

0 current contributors

over 9 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: gpl3_or_l...

Tags archive backup filesystem fuse python sqlite3

NArchivist

Analyzed 4 days ago

A cloud-based backup and archiving tool, loosely based on Palindrome's "Network Archivist" philosophy. Archiving of every version of every file you ever had. We support Amazon s3 and Rackspace CloudFiles at this point.

0 lines of code

0 current contributors

0 since last commit

0 users on Open Hub

Activity Not Available

0 Reviews

I Use This

Mostly written in language not available

Licenses: gpl3_or_l...

Tags backup cloud python

servoapp

S

Analyzed about 10 hours ago

This is a web application let us make backups all computer in your LAN. You can make backups from windows, linux and mac machines. In this version, MySQL's backups are supported too. You can send the encrypted data to remote server in not working time.

7.73K lines of code

0 current contributors

over 14 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in PHP

Licenses: No declared licenses

Tags appliance backup online remote server

Django Smuggler

Analyzed about 11 hours ago

Django Smuggler is a pluggable application for Django Web Framework that help you import/export fixtures via the automatically-generated admin interface.

981 lines of code

3 current contributors

about 2 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: lgpl3

Tags admin backup django django-admin fixtures tools

BaculaFS

Analyzed 1 day ago

BaculaFS is a tool that represents the Bacula catalog and backup storage media as a read-only filesystem in userspace.

1.21K lines of code

0 current contributors

over 11 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: gpl3

Tags backup bacula duplicity filesystem fuse python rsync

SaveMyPrecious

Analyzed about 23 hours ago

SaveMyPrecious remplace Saise et permet donc une sauvegarde incrémentale totale (chaque sauvegarde se suffit à elle même) distante via l’utilisation de la commande cp -al et de rsync. Les principes de base sont expliqués sur la page de présentation d’ Obiran , le premier script de sauvegarde que ... [More]

189 lines of code

0 current contributors

about 14 years since last commit

0 users on Open Hub

Inactive

0 Reviews

I Use This

Mostly written in Python

Licenses: apache_2

Tags backup python rsync

Tags : Browse Projects