Rsync Help for SDSS DAS Users

Users of the SDSS Data Archive Server (DAS) who wish to obtain more than 10 files are required to use rsync, an open source utility that provides fast incremental file transfer, using the rsh or ssh protocols. Rsync is available for download at the rsync website. Here we provide detailed instructions for installation and use on a variety of platforms.



Unix and linux

Rsync is often installed by default on Unix and Linux systems. It is included in Red Hat 7.2, for instance. If it is not installed on your system, or you would like to upgrade to the latest version (2.5.6 as of 02/28/2003), you can find links to the available downloads. We recommend downloading and compiling the source, rather than retrieving the binary.

The source can be downloaded directly here. You will need to gunzip and untar the file if your browser does not do so automatically. A directory called rsync-2.5.6 is created; just cd into that directory, and execute
./configure
This will create a Makefile and config.h appropriate for your system. Then type
make
to compile the code. Finally, to put rsync in your path, either add it by hand, or type
make install.
At this point, you are ready to use rsync. When you visit the DAS access page and request data, you can choose rsync as your download method; if you request more than 10 files this will be the default. When your data is ready, you will be asked to download a file called sdss-rsync.lis to a local directory where you want to save your data. This file contains a listing of all the data files to be pulled over by rsync. Then, just execute
rsync -vtrLPR rsync://dr1@rsync.sdss.org/DR1/ ./ --include-from=sdss-rsync.lis to retrieve your files. You will be prompted for a password, which is simply "dr1". If you will be downloading often, you can set an environment variable of this password by adding
to your .cshrc file.

Windows

Windows users cannot download and run rsync directly. You will first have to install cygwin, a linux emulator. It works with all non-beta, non "release candidate", ix86 versions of Windows since Windows 95, with the exception of Windows CE. Cygwin is available for download here, free of charge. Just click on the "Install Now" link, and a file called setup.exe will be downloaded. Running this will allow you to install Cygwin.

Because rsync is not included with Cygwin, you will also need to download and install rsync. Use your web browser to download the rsync source code. Open a Cygwin session, cd to the location of the source, and follow the instructions in the Unix section above to install rsync.

Macintosh

Mac users with OSX can follow the instructions in the Unix section above to download and install rsync. Users with OS9.x will unfortunately not be able to use this utility.


Last modified: Mon Feb 3 13:45:32 CST 2003