Check out the new USENIX Web site.

Home About USENIX Events Membership Publications Students
USITS '03 Abstract

FastReplica: Efficient Large File Distribution Within Content Delivery Networks

Ludmila Cherkasova, Hewlett-Packard Laboratories, and Jangwon Lee, University of Texas at Austin

Abstract

In this work, we consider a large-scale distributed network of servers and a problem of content distribution across it. We propose a novel algorithm, called FastReplica, for an efficient and reliable replication of large files in the Internet environment. There are a few basic ideas exploited in FastReplica. In order to replicate a large file among $n$ nodes ($n$ is in the range of 10-30 nodes), the original file is partitioned into $n$ subfiles of equal size and each subfile is transferred to a different node in the group. After that, each node propagates its subfile to the remaining nodes in the group. Thus instead of the typical replication of an entire file to $n$ nodes by using $n$ Internet paths, connecting the original node to the replication group, FastReplica exploits $n \times n$ Internet paths within the replication group where each path is used for transferring $1\over n$-th of the file. We design a scalable and reliable FastReplica algorithm which can be used for replication of large files to a large group of nodes. The new method is simple and inexpensive. It does not require any changes or modifications to the existing Internet infrastructure, and at the same time, it significantly reduces the file replication time as we demonstrate through experiments on a prototype implementation of FastReplica in a wide-area testbed.
  • View the full text of this paper in HTML or PDF.
    Click here if you have forgotten your password Until March 2004, you will need your USENIX membership identification in order to access the full papers. The Proceedings are published as a collective work, © 2003 by the USENIX Association. All Rights Reserved. Rights to individual papers remain with the author or the author's employer. Permission is granted for the noncommercial reproduction of the complete work for educational or research purposes. USENIX acknowledges all trademarks within this paper.

  • If you need the latest Adobe Acrobat Reader, you can download it from Adobe's site.
To become a USENIX Member, please see our Membership Information.
?Need help? Use our Contacts page.

Last changed: 10 Nov. 2003 jel
Technical Program
USITS '03 Home
USENIX home