Index of /doc/web/momspider

[ICO]NameLast modifiedSizeDescription

[DIR]Parent Directory  -  
[   ]MOM_Changes.pl10-Aug-1994 10:19 1.6K 
[TXT]README.html10-Aug-1994 10:20 6.3K 
[DIR]docs/12-Oct-2000 02:57 -  
[DIR]examples/12-Oct-2000 02:57 -  
[   ]momavoid.pl10-Aug-1994 10:19 22K 
[   ]momconfig.pl10-Aug-1994 10:19 8.5K 
[   ]momemail.pl10-Aug-1994 10:19 8.6K 
[   ]momevent.pl10-Aug-1994 10:19 7.8K 
[   ]momhistory.pl10-Aug-1994 10:19 23K 
[   ]momindex.pl10-Aug-1994 10:19 32K 
[TXT]momspider10-Aug-1994 10:19 15K 
[   ]momvisit.pl10-Aug-1994 10:19 17K 
[TXT]system-avoid10-Aug-1994 10:19 1.1K 
[TXT]system-sites10-Aug-1994 10:20 572  

MOMspider -- Distribution Information

MOMspider -- Distribution Information

Copyright (c) 1994 Regents of the University of California. All rights reserved.

MOMspider is a web-roaming robot that specializes in the maintenance of distributed hypertext infostructures (i.e. wide-area webs). The program is written in Perl and, once customized for your site, should work on any UNIX-based system with Perl 4.036.

For more information on what MOMspider is, why it is needed, and how it was designed, see the MOMspider paper that was presented at the First International Conference on the World-Wide Web (WWW94).


Documentation

The following documentation is included with the release:
  1. Installation Notes
  2. Configuration Options
  3. MOMspider's Instruction Files
  4. Avoiding and Leafing Specific URLs
  5. Usage Information
  6. Making Document Metainformation Visible
  7. Extending MOMspider's Functionality
  8. The MOMspider WWW94 paper

Software Availability

For easy distribution, the MOMspider software is available as a gzip'd tar file or as a compress'd tar file. It is also also available via anonymous ftp from liege.ics.uci.edu in the directory /pub/arcadia/MOMspider

Version History

Current version is 1.00

Other Required Software

MOMspider requires the following to be installed:

Licensing and Redistribution

This software has been developed by Roy Fielding as part of the Arcadia project at the University of California, Irvine.

Redistribution and use in source and binary forms are permitted, subject to the restriction noted below, provided that the above copyright notice and this paragraph and the following paragraphs are duplicated in all such forms and that any documentation, advertising materials, and other materials related to such distribution and use acknowledge that the software was developed in part by the University of California, Irvine. The name of the University may not be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED ``AS IS'' AND WITHOUT ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, WITHOUT LIMITATION, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE.

Use of this software in any way or in any form, source or binary, is not allowed in any country which prohibits disclaimers of any implied warranties of merchantability or fitness for a particular purpose or any disclaimers of a similar nature.

IN NO EVENT SHALL THE UNIVERSITY OF CALIFORNIA BE LIABLE TO ANY PARTY FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OF THIS SOFTWARE AND ITS DOCUMENTATION (INCLUDING, BUT NOT LIMITED TO, LOST PROFITS) EVEN IF THE UNIVERSITY OF CALIFORNIA HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.


Acknowledgements

MOMspider has grown considerably since its original intention of being a class project in distributed information systems. Since then, MOMspider has spawned two other successful software packages -- wwwstat and libwww-perl -- and more will appear in the future. In turn, the knowledge gained from discussions with users of those systems, and particularly with other developers in the libwww-perl collaborative project, has resulted in considerable improvements to the MOMspider implementation. Special thanks go to Martijn Koster for his work on the Robot Exclusion Protocol and to Brooks Cutter for contributing a lot of stuff to libwww-perl.

Dr. Mark Ackerman deserves credit for suggesting a maintenance robot would make a good project for the Web. Mark and I will be examining the results returned from MOMspider sites for what they can tell us about the existing use of distributed hypertext systems and their needs for both short and long-term maintenance. Send us a note if you would like to be a site for the long-term case study or if you would like to help support further research in this area.

This work was sponsored in part by the Advanced Research Projects Agency under Grant Number MDA972-91-J-1010. This software and its documentation does not necessarily reflect the position or policy of the U.S. Government and no official endorsement should be inferred. Their support is appreciated.


Roy Fielding <fielding@ics.uci.edu>
Department of Information and Computer Science,
University of California, Irvine, CA 92717-3425
Last modified: Tue Aug 9 22:03:16 1994