TITLE          

    GetURL.rexx
    
VERSION

    1.04
    
AUTHOR

    James Burton
    
    c/o 
    Department of Computer Science & Computer Engineering
    Latrobe University
    Bundoora, Victoria, 3083
    Australia

    EMail:  burton@cs.latrobe.edu.au
    Web:    http://www.cs.latrobe.edu.au/~burton/
    
    Also a few other people helped out, please read the documentation
    file.
    
DESCRIPTION

    -- Script to download HTML systems across the network --

    GetURL.rexx is an ARexx script which will download World-Wide Web pages.
    With a simple command line it will download a specific page, and with
    more complex command lines it will be able to download specific sets of
    documents.
    
    The intention was to create a tool that allowed local caching of important
    web pages and a flexible way of specifying what pages are important. The
    script has no GUI as of yet but may have at some stage in the future.
    
    If you have ever tried to download and save to disc a 200 page document
    using Mosaic, then you know what this script is for. Mosaic will only
    let you load a page, then load it to disc, then load another page etc.
    This is a very frustrating process. GetURL automates this process and
    will run in batch mode without user intervention.
    
    The major features of GetURL.rexx are as follows:
    
    * doesn't require AMosaic, so you can be browsing something else
        with AMosaic whilst this is running
        
    * save pages to your hard disc so that they can be read offline and
        you can also give them to friends on a floppy disc. Who knows, 
        you may even be able to sell discs containing web pages :-)

    * flexible set of command line switches that allow you to restrict the 
        type of pages that it downloads
    
    * ability to specify files for the lists of URLs that it keeps so
        that any search for pages can be stopped and restarted at a later
        date. i.e. you could run GetURL for 2 hours a day whilst you are
        online and gradually download everything in the entire universe
        and it won't repeat itself.
        
    * includes the ability to download itself when there are new versions.
    
    * will use a proxy if you have access to one, in order to both speed up
        access to pages and also to reduce network load.
        
    * will download binary files (*.gif, *.lha) as easily as text and html
        files.
        
NEW FEATURES

    * AmigaDOS pattern matching to specify or restict URLs to download
    
    * Update facility
    
    * a few bugs fixed
    
    * separate documentation
    
    * More strict control of URLs

SPECIAL REQUIREMENTS

    * Until somebody writes a TCP: device for the AS225 TCP/IP protocol
        stack unfortunately this script will require AmiTCP.

    * requires the TCP: device be mounted
    
    * either restraint, or an extremely large hard disc - your choice :-)
    
    - This script is no use at all unless you have AmiTCP set up and running.
    If you don't know what this means then please ask me (burton@cs.latrobe.edu.au).
    
HOST NAME
DIRECTORY

    This script is available via
    
    Anonymous FTP to AmiNet
        wuarchive.wustl.edu (128.252.135.4)
        /pub/aminet/comm/tcp/GetURL-1.04.lha
        
        and all of it's mirrors. Please check the closest mirror FIRST.
        
    HTTP from my university account
        http://www.cs.latrobe.edu.au/~burton/Public/GetURL.rexx
        (this URL will always point to the newest version)
        
FILE NAMES

    GetURL-1.04.lha              41770 Bytes
    GetURL-1.04.readme           3874 Bytes
    
PRICE
    
    Absolutely free to humans
    
DISTRIBUTABILITY
    
    Public domain. But so that a hundred different versions of this don't 
    appear, please send corrections, new features, bug fixes etc. to me
    and I will coordinate.
                          
End of File

 PERMSSN    UID  GID    PACKED    SIZE  RATIO     CRC       STAMP          NAME
---------- ----------- ------- ------- ------ ---------- ------------ -------------
[generic]                  254     628  40.4% -lh5- 3d73 Oct 26  1995 GetURL-1.06/C.info
[generic]                 5134    8096  63.4% -lh5- 5c52 Jul 23  1994 GetURL-1.06/C/Clip
[generic]                 7911   12928  61.2% -lh5- cabf Mar 22  1995 GetURL-1.06/C/Localise
[generic]                 4262    6584  64.7% -lh5- 9069 Jan 16  1995 GetURL-1.06/C/Match
[generic]                13955   40373  34.6% -lh5- 6549 Oct 26  1995 GetURL-1.06/GetURL-1.06.doc
[generic]                 1899    4140  45.9% -lh5- f270 Mar  5  1995 GetURL-1.06/GetURL-1.06.readme
[generic]                14399   68613  21.0% -lh5- aae6 Oct 24  1995 GetURL-1.06/GetURL-1.06.rexx
[generic]                  254     628  40.4% -lh5- 3d73 Oct 26  1995 GetURL-1.06/Rexx.info
[generic]                  410     755  54.3% -lh5- e9a2 Feb  8  1995 GetURL-1.06/Rexx/Localise-Page.www
[generic]                 1450    3651  39.7% -lh5- b919 Dec 31  1994 GetURL-1.06/Rexx/saveurl.www
[generic]                  254     628  40.4% -lh5- 3d73 Oct 26  1995 GetURL-1.06.info
---------- ----------- ------- ------- ------ ---------- ------------ -------------
 Total        11 files   50182  147024  34.1%            May  6  1996