# A1 Website Download / Help / Download website

## Installation

- Application data

## How to use

- Help topics
  - Scan and download website
    - Crawler paths - root path, website aliases, "scan-from" start pages
    - Crawler engine - primary content type, simultaneous connections and threads
    - Crawler options - link tag types, external links, cookies, redirects, user / password
    - Crawler identification - user agent string, download robots.txt
    - Crawler scanner filters - file extensions to scan, ignore paths, follow robots.txt
    - Crawler output filters - limit website output data to some directories and file extensions

## Miscellaneous

- Automate website download
- Program user interface tips and tricks
- User interface language and localization
- Scanning multi-language websites

## Windows 32 bit program versions

- Increase memory address space to 3 gigabyte

## Articles

- Solutions to common website crawling problems
- How to scan large and huge websites

Copyright © 2006-2007 Thomas Schulz (see http://www.micro-sys.dk), all rights reserved.