Advanced
The Advanced screen provides the following settings:
Attempts
Use this control to specify the number of times SiteSucker should attempt to download a file. SiteSucker will only retry downloading a file if a timeout error occurs.
Timeout (seconds)
Use this control to select the length of time that SiteSucker should wait for a response from the server.
Delay (seconds)
Use this control to specify the length of time that SiteSucker should delay between download requests. This feature allows SiteSucker to use less bandwidth and avoid anti-mining safeguards employed by some sites.
If a Crawl-delay is already being imposed by the site's robots.txt file, the longer of the two delays will be used. See Robot Exclusions for more information about the robots.txt file.
Identity
Use this control to customize the way SiteSucker identifies itself when making a request. Some sites are very particular about which browsers they will allow. You can you use this feature to "fool" the site into thinking that you are using an approved browser.
To change SiteSucker's identity, simply tap on this control and select one of the Web browsers listed. (If you choose None, SiteSucker will not include any identifying information when making requests.)
Include Supporting Files
Switch this on to have SiteSucker include supporting files in the download. When this option is on, SiteSucker will download non-HTML files (such as style sheets, images, etc.) even if they are not allowed by the current paths settings or if the Maximum Number of Levels is exceeded.
Download Using Web Views
Switch this on to have SiteSucker download HTML using hidden web views. When this option is on, SiteSucker will load each HTML file into a hidden web view and then extract the HTML from the web view after the page is loaded. This can be useful if the file uses JavaScript to modify the HTML as the page is loading or if the file is an XML file that can be converted into HTML by the web view.
