URL Encoding
A number of non-alphanumeric characters are not
allowed in a URL, and must first be encoded. For
example, you may have noticed URLs like this:
http://www.mysite.com/my%20folder/my%20file.htm
The %20 is the URL Encoding for a space.
There is no need for you to worry about URL encoding
your files. You may enter spaces and other illegal
characters into your URLs without worry Rapid Sitemaps
will encode everything for you behind the scenes.
Multi Threading in Spiders
Multi Threading is a technique which allows a program
to do more than one thing at a time. Rapid Sitemaps uses
this technique when spidering sites, to dramatically
speed up the process (It is a lot faster to fetch 10
websites at once than only one at a time).
This technique does, however use much more computer
memory. Each new thread uses up its own share of the
available memory. Using too many threads can result in
the computer running slowly, and in unexpected results
(these usually show up as files without last updated
dates, or missing files). If you are having these
problems, reduce the number of threads that are being
used by opening Options Spidering, and changing the
relevant value. The default value (10 threads) is just a
guideline each computer setup will run with a different
optimal number of threads. Try different numbers of
threads, and see what happens.
|