Options - Spidering

Include Images

By default, Google will include both links (defined by <a href> tags) and images (defined by <img src> tags) when it indexes a site. Rapid Sitemaps does the same, but you can choose not to include images by unchecking this box.

Number of Threads

Select the number of pages to fetch at once while spidering a site. The more threads you choose, the faster the import will be, but too many and your computer will crash. If you get errors when spidering, try reducing this value. For more information, see Technical Multi Threading

Ignore Query Values

Rapid Sitemaps assumes that two pages with the same filename, but different query strings are different files. For example,

http://www.mysite.com/myfile.htm?id=1 is different from
http://www.mysite.com/myfile.htm?id=2.

Sometimes, however, you may decide that two URLs that differ only in a certain query attribute should be considered the same. Enter the names of the attributes you wish to ignore here.

For example, you may decide that:
http://www.mysite.com/mypage.htm?affiliateid=1832
is the same as
http://www.mysite.com/mypage.htm?affiliateid=3652 and
http://www.mysite.com/mypage.htm
You would then add affiliateid to this list.

Separate multiple attribute names with a semi-colon (;). Attribute names are not case sensitive.

options - general

options - file extensions