Crawl Method (startURL, isLoginPage)

Keyoti SearchUnit v6

Starts the spidering process, which will recrawl all the existing documents for new links.

Declaration Syntax

C#	Visual Basic

[ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)]
public virtual ArrayList Crawl(
	string startURL,
	bool isLoginPage
)

<ObsoleteAttribute("Use DocumentIndex.ImportWebsite instead.", true)> 
Public Overridable Function Crawl ( 
	startURL As String,
	isLoginPage As Boolean
) As ArrayList

Parameters

startURL (String): The URL to start crawling a web-site from.

isLoginPage (Boolean): Whether this start URL is the login form for the site

Return Value

ArrayList
ArrayList of Uri objects with URLs that weren't already in the index

Exceptions

Exception	Condition
InvalidOperationException	If Configuration.IsLock is true (a lock has been applied).

Assembly: Keyoti4.SearchEngine.Core (Module: Keyoti4.SearchEngine.Core.dll) Version: 2022.8.22.610