Skip to main content

How Can I Crawl a Website Using MetaCrawl?

1. Once the website is registered in MetaCrawl, navigate to Management in the sidebar menu,
select Website Management.

2. In the Active Website grid, select Recrawl to rerun the initial crawl or select Crawl More to crawl additional pages on the same website.

3. Standby while MetaCrawl completes the crawl.

If you selected Crawl More, you will see that the number of crawled pages has increased.