Plan requirement
| Subscription | Suite Growth or higher, Guide Professional or higher |
| Access | Admin |
The crawler ran and nothing appeared in search. Four causes account for nearly all of it.
Symptoms
- The crawl completes but indexes zero pages.
- Far fewer pages are indexed than the site has.
- Content you can see in a browser does not appear in help centre search.
One: the filters exclude everything
The most common cause by a distance. An include pattern that does not match the site's actual paths excludes the whole site, and the crawl reports success because it did exactly what it was told.
Open the site, copy a real address, and check it against your patterns.
Two: the crawler cannot reach the pages
Anything behind a login is invisible to it, and so is anything a firewall or geographic restriction blocks. If the pages are not public, crawling is not the mechanism to use.
Three: the site asks not to be crawled
A site's own robots rules can disallow crawling of the paths you want. This is a setting on the site being crawled rather than in Zendesk, so it needs whoever runs that site.
Four: the content is built in the browser
Pages whose text is assembled by scripts after loading can arrive empty. What matters is what the page contains when it is fetched, not what you see on screen.
Still nothing
Note which of the four you have ruled out and how, then contact pluscloud support with the site address and your filter patterns. That is enough to reproduce it without going back and forth.
Comments
0 comments
Article is closed for comments.