Turning on advanced website indexing generates an index for the websites that you specify when you create your data store. You can turn on advanced website indexing in the following situations:
- When you create a data store for website search. The data store creation process lets you turn on advanced website indexing.
- When you upgrade your data store from basic website search to advanced website indexing.
A data store is indexed using advanced website indexing only after a successful domain verification. Using advanced website indexing imposes a quota on the number of pages that you can index. You can upgrade this quota if necessary. Advanced website indexing incurs additional cost. For more information, see Advanced website indexing.
You cannot turn off advanced website indexing for an existing data store. Instead, you must create a new data store, and during the data store creation process, don't select the Advanced website indexing option.
To turn on advanced website indexing for an existing data store that uses basic website search, follow these steps:
In the Google Cloud console, go to the Vertex AI Agent Builder page.
In the navigation menu, click Data Stores.
Click the data store for which you want to turn on advanced website search.
On your data store page, in the Type row, click Upgrade.
In the Verify your domains pane, verify the domains either by domain association or by verifying domain ownership. For more information, see Verify website domains.