Google AI Mode Scraper

Google AI Mode scraper lets you send prompts and reliably extract AI responses at scale without blocks. Built on the Web Scraper API, it delivers parsed data in JSON format while handling proxies, headless browsers, and anti-bot systems for you. You can use scraped Google AI Mode data to power SEO and GEO projects, build training datasets, or support other data tasks.

How it works

Scrape Google AI Mode responses by sending a POST request with your prompt and authentication credentials. See the Python example below, or explore more language samples here.

Tip

Get a free trial by registering on the dashboard.

Request sample (Python)

First, install the requests library in your Python environment:

pip install requests

Then, create the following .py file. Make sure to use your Web Scraper API USERNAME and PASSWORD:

import json
import requests


# API parameters.
payload = {
    'source': 'google_ai_mode',
    'query': 'best health trackers under $200',
    'render': 'html',
    'parse': True,
    'geo_location': 'United States'
}

# Get a response.
response = requests.post(
    'https://realtime.oxylabs.io/v1/queries',
    # Replace with your credentials.
    auth=('USERNAME', 'PASSWORD'),
    json=payload,
)

# Print the response to stdout.
print(response.json())

# Save the response to a JSON file.
with open('response.json', 'w') as file:
    json.dump(response.json(), file, indent=2)

Request parameters

Parameter	Description	Default Value
source (mandatory)	Sets the scraper.	google_ai_mode
query (mandatory)	The prompt or question to submit to Google AI Mode. Cannot exceed 400 characters.	–
render (mandatory)	Setting to html is required for this source.	–
parse	Returns parsed data when set to true.	false
geo_location	Specify a country to send the prompt from. More info.	-
callback_url	URL to your callback endpoint. More info.	–

Check out documentation to learn more.

Output samples

JSON example

Below is a trimmed JSON output sample. See the full JSON output here.

{
  "results": [
    {
      "content": {
        "links": [
          {
            "url": "https://www.tomsguide.com/best-picks/best-cheap-fitness-trackers",
            "text": "We've tested the best cheap fitness trackers available right now"
          },
          {
            "url": "https://www.garagegymreviews.com/best-budget-fitness-tracker",
            "text": "Expert-Tested: Best Budget Fitness Tracker (2025)"
          },
          {"url": "...", "text": "..."}
        ],
        "prompt": "best health trackers under $200",
        "citations": [
          {
            "url": "https://www.garagegymreviews.com/best-budget-fitness-tracker",
            "text": "For the best health trackers under $200, the top contenders are the Fitbit Charge 6 , Fitbit Inspire 3 , and..."
          },
          {
            "url": "https://www.techradar.com/best/best-cheap-fitness-trackers",
            "text": "For the best health trackers under $200, the top contenders are the Fitbit Charge 6 , Fitbit Inspire 3 , and..."
          },
          {"url": "...", "text": "..."}
        ],
        "response_text": "For the best health trackers under $200, the top contenders are the Fitbit Charge 6 , Fitbit Inspire 3 , and...",
        "parse_status_code": 12000
      },
      "created_at": "2025-09-03 10:13:11",
      "updated_at": "2025-09-03 10:13:26",
      "page": 1,
      "url": "https://www.google.com/search?udm=50&q=best+health+trackers+under+$200&uule=w+CAIQICINdW5pdGVkIHN0YXRlcw&gl=us&hl=en&sei=vRS4aPrAL9K55OUPhfvBsAM",
      "job_id": "7368949174630367233",
      "is_render_forced": false,
      "status_code": 200,
      "parser_type": "",
      "parser_preset": null
    }
  ]
}

Alternatively, you can extract the data in Markdown format to streamline integration with AI tools. Find more details here.

HTML example

JSON structure

google_ai_mode returns structured output with fields such as URL, page, and results. The table below explains each element in detail, outlining its description and data type. Depending on the search query, both the number of items and the fields included can change.

Key Name	Description	Type
url	The URL of Google AI Mode.	string
page	Page number.	integer
content	An object containing the parsed Google AI Mode response data.	object
content.links	List of external links referenced in the response. Displayed in the box on the right side of the page.	array
content.prompt	Original prompt submitted to Google AI Mode.	string
content.citations	List of citation links with URLs and associated texts, as shown in the main block of the Google AI Mode response.	array
content.response_text	Complete response text from Google AI Mode.	string
content.markdown_text	Complete Markdown text from Google AI Mode.	string
content.parse_status_code	Status code of the parsing operation.	integer
created_at	Timestamp when the scraping job was created.	timestamp
updated_at	Timestamp when the scraping job was finished.	timestamp
job_id	ID of the job associated with the scraping job.	string
status_code	Status code of the scraping job. You can see the scraper status codes described here.	integer

Use cases

Scraping Google AI Mode unlocks powerful applications across SEO and GEO analysis, as well as dataset development:

• Monitor brand presence: track how brands appear in Google AI Mode results to strengthen visibility and reputation.
• Optimize content for AI: refine and adapt content strategies to perform better in AI-driven search interfaces.
• Build training datasets: gather diverse, real-world responses to create high-quality datasets for model training or fine-tuning.

Why choose Oxylabs?

• No upkeep needed: all infrastructure handled for you (proxies, IP rotation, anti-bot measures). No engineering time wasted on fixes or site changes.
• Reliable performance: consistent, high success rates powered by enterprise-level infrastructure.
• Smart capabilities: headless browser for real-user simulation, CAPTCHA bypass, and geo-targeting for localized results.

FAQs

Is it allowed to scrape AI-generated content from Google?

The legality of scraping AI-generated content depends on factors like Google’s terms of service, your use case, and applicable laws. We recommend consulting a legal expert before proceeding.

Are there any limitations of Google AI Mode scraper?

Yes. The main limitation is prompt size – requests sent to the API cannot exceed 400 characters. Longer prompts need to be shortened before submitting.

Learn more

For detailed information on API features, integrations, and more examples, see the Web Scraper API documentation.

Contact us

For questions or support, contact us at hello@oxylabs.io or via live chat.