ChatGPT

This document provides information about the API and the available POST parameters.

The LLM Scraper enables retrieval of ChatGPT responses- including optional search-enhanced answers and returns a structured JSON output.

API Setup

Endpoint

https://llm-scraper.netnut.io/search

Authentication

Use HTTP Basic Authentication:

Authorization: Basic <base64(username:password)>

Where <base64(username:password)> is the Base64-encoded string of your NetNut credentials.

Request Body Schema

{
  "prompt": "Explain SEO ranking factors in 2025",   // Required
  "country": "us",                                   // Optional
  "web_search": false,                               // Optional, default false
  "follow_up_prompt": "Summarize in 5 bullets",      // Optional
  "engine": "chatgpt"                                // Optional, default: chatgpt
}

Field Descriptions

Field

Description

Parameter Type

prompt

Main prompt sent to ChatGPT. Max length: 4096 chars.

Required

web_search

Enables ChatGPT’s built-in Web Search mode.

Optional (default: false)

country

Target geographic region for contextual responses.

Optional

engine

The chatbot engine to use. Currently only "chatgpt" is supported.

Optional (default: chatgpt)

follow_up_prompt

A second message sent immediately after the first response.

Optional

Example Usage

curl -X POST https://llm-scraper.netnut.io/search \
  -H "Content-Type: application/json" \
  -H "Authorization: Basic <base64(username:password)>" \
  -d '{
    "prompt": "Give me SEO trends for 2025",
    "country": "uk",
    "web_search": true
  }'

import requests
from base64 import b64encode

headers = {
    "Authorization": "Basic " + b64encode(b"username:password").decode(),
    "Content-Type": "application/json"
}

body = {
    "prompt": "Give me SEO trends for 2025",
    "country": "us",
    "web_search": True
}

response = requests.post("https://llm-scraper.netnut.io/search", headers=headers, json=body)
print(response.json())

const username = 'your_username';
const password = 'your_password';
const auth = Buffer.from(`${username}:${password}`).toString('base64');

const headers = {
  'Authorization': `Basic ${auth}`,
  'Content-Type': 'application/json'
};

const body = {
  prompt: 'Give me SEO trends for 2025',
  country: 'us',
  web_search: true
};

fetch('https://llm-scraper.netnut.io/search', {
  method: 'POST',
  headers: headers,
  body: JSON.stringify(body)
})
.then(response => response.json())
.then(data => console.log(data))
.catch(error => console.error('Error:', error.message));

Response Format

The ChatGPT Scraper always returns structured JSON. No HTML is returned.

Example JSON Response

{
  "traceID": "71f9e0b2-3a77-4ad0-9a61-23b7e1bfa8d1",
  "scraper": "ChatGPT scraper",
  "timestamp": "2025-11-26T11:23:45Z",
  "request_duration": 6.8,
  "process_duration": 7.0,
  "response": {
    "text": "Here are the leading SEO trends for 2025...",
    "citations_found": true,
    "citations": [
      {
        "id": 1,
        "url": "https://example.com/seo-trends",
        "title": "SEO Trends 2025",
        "section": "citations"
      },
      {
        "id": 2,
        "url": "https://example.com/ai-content",
        "title": "AI & Search Evolution",
        "section": "more"
      }
    ]
  },
  "follow_up_response": {
    "text": "Here is a short summary...",
    "citations_found": false,
    "citations": []
  }
}

PreviousLLM Scraper NextFeatures

Last updated 4 days ago