Research Website

Extract specific information from any website by asking questions about its content. This tool intelligently crawls and analyzes web pages to find answers to your questions.

This tool is part of our beta Tools API. Contact sales to request increased limits (available to select partners).

POST/v1/tools/research-website

Endpoint

This endpoint allows you to ask questions about a website's content and receive structured or unstructured answers.

Required parameters

Name
url
Type
string
Description
The URL of the website to analyze. Must be a valid HTTP or HTTPS URL.
Name
question
Type
string
Description
The question to ask about the website content. Be specific for best results.

Optional parameters

Name
output_schema
Type
object
Description
Define the structure of the output you want to receive. When provided, the tool will extract and format the information according to your schema.

Request

POST

/v1/tools/research-website

curl -X POST https://api.utopianlabs.ai/v1/tools/research-website \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://stripe.com",
    "question": "What payment methods does Stripe support?"
  }'

Response

{
  "output": "Stripe supports a wide variety of payment methods including credit and debit cards (Visa, Mastercard, American Express, Discover, JCB, Diners Club, China UnionPay), digital wallets (Apple Pay, Google Pay, Microsoft Pay, WeChat Pay, Alipay), bank debits (ACH, SEPA, BACS), bank transfers, buy now pay later options (Klarna, Afterpay, Affirm), and various local payment methods specific to different countries and regions."
}

Structured Output Example

You can use the output_schema parameter to receive structured data in a specific format.

Example schema

Request information about a company's pricing in a structured format.

Request with schema

curl -X POST https://api.utopianlabs.ai/v1/tools/research-website \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://openai.com/pricing",
    "question": "What are the pricing tiers?",
    "output_schema": {
      "pricing_tiers": [{
        "name": "string",
        "price": "string",
        "features": ["string"]
      }]
    }
  }'

Structured response

{
  "output": {
    "pricing_tiers": [
      {
        "name": "Free",
        "price": "$0/month",
        "features": ["Basic website analysis", "Limited queries", "Standard support"]
      },
      {
        "name": "Pro",
        "price": "$29/month",
        "features": ["Advanced analysis", "Unlimited queries", "Priority support", "API access"]
      },
      {
        "name": "Enterprise",
        "price": "Custom pricing",
        "features": ["Custom solutions", "Dedicated support", "SLA guarantees", "Advanced integrations"]
      }
    ]
  }
}

Limitations

Cannot access content behind login walls or paywalls
JavaScript-heavy sites may have limited content visibility
Maximum crawl depth is limited to prevent excessive processing
Large websites may return partial results based on relevance to your question