1. Scrape
ScrapingDuck API Docs
  • Actions
    • Returns example action objects for each available action.
      GET
  • Browser
    • Executes a list of browser actions.
      POST
    • Fetches the full HTML content of a web page.
      GET
    • Extracts the main article content from a web page.
      GET
  • Devices
    • Gets the list of all available device names.
      GET
    • Gets detailed information for a specific device.
      GET
  • Scrape
    • Fetches the raw HTML source of a web page as a direct text/html response.
      GET
    • Fetches the full scraping result including HTML content and metadata (JSON response).
      GET
    • Extracts the main article content from a web page.
      GET
    • Extracts the main article content as Markdown-friendly text.
      GET
    • Captures a screenshot of a web page as a binary image.
      GET
    • Submits a batch of URLs for asynchronous scraping. Returns 202 Accepted with a batch ID immediately. Results are delivered via webhook callback or polled via GET /v1/scrape/batch/{batchId}.
      POST
    • Polls the status of a previously submitted batch scrape job. Results are retrieved from the webapp's persistent storage.
      GET
  • Billing
    • Estimates the credit cost of a browser automation request without executing it.
      POST
    • Estimates the credit cost of a batch scrape without reserving credits.
      GET
  • Search
    • Performs a web search and returns unified results from SearXNG, TinyFish or Brave Search.
      GET
  • Sessions
    • Opens a new interactive browser session. Creating a session is free; each step is billed.
      POST
    • Lists the caller's active sessions.
      GET
    • Gets a session's metadata and current page snapshot.
      GET
    • Closes the caller's session. Idempotent: always returns 204.
      DELETE
    • Executes a single browser action in the caller's live session.
      POST
  • Schemas
    • ActionExecutionMeta
    • BrowserAction
    • BatchItemResult
    • BrowserActionResult
    • BatchScrapeRequest
    • BrowserActionResultActionExecutionResponse
    • BatchScrapeResponse
    • BrowserAutomationRequest
    • BatchWebhookMeta
    • DeviceContextOptionsDto
    • BatchWebhookPayload
    • BillingEstimateResponse
    • DeviceDetailDto
    • ProblemDetails
    • PublicBrowserAutomationRequest
    • ResultData
    • BrowserActionResultSessionStepResponse
    • ValidationProblemDetails
    • ViewSettings
    • SearchResponse
    • SearchResultItem
    • SessionOpenedResponse
    • SessionSummaryDto
    • TrafficSource
ScrapingDuck
  1. Scrape

Extracts the main article content from a web page.

GET
https://api.scrapingduck.com/v1/scrape/article
Last modified:2026-10-04 11:19:18
Visits the specified URL, extracts the main article text, and returns it as clean HTML within a JSON envelope.

Request

Authorization
API Key
Add parameter in query
apiKey
Example:
apiKey: ********************
or
Query Params

Responses

🟢200
application/json
OK
Body

🟠400
🟠401
🟠404
🔴500
Request Request Example
Shell
JavaScript
Java
Swift
curl --location 'https://api.scrapingduck.com/v1/scrape/article?url=&deviceName=&locale=&timezone=&disableResourceExclusion=&useAdvancedSpoofing=&disableJavaScript=&useResidentialProxy=&apiKey=%3Capi-key%3E'
Response Response Example
200 - Success
{
    "executionId": "myApiKey_a1b2c3d4",
    "results": [
        {
            "type": "VisitUrlActionResult",
            "success": true,
            "data": [
                {
                    "name": "StatusCode",
                    "data": 200
                },
                {
                    "name": "ResponseSize",
                    "data": 45678
                },
                {
                    "name": "Headers",
                    "data": {
                        "content-type": "text/html; charset=utf-8",
                        "server": "nginx"
                    }
                },
                {
                    "name": "Cookies",
                    "data": [
                        {
                            "name": "sessionid",
                            "value": "abc123",
                            "domain": ".example.com",
                            "path": "/",
                            "httpOnly": true,
                            "secure": true
                        }
                    ]
                }
            ]
        },
        {
            "type": "ExtractArticleActionResult",
            "success": true,
            "data": {
                "article": {
                    "uri": "https://news.ycombinator.com/item?id=40825098",
                    "title": "Extracted Article Title",
                    "byline": "John Doe",
                    "content": "<div><p>This is the main content of the article.</p></div>",
                    "textContent": "This is the main content of the article.",
                    "excerpt": "A short summary of the article content.",
                    "author": "John Doe",
                    "siteName": "Hacker News",
                    "publicationDate": "2025-01-01T12:00:00Z",
                    "featuredImage": "https://via.placeholder.com/1200x630.png",
                    "language": "en",
                    "timeToRead": "00:05:00",
                    "isReadable": true
                }
            }
        }
    ],
    "meta": {
        "actionsRequested": 2,
        "actionsSucceeded": 2,
        "startedAtUtc": "2025-01-01T12:00:00Z",
        "finishedAtUtc": "2025-01-01T12:00:02Z",
        "durationMs": 2000,
        "responseSizeBytes": 1234,
        "maxActionsAllowed": 50
    }
}
Modified at 2026-10-04 11:19:18
Previous
Fetches the full scraping result including HTML content and metadata (JSON response).
Next
Extracts the main article content as Markdown-friendly text.
Built with