Setting Up Fetch

Zenrows’ Fetch enables fast, efficient, and hassle-free data extraction from web pages by providing versatile scraping modes. Whether you’re new to scraping or already experienced, Zenrows adapts to your needs, making it easy to collect data from the web while overcoming the common challenges posed by modern websites, including CAPTCHAs and anti-bot mechanisms.

Getting started

Zenrows’ API offers a straightforward approach to web scraping with just two key components:

API key – Your unique key to authenticate requests.
Sign up free
The encoded URL – The target URL you want to scrape, properly encoded.

Once logged in, you’ll be directed to the Overview page, where you can locate your API key and start running your requests.

Open the Overview page

Here’s what you can do:

Paste your target URL to configure a request.
Enable Zenrows parameters like blocking unnecessary resources or specifying JavaScript instructions.
Select a programming language (e.g., Python) and a connection mode. For general use, select “cURL” to generate the full API endpoint that works with any HTTP client.
Test the request by clicking “Try It” to execute the request in the browser.
Copy the generated code and integrate it into your Python script.

Connection modes

Zenrows Fetch accommodates different needs through three flexible connection methods:

API Mode: Ideal for quick and easy scraping with all the processing handled by Zenrows. Just pass your API key and URL, and get the data back.
Proxy Mode: For users who want to maintain control over their scraping logic but need Zenrows’ powerful proxy network, this mode allows you to use Zenrows as a proxy. You can integrate it into your existing system, enabling access to residential, datacenter, and rotating proxies to avoid IP bans and anti-bot systems.
SDK: Zenrows offers dedicated SDKs for Python and Node.js to simplify integration for developers. These SDKs abstract many low-level details, like request handling, retries, and response processing, making it easy for both beginners and experienced developers to get started quickly.

Response Headers

Zenrows provides several types of headers in API responses to help you monitor usage and understand the results:

Target Website Headers

Headers from the target website are prefixed with Zr- for easy identification. For example:

Zr-Content-Encoding: gzip
Zr-Content-Type: text/html
Zr-Cookies: _pxhd=Bq7P4CRaW1B...

Zenrows Monitoring Headers

Zenrows also includes valuable monitoring headers with each response:

Concurrency-Limit: 200
Concurrency-Remaining: 199
X-Request-Cost: 0.001
X-Request-Id: 67fa4e35647515d8ad61bb3ee041e1bb
Zr-Final-Url: https://www.example.com/

These headers provide important information:

Concurrency-Limit: Your maximum concurrent request limit based on your plan
Concurrency-Remaining: Number of additional concurrent requests you can make
X-Request-Cost: The cost of this request
X-Key-Credits-Remaining: The lowest remaining credits across your API key’s credit caps. Sent only for keys with at least one cap
X-Request-Id: Unique identifier for the request, crucial for troubleshooting
Zr-Final-Url: The final URL after any redirects, ensuring you always know the last page accessed.

When contacting support about any issues, always include the X-Request-Id from your response. This identifier allows our team to quickly trace your specific request in our logs.

API Key

Your API Key is the gateway to the Zenrows Fetch, functioning as both an authentication tool and an identifier for all your requests. Without it, you won’t be able to access Zenrows’ features or receive any scraped data. You can easily create your API Key by signing up for an account.

Make sure to store your key securely and never share it publicly.

## pip install requests
import requests

url = 'https://httpbin.io/anything'
apikey = 'YOUR_ZENROWS_API_KEY'
params = {
    'url': url,
    'apikey': apikey,
    'mode': 'auto',
}
response = requests.get('https://api.zenrows.com/v1/', params=params)
print(response.text)

// npm install axios
const axios = require('axios');

const url = 'https://httpbin.io/anything';
const apikey = 'YOUR_ZENROWS_API_KEY';
axios({
	url: 'https://api.zenrows.com/v1/',
	method: 'GET',
	params: {
		'url': url,
		'apikey': apikey,
		'mode': 'auto',
	},
})
    .then(response => console.log(response.data))
    .catch(error => console.log(error));

import org.apache.hc.client5.http.fluent.Request;

public class APIRequest {
    public static void main(final String... args) throws Exception {
        String apiUrl = "https://api.zenrows.com/v1/?apikey=YOUR_ZENROWS_API_KEY&url=https%3A%2F%2Fhttpbin.io%2Fanything&mode=auto";
        String response = Request.get(apiUrl)
                .execute().returnContent().asString();

        System.out.println(response);
    }
}

<?php
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, 'https://api.zenrows.com/v1/?apikey=YOUR_ZENROWS_API_KEY&url=https%3A%2F%2Fhttpbin.io%2Fanything&mode=auto');
curl_setopt($ch, CURLOPT_CUSTOMREQUEST, 'GET');
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
$response = curl_exec($ch);
echo $response . PHP_EOL;
curl_close($ch);
?>

package main

import (
    "io"
    "log"
    "net/http"
)

func main() {
    client := &http.Client{}
    req, err := http.NewRequest("GET", "https://api.zenrows.com/v1/?apikey=YOUR_ZENROWS_API_KEY&url=https%3A%2F%2Fhttpbin.io%2Fanything&mode=auto", nil)
    if err != nil {
        log.Fatalln(err)
    }
    resp, err := client.Do(req)
    if err != nil {
        log.Fatalln(err)
    }
    defer resp.Body.Close()

    body, err := io.ReadAll(resp.Body)
    if err != nil {
        log.Fatalln(err)
    }

    log.Println(string(body))
}

# gem install faraday
require 'faraday'

url = URI.parse('https://api.zenrows.com/v1/?apikey=YOUR_ZENROWS_API_KEY&url=https%3A%2F%2Fhttpbin.io%2Fanything&mode=auto')
conn = Faraday.new()
conn.options.timeout = 180
res = conn.get(url, nil, nil)
print(res.body)

curl "https://api.zenrows.com/v1/?apikey=YOUR_ZENROWS_API_KEY&url=https%3A%2F%2Fhttpbin.io%2Fanything&mode=auto"

URL

The URL you want to scrape must be URL-encoded to prevent issues with special characters like spaces, question marks, and ampersands. Encoding ensures that servers interpret the URL correctly, avoiding common issues like broken requests or misinterpretation of the data. Always double-check your URLs for proper encoding. If you’re using Zenrows SDKs or common HTTP libraries like requests in Python or axios in Node.js, they often handle this for you.

Get Started

Fetch

Extract

Crawl

Batch

Browser

Residential Proxies (Legacy)

Guides

Setting Up Fetch

Getting started

Connection modes

Response Headers

Target Website Headers

Zenrows Monitoring Headers

API Key

URL

​Getting started

​Connection modes

​Response Headers

​Target Website Headers

​Zenrows Monitoring Headers

​API Key

​URL

Getting started

Connection modes

Response Headers

Target Website Headers

Zenrows Monitoring Headers

API Key

URL