Realtime web data API

Fresh web data,
at any scale.

Realtime answers in seconds, whole catalogs in bulk, and every hard part of scraping handled for you. One reliable API for clean, structured data, priced per result.

No credit card. 1,000 free credits every month; a product costs 2 credits in bulk, 3 in realtime.

01Realtime

Fast on every call, not just on average.

Most scraping APIs add seconds of overhead on top of the page itself. FreshCrawl answers in typically 1–3 seconds, call after call, so you can put live data directly behind a product page, a pricing engine or an agent's next step.

  • One GET, one answer. Nothing to poll
  • Fetched live at request time, stamped observedAt + zipCode
  • Typed JSON with a stable schema, documented per field
curl -H "Authorization: Bearer $FRESHCRAWL_KEY" \
  https://api.freshcrawl.io/v1/walmart-us/items/20708870822

02Bulk

Whole catalogs, streamed as they land.

Send up to 1,000,000 lines per batch and as many batches as you need. Rows stream in the moment they're fetched, so you start working with results right away instead of waiting for the whole job to finish.

  • Read results while the job runs, or take a webhook at the end
  • Retries happen automatically, so every job comes back fresh and complete
  • Same operations, same schema, cheaper per row: 2 credits a product instead of 3

03Reliability

We handle the hard parts of scraping.

Retries, load balancing, slow and flaky pages, parsing, keeping up when a site changes: that's our job. You call one reliable API and get clean results.

Precise answers, even when the answer is no.

Retries and load balancing happen automatically, so your requests just succeed. In the rare case a request can't be answered, you get a precise reason your code can act on. A failure on our side is never billed.

404 not_found

The item doesn't exist at the source. We verify every 404 before returning it, so you can trust it. 1 credit.

503 service_unavailable

A brief, rare issue on our side. Safe to retry right away. Never billed.

04Use cases

What teams build on it.

Price intelligence, assortment tracking, marketplace analytics and AI agents that need to know what's true right now, not last week.

Price monitoring

Every price change, the day it happens.

GASEE Ergonomic Office Chair$49.99$39.99
Café Bustelo Supreme, 16 oz$15.98$16.83
SDS-Plus Masonry Bit Set$24.97$24.97
Mesh Desk Chair, Lumbar$89.00$74.00

Share of shelf

Where you rank, for every query that matters.

#1Cordless Hammer Drill 20V+3
#2Hammer Drill Kit, 1/2 in−1
#3Rotary Hammer SDS-Plus+5
#4Corded Hammer Drill 7.5A−2

Marketplace & sellers

Who's selling, at what price, and who holds the Buy Box.

Walmart.com$16.83Buy Box
Marketplace seller A$17.492-day
Marketplace seller B$18.10Used

AI agents

Ground answers in what's on the shelf right now.

agent › Is the GASEE chair in stock near 75201?
tool  › GET /v1/walmart-us/items/20708870822
agent › Yes, in stock at $39.99 (was $49.99),
        observed 2 seconds ago.

Previews are illustrative. Every field shown is a real field in the API response.

05Sources

Many sources, one API.

Same key, same envelope, same billing for every source. Walmart, Walmart Business and Amazon are live. More e-commerce data is coming soon.

Walmart

Live 8 endpoints

Walmart Business

Live 4 endpoints

Amazon

Live 6 endpoints

Walmart, Walmart Business and Amazon endpoints
OperationEndpointReturnsCredits bulk / realtime
Item details & Buy Boxwalmart-us.items.getGET /v1/walmart-us/items/{itemId}Full product page data for one item: title, brand, price, Buy Box offer, stock, shipping.2 / 3
All-seller offerswalmart-us.items.offers.listGET /v1/walmart-us/items/{itemId}/offersEvery seller's offer on one item's Buy Box slot, with price, condition and fulfilment.3 / 4
Seller profilewalmart-us.sellers.getGET /v1/walmart-us/sellers/{sellerId}A seller's storefront record: name, rating, contact info and status.2 / 3
Seller catalog pagewalmart-us.sellers.items.listGET /v1/walmart-us/sellers/{sellerId}/itemsOne page of a seller's product catalog, with price and availability per item.2 + 2 / 2 + 3 per page
Search resultswalmart-us.search.listGET /v1/walmart-us/search?q=…Full result tiles for one page of a Walmart search query.2 / 3
Reviews & rating summarywalmart-us.items.reviews.listGET /v1/walmart-us/items/{itemId}/reviewsReviews and the rating summary for one item, one page.2 / 3
Category listing pagewalmart-us.categories.items.listGET /v1/walmart-us/categories/{categoryId}/itemsOne page of a Walmart category listing (e.g. best sellers), with every field of every product tile.2 / 3
Related productswalmart-us.items.related.listGET /v1/walmart-us/items/{itemId}/relatedEvery recommendation shelf of one item page (similar items, popular in category, frequently bought together, …), with every field of every product tile.2 / 3
Business item details & Buy Boxwalmart-business-us.items.getGET /v1/walmart-business-us/items/{itemId}Full Walmart Business product page data for one item: price, Buy Box offer with its business stock, volume pricing and business-price flag, every product field.2 / 3
Business all-seller offerswalmart-business-us.items.offers.listGET /v1/walmart-business-us/items/{itemId}/offersEvery seller's offer on one item on Walmart Business, each with its business stock, order limits and volume pricing.3 / 4
Business search resultswalmart-business-us.search.listGET /v1/walmart-business-us/search?q=…Full result tiles for one page of a Walmart Business search, with each tile's business price flag and volume pricing.2 / 3
Business reviews & rating summarywalmart-business-us.items.reviews.listGET /v1/walmart-business-us/items/{itemId}/reviewsThe rating summary and the reviews the Walmart Business item page shows for one item.2 / 3
Amazon product details & buy boxamazon-us.items.getGET /v1/amazon-us/items/{itemId}Every field of one Amazon product page: title, buy box price, availability and seller, ratings, bullets, details, images, breadcrumb and variations.2 / 3
Amazon all-seller offersamazon-us.items.offers.listGET /v1/amazon-us/items/{itemId}/offersEvery offer on Amazon's offers panel for one product: condition, price, seller, delivery promises and promotions.3 / 4
Amazon seller profileamazon-us.sellers.getGET /v1/amazon-us/sellers/{sellerId}One Amazon seller's profile: name, feedback summary and histograms, about texts, published business details and policies.2 / 3
Amazon seller's productsamazon-us.sellers.items.listGET /v1/amazon-us/sellers/{sellerId}/itemsOne page of the products an Amazon seller lists, every field of each product card.2 + 2 / 2 + 3 per page
Amazon search resultsamazon-us.search.listGET /v1/amazon-us/search?q=…One page of Amazon search results: every product card and the page-level blocks (result count, refinements, related searches).2 / 3
Amazon category listingamazon-us.categories.items.listGET /v1/amazon-us/categories/{categoryId}/itemsOne page of an Amazon category (browse node) listing: every product card and the page-level blocks.2 / 3
# Point your agent at one URL
curl https://api.freshcrawl.io/docs/agents/index.md

# A Markdown index of every operation:
#   parameters, response fields, errors, prices,
#   curl / TypeScript / Python examples

06Built for agents

Docs your agent can read.

Every operation has plain Markdown docs an LLM can fetch and follow, generated straight from the API spec. Humans get interactive docs in the console with their key already selected.

07Pricing

Buy credits once. Spend them at your pace.

Every package unlocks every source and endpoint, realtime and bulk. Pay once, no subscription: credits never expire, and bigger packages cost less per credit. You also get 1,000 free credits every month.

Starter

$87 once

250,000 credits

Per 1,000 credits
$0.348
≈ Products in bulk
125k
Get Starter

Growth

$275 once

1,000,000 credits

Per 1,000 credits
$0.275
≈ Products in bulk
500k
Get Growth

Volume

$3,300 once

20,000,000 credits

Per 1,000 credits
$0.165
≈ Products in bulk
10M
Get Volume

Enterprise

$13,000 once

100,000,000 credits

Per 1,000 credits
$0.130
≈ Products in bulk
50M
Get Enterprise

Estimate your month

Pick a workload or type your own numbers. We suggest the smallest package that covers one month.

10,000 products checked every day.

Monthly estimate by call type
Call typeCalls / monthCredits each$ per 1,000 calls$ / month
Productper product2$0.55$165.00
Product + every seller offerper product5$1.38$0.00
Search resultsper results page2$0.55$0.00
Category listingper listing page2$0.55$0.00
Seller profileper seller2$0.55$0.00
Seller catalogper 5-page catalog12$3.30$0.00
Reviewsper reviews page2$0.55$0.00
Buy box mapper 51-state map, batch only102$28.05$0.00

Credits per month 600,000

Suggested package Growth · $275

Cost of a month $165.00

Credits per call
Call typeBulk (async)Realtime (sync)
Productper product23
Product + every seller offerper product57
Search resultsper results page23
Category listingper listing page23
Seller profileper seller23
Seller catalogper 5-page catalog1217
Reviewsper reviews page23
Buy box mapper 51-state map, batch only102—
Item does not exista verified 40411
Request we could not answerfailed or timed out00

Safety limits: free and trial accounts 60 requests/min, 5 concurrent; accounts with purchased credits 6,000 requests/min, 120 concurrent. The smallest package is $87; need more than 100M credits? Talk to us.

08FAQ

Questions.

Anything else: support@freshcrawl.io

How fast is a realtime call?

Typically 1–3 seconds, call after call. There is nothing to poll: one GET, one answer.

How fresh is the data?

Every call is a live fetch at request time. Each response carries meta.observedAt, the exact moment the data was collected, and meta.zipCode, the US ZIP code it was collected for, because prices, stock and delivery promises depend on location.

How reliable is it?

Retries and load balancing happen automatically, so your requests just succeed. In the rare case a request cannot be answered, you get a precise reason: a 404 means the item does not exist at the source (we verify every 404 before returning it, and it costs 1 credit), and a 503 means a brief issue on our side that is safe to retry right away and is never billed.

Do I have to wait for a bulk job to finish?

No. Rows are available the moment they are fetched: page through the results while the job is still running, or take a webhook when it is done. Retries happen automatically along the way.

What does a call cost?

It depends on the call and how you send it. A product costs 2 credits in a batch or 3 on demand; the price table above lists every call type. An item that does not exist costs 1 credit, and a request we fail to answer costs nothing. The price is in meta.credits on every response and result.

Do credits expire?

No. A package is a one-time payment, and its credits stay on your balance until you use them. Buy a bigger package when you want a lower price per credit; there is no subscription to cancel.

Which package should I buy?

Enter your expected calls in the estimate above: it picks the smallest package that covers one month. Larger packages cost less per credit, so a package that lasts several months is often the better deal.

Are there rate limits?

Only safety limits that protect you from a runaway script: free and trial accounts can send 60 requests a minute with 5 in flight; accounts with purchased credits can send 6,000 requests a minute with 120 in flight. Need more? Write to support@freshcrawl.io.

Which sources are available?

Walmart (walmart.com, 8 endpoints), Walmart Business (business.walmart.com, 4 endpoints) and Amazon (amazon.com, 6 endpoints) are live today. More e-commerce data is coming soon, all behind the same API, key and billing.

Which location is Amazon data collected for?

ZIP code 75201 (Dallas, TX). Prices, availability and delivery promises are those Amazon shows there, and meta.zipCode names it on every response and result.

Can my AI agent use it directly?

Yes. Every operation has plain Markdown docs at api.freshcrawl.io/docs/agents, the full OpenAPI spec is at /openapi.json, and errors are application/problem+json with stable machine-readable codes.

Do I need a credit card to start?

No. Sign up and you get 1,000 free credits right away, enough for about 333 on-demand product calls, and we top your balance back up to 1,000 every month.

Start in a minute

Start with one call.
Scale to whole catalogs.

1,000 free credits on sign-up, no credit card. Same API at every size.