Build one reliable collection path
Start with a representative page and a clear output contract. These guides explain the decisions between submission and a usable result, including what to do when a target changes.
- HTTP vs browser scraping: choose by the data you needA practical method for selecting HTTP, browser, or auto acquisition: compare returned content, wait conditions, routing, and effective cost.
- How to validate structured web extractionDesign a small extraction schema, submit an individual request, inspect extraction state, and validate data before storing or reusing a recipe.
- Asynchronous scraping: polling, retries, and idempotencyHandle RunHarvester requests from submission to retained result. Distinguish network retries, failed jobs, incomplete results, and result expiry.