Route · In preparation
Scraping
From the page to the data: one adapter per source, dated snapshots and a comparison that never invents a price.
Goal
Go from a web page to a dated, verifiable table, with one adapter per source and clear rules about what is never published.
For: Anyone who needs public data that does not come as a downloadable file.
Syllabus
- One adapter per source and a common output contract
- Dated snapshots instead of live scraping
- Normalizing products so only like is compared with like
- Walking a large catalogue without breaking it or the site
- What is never published: terms of use and personal data
No lessons yet: this route lists what it will cover and the projects it will draw on. Nothing here is written ahead of the work.