Scraping
Scraping & automationExtracting data from undocumented APIs or HTML, always from legitimate sources.
Undocumented APIs, HTML and antibot sites. Always legitimate sources, always snapshotted.
Where it was used 03
- Metal Globe
195,679 bands from 153 countries, using Scrapling/Camoufox for anti-bot evasion at a careful pace.
- Radar de Precios
Undocumented Algolia and SFCC APIs, read straight out of each frontend's own bundle.
- Signal Agent
Four collector types — RSS, JSON over HTTP, price feeds and HTML — deduplicated by content hash.
Web & product
Metal Globe
I put 195,679 metal bands on a 3D globe, filterable by country, genre and decade.
three.js · 4,408 → 496 lines, split into data.js · lazy-loaded flags · static
Markets & comparators
Radar de Precios
I match 296 medicines across Peruvian pharmacy chains by reading their own undocumented APIs.
Python adapters · Algolia/SFCC APIs · three-layer matcher · static comparison table
- Python
- SC Scraping
- EN Entity matching
- BE BeautifulSoup & selectolax
- JavaScript
Agents & AI automation
Signal Agent
A market monitor where the model has to write a falsifiable prediction before it can be scored — 3 open, 0 resolved, the first ones due January 2027.
Python · GitHub Actions · SQLite
- Python
- GitHub Actions
- SQLite
- SC Scraping
- LL LLMs & agents
Same category