Developer tools
Scraper Gateway
A Go scraping service with provider configuration, key rotation and a web administration interface.
- My role
- Developer: backend service
- Status
- Public source
- Stack
- Go · PostgreSQL · Docker · APIs
The problem
Applications need a stable way to retrieve page content even when one upstream scraping provider is rate-limited or unavailable.
My contribution
I wrote the service and its administration interface, moving provider selection, key rotation and request visibility out of individual applications.
How it works
An authenticated endpoint walks configured providers and keys in priority order, rotates to the next on failure and logs every attempt in PostgreSQL. An admin UI manages providers and keys.
What it demonstrates
Backend APIs, integration boundaries and handling of upstream failure. The source is public for technical review.
Related work
RankCortex
SEO, AI-readability and website operations tooling with audits, monitoring and search integrations.
- Go
- PostgreSQL
- JavaScript
- APIs
CityBook
A Morocco-focused local discovery platform connecting business listings, city information, search and localized content.
- Next.js
- React
- TypeScript
- Go
Need something similar?
Tell me about the project, the role or the workflow you want to improve.