Browse categories
Explore
Fiverr Pro
English
$
USD
I will build a web scraper and data pipeline
Golang Backend Developer
Golang Developer with 3+ years of experience building robust and scalable backend systems — microservices, APIs, and real-time applications.
Key skills:
• Golang (Gin, Echo), REST, GraphQL, WebSocket...
About this Gig
I build reliable data pipelines in Go: scraping websites or monitoring APIs, cleaning and structuring the data, and pushing it wherever you need a database, a Telegram bot, or a third-party platform via its API. I've built systems that continuously monitor freight/logistics listings, track YouTube channel analytics, and publish parsed data to external platforms through custom API clients.
What I can build for you:
- Web scrapers (HTTP-based or browser automation for JS-heavy/protected sites)
- Duplicate filtering and data normalization
- Scheduled/continuous monitoring with configurable intervals
- Custom API client libraries for third-party platforms (auth, requests, error handling)
- Storage in PostgreSQL/MySQL with historical tracking and filters
- Human-like timing/anti-detection logic for sites sensitive to bot traffic
- Delivery of results via Telegram, webhook, or direct platform publishing
Tech stack: Golang, HTTP/Browser Automation, PostgreSQL/MySQL, REST API integration, Docker.
Tell me the source site/API and target output, and I'll scope the exact approach.
Technology:
Selenium
•
Beautiful soup
•
Playwright
•
Pandas
•
Golang
Technique:
Automated
My Portfolio
FAQ
Can you scrape sites that require login or have anti-bot protection?
Yes, depending on the site. I use browser automation with human-like timing for JS-heavy or protected sites. Send me the target URL and I'll confirm the right approach before you order.
How do you handle sites that change their layout over time?
Scrapers are built to be as resilient as possible, but layout changes can break any scraper eventually. I recommend a short trial run after delivery, and ongoing maintenance can be arranged separately if needed.
Can the scraped data be pushed directly into my own system/database?
Yes — Standard and Premium packages include storage integration (PostgreSQL/MySQL) and, in Premium, a custom API client to publish data directly into a third-party platform.
Is this legal / will my account get banned for using this?
I build in safeguards like randomized delays and human-like behavior patterns to minimize detection risk, but scraping legality and platform ToS compliance depend on the specific target site — that responsibility stays with the buyer.
How often can the scraper run — one-time or continuous?
Both are supported. Basic covers a one-time run; Standard and Premium include continuous/scheduled monitoring with configurable intervals up to the pages/sources limit in your package.
