I will do web scraping and data extraction using python and selenium
Software Engineer
About this Gig
Need data from a website but don't want to copy-paste for hours? I build custom web scrapers that pull exactly the data you need clean, structured, and ready to use.
What I can handle:
- Static and JavaScript-rendered websites (Selenium)
- Multi-page / paginated data (thousands of records)
- Anti-bot protected sites (proxy rotation, CAPTCHA handling)
- Data cleaning, deduplication, and normalization
- Delivery in CSV, Excel, JSON, or directly into MySQL/PostgreSQL/MongoDB
Proven experience: I built a production-scale price comparison scraper that collected 50,000+ live product listings across multiple major e-commerce sites, handling JS rendering, pagination, and data normalization with clean, deduplicated data stored in PostgreSQL.
Common use cases:
- Price monitoring / competitor tracking
- Lead generation (business directories, contact data)
- Product catalogs and marketplace data
- Real estate / job listings aggregation
- Research datasets
Before ordering, message me with the website(s) and data fields you need I'll confirm feasibility before you pay, so there are no surprises.
Let's automate your data collection.
Technology:
Python
•
PHP
•
Scrapy
•
Selenium
•
Beautiful soup
Information type:
Images
•
Listings
•
Price comparison
•
Websites
•
Links
Technique:
Automated
My Portfolio
FAQ
Can you scrape websites that require login?
Yes, if you can provide access/credentials or the site allows automated access within its terms.
What if the website has anti-bot protection?
I use proxy rotation and browser automation (Selenium) to handle most anti-bot measures. Message me the site first so I can confirm feasibility.
What format will I receive the data in?
CSV, Excel, or JSON by default. Database delivery (MySQL/PostgreSQL/MongoDB) available on Standard/Premium.
Can you set up recurring/scheduled scraping?
Yes — available as an add-on for ongoing price monitoring or data refresh needs.
Is web scraping legal?
I scrape publicly available data and follow site terms of service where applicable. I don't scrape login-restricted or clearly prohibited data without explicit permission.
