Browse categories
Explore
Fiverr Pro
English
$
USD
I will build etl data pipelines using python handle data scientist
i enjoy watching nat geo wild and other channels about nature. i also enjoy reading books and it is one of the reasons i could excel in getting my degree.
About this Gig
Do you need to move, transform, clean or synchronize data between databases, files or APIs?
I will build a reliable ETL/ELT data pipeline using Python and SQL to move data between different sources and target databases.
I can build simple batch pipelines as well as more structured data integration solutions.
I can build pipelines for:
- PostgreSQL SQL Server
- SQL Server PostgreSQL
- MySQL PostgreSQL
- CSV/Excel Database
- API Database
- Database Data Warehouse
- Multiple database sources Staging Target
- Incremental data loading
- Batch processing
- Data cleansing and transformation
- Duplicate detection
- Data validation
- Error handling
- Logging and audit tracking
TECHNOLOGIES
- Python
- Pandas
- NumPy
- SQL
- PostgreSQL
- SQL Server
- MySQL
- Oracle
- REST APIs
- ETL/ELT concepts
- Data warehousing
- Staging tables
FAQ
Q: Can you move data between PostgreSQL and SQL Server?
A: Yes. I can build batch-based pipelines between PostgreSQL and SQL Server.
Q: Can you work with APIs?
A: Yes. I can extract data from REST APIs and load it into databases.
Q: Can you handle large datasets?
A: Yes. I can use batching, incremental loading and database-side processing to reduce memory and database overhead.
Q: Can you clean duplicate data?
A: Yes. I can implement validation and duplicate-detection rules based on your business requirements.
Q: Can you schedule the pipeline?
A: Yes. Scheduling can be implemented using available tools such as cron or other orchestration platforms depending on your environment.
