Browse categories
Explore
Fiverr Pro
English
$
USD
I will be your gcp data engineer for python bigquery and etl
About this Gig
I build reliable GCP data pipelines using Python, BigQuery and Dataflow.
If you need to move data from APIs, CSV, JSON or other sources into Google Cloud, I can help you design and build a clean ETL workflow that is easy to maintain and scale.
I can help with:
- Python based ETL pipelines
- BigQuery data loading and transformations
- GCP Dataflow and Apache Beam
- REST API data ingestion
- CSV and JSON processing
- Data quality checks
- Error handling and logging
- Basic Airflow or Cloud Composer orchestration
- BigQuery tables and views
- Pipeline troubleshooting and improvements
My focus is on building practical, maintainable solutions with clear structure, proper validation and documentation.
I have professional experience working with Python, SQL, BigQuery, Dataflow, Apache Beam, Airflow and cloud based data platforms.
Please message me before ordering if your project includes multiple data sources, complex APIs, streaming pipelines or custom GCP requirements so I can confirm the scope first.
Destination Platform:
Google BigQuery
•
Google Cloud Storage
Tools & Platforms:
Google Cloud Dataflow
•
Other
My Portfolio
FAQ
What types of data sources do you support?
I can work with REST APIs, CSV, JSON, Google Cloud Storage, databases, and other structured data sources depending on your requirements.
Can you load data into BigQuery?
Yes. I can build pipelines that load and transform data into BigQuery tables and views.
Do you support Python and Dataflow?
Yes. I can build Python ETL workflows and Apache Beam/Dataflow pipelines for scalable data processing
Can you automate the pipeline?
Yes. I can add scheduling and orchestration using Airflow or Cloud Composer where required.
How can I ensure successful data migration?
I use validation, data quality checks, schema review, logging, and testing to help ensure data is transferred accurately and reliably.
What do you need from me before starting?
Please provide the data source details, sample data or API documentation, target destination, required transformations, and any GCP access needed for the project.
Do you provide data quality checks?
Yes. I can include validation, null checks, duplicate checks, schema checks, and other quality rules based on the project.
Can you work with API-based data sources?
Yes. I can integrate REST APIs, handle authentication, pagination, retries, and process API responses before loading the data.
