I will create a python script to merge CSV files and remove duplicates
About this Gig
Need to combine CSV files without repeating the same manual work?
I will create a reusable Python script to merge your CSV files and remove duplicates using one agreed rule.
Included:
- Up to 5 CSV files with matching columns, up to 20 MB combined.
- Duplicate removal using complete rows or selected columns.
- One consolidated CSV file.
- Python source code, running instructions, and a summary of input, output, and removed duplicate rows.
I will check column consistency and record counts before delivery. The script will be designed for files with the same structure as the agreed sample.
Delivery: 3 days. Includes 1 revision within the agreed scope.
Not included: Excel workbooks, web scraping, APIs, databases, dashboards, scheduled execution, remote installation, or damaged-file recovery.
Please message me before ordering with an anonymized sample, your operating system, and the expected result. Do not send passwords, API keys, or sensitive personal data. Communication is through Fiverr messages in English or Spanish.
Technology:
Python
Expertise:
Data manipulation
•
Data validation
FAQ
What do you need before I order?
Please send an anonymized or synthetic CSV sample, the number and total size of your files, your operating system, and the expected result. Explain which columns identify duplicates. I will review the sample and confirm whether it fits this package before you order.
How will duplicates be identified?
We will agree on one rule: compare complete rows or match exact values in selected columns. We will also confirm the file order and which matching row to keep. Fuzzy matching and deciding which conflicting values are correct are not included.
Can I reuse the Python script?
Yes. You will receive the Python source code and instructions to run it on files with the same structure and within the agreed limits. Python 3 is required. This is a command-line script, not a graphical app. Remote installation and scheduled execution are not included.
What does the included revision cover?
One round of adjustments within the agreed requirements is included. New features, different file formats, or additional integrations require a separate agreement. Errors in my delivery that do not meet the original requirements will be corrected at no extra charge.
Does this package include Excel files, APIs, or databases?
No. This package covers CSV files only. Excel workbooks (.xlsx or .xls), Google Sheets connections, APIs, databases, web scraping, and damaged-file recovery are not included. Please contact me before ordering if your files or requirements differ from the package.

