Skip to content
Data & analytics

Get messy data cleaned up and duplicates removed

Two customer lists after a merger, a CRM full of duplicates, a spreadsheet nobody trusts. Cleaning it by hand eats weeks, and mistakes live on in every report built on top. A data specialist can match, merge and standardise records with rules you agree up front.

TW-DRAFTDraft

Merge two customer lists and remove duplicates before a CRM import

Budget
You set this
Timeline
2 weeks
Category
Data & analytics

Scope

After acquiring a smaller company we have two customer lists, one in HubSpot and one in spreadsheets, with overlapping customers written in different ways. We want them merged into one clean list, duplicates removed by rules we agree, and imported into HubSpot.

Deliverables

  • Data profile of both sources
  • Agreed matching and merge rules
  • One deduplicated customer list
  • Change log of merged and removed records
  • Import into HubSpot with field mapping

Skills

  • Data cleaning
  • Excel
  • HubSpot
  • Deduplication
An example brief. Describe your task and the brief writer drafts one like it.

What the work involves

The scope a provider will expect to cover. Leave out what you don't need, and say so in the brief.

  • Profiling the data: which fields there are, how they're formatted, what's missing
  • Agreeing the rules for what counts as a duplicate and which record wins
  • Standardising formats: names, addresses, phone numbers, dates
  • Merging and deduplicating, with a log of every change
  • Delivering a clean file, or importing it back into your system

What to put in the brief

The facts a provider needs to give you a real price instead of a guess. Write it in your own words: the brief writer turns it into scope and deliverables, asks about anything missing, and you can edit every line before it goes out.

Start the brief
  1. 1Where the data lives, and roughly how many rows or records
  2. 2What a clean result looks like, and the system it goes back into
  3. 3How you'd decide which of two duplicates to keep
  4. 4Whether the data includes personal information, and how you'll share it
  5. 5A small sample with personal details removed, if you can

Ask each provider

Every proposal opens a conversation, so you can ask before you accept. The answers are often what separates two similar prices.

  • How will you decide what counts as a duplicate, and will you check edge cases with us?
  • Will we get a log of what changed, so it can be undone?
  • How will you store our data while you work, and delete it afterwards?

Questions companies ask

How do I share customer data safely?

Share a sample with personal details removed to get quotes. Once you've chosen someone, agree how the data will be stored and deleted, and give access through your own tools rather than emailing files where you can.

Can the clean-up be repeated next time?

Often, yes. Ask providers whether they can leave you a repeatable process, such as a script or a set of import rules, so the same mess doesn't build up again.

Ready to hand it off?

Describe it in a sentence or two. The brief goes to every provider who lists Data & analytics, and you compare their proposals side by side. Posting is free, and you set the budget.

Post a task

More data & analytics guides

All guides