Elysia Tools Docs
EN
Language
ZHESPTRUFRDEEN
Back to site
Browse tools

Data Processing

Data Deduplicator

Remove duplicate rows from CSV files based on multiple column combinations. Perfect for cleaning customer lists, survey responses, and database exports. Features: - Multi-column combination deduplication - Fuzzy matching for similar records - Custom deduplication strategies (keep first, last, or most complete record) - Case-insensitive matching option - Whitespace trimming - Detailed duplicate statistics Common Use Cases: - Remove duplicate customer records - Clean email marketing lists - Eliminate redundant survey responses - Prepare data for analysis

text· Text resultOpen tool

Quick start

Call this tool from your code in three languages.

cURL
curl -X POST 'https://api.elysiatools.com/en/api/tools/data-deduplicator' \
  -H 'Content-Type: application/json' \
  -d '{"inputData":"name,email,phone\nJohn Doe,[email protected],123-456-7890\nJane Smith,[email protected],123-456-7890","deduplicationColumns":"email, phone or name, email","strategy":"first","fuzzyMatching":false,"fuzzyThreshold":85,"caseSensitive":false,"trimValues":true,"preserveOriginalOrder":true}'

© 2026 Elysia Tools. Developer documentation.

Back to siteBrowse tools

API reference

Send a POST request with your inputs as JSON. File parameters require a separate upload first.

Endpoint

HTTP
POST https://api.elysiatools.com/en/api/tools/data-deduplicator

Parameters

NameTypeRequiredDescription
inputDatatextareaYes—
deduplicationColumnstextareaNo—
strategyselectNo—
fuzzyMatchingcheckboxNo—
fuzzyThresholdrangeNo—
caseSensitivecheckboxNo—
trimValuescheckboxNo—
preserveOriginalOrdercheckboxNo—

Response format

Text result

JSON
{
  "result": "Processed text content",
  "error": "Error message (optional)",
  "message": "Notification message (optional)",
  "metadata": {
    "key": "value"
  }
}

MCP integration

Add this tool to your Model Context Protocol server so AI agents can list and call it.

Server configuration

Add this block to your MCP client configuration:

mcp.json
{
  "mcpServers": {
    "elysiatools-data-deduplicator": {
      "name": "data-deduplicator",
      "description": "Remove duplicate rows from CSV files based on multiple column combinations. Perfect for cleaning customer lists, survey responses, and database exports.\n\nFeatures:\n- Multi-column combination deduplication\n- Fuzzy matching for similar records\n- Custom deduplication strategies (keep first, last, or most complete record)\n- Case-insensitive matching option\n- Whitespace trimming\n- Detailed duplicate statistics\n\nCommon Use Cases:\n- Remove duplicate customer records\n- Clean email marketing lists\n- Eliminate redundant survey responses\n- Prepare data for analysis",
      "baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=data-deduplicator",
      "command": "",
      "args": [],
      "env": {},
      "isActive": true,
      "type": "sse"
    }
  }
}

List available tools

After connecting to the SSE endpoint, list the exposed tools:

tools/list
{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/list"
}

Call this tool

Invoke the tool by its id, passing arguments built from its parameters:

tools/call
{
  "jsonrpc": "2.0",
  "id": 2,
  "method": "tools/call",
  "params": {
    "name": "data-deduplicator",
    "arguments": {
  "inputData": "name,email,phone\nJohn Doe,[email protected],123-456-7890\nJane Smith,[email protected],123-456-7890",
  "deduplicationColumns": "email, phone or name, email",
  "strategy": "first",
  "fuzzyMatching": false,
  "fuzzyThreshold": 85,
  "caseSensitive": false,
  "trimValues": true,
  "preserveOriginalOrder": true
}
  }
}
Chain multiple tools in one session with a comma-separated toolId list, e.g. /mcp/sse?toolId=png-to-webp,jpg-to-webp,gif-to-webp (max 20).

Questions or issues? Contact [email protected]

Browse tools
Open tool