Data Processing
Remove duplicate rows from CSV files based on multiple column combinations. Perfect for cleaning customer lists, survey responses, and database exports. Features: - Multi-column combination deduplication - Fuzzy matching for similar records - Custom deduplication strategies (keep first, last, or most complete record) - Case-insensitive matching option - Whitespace trimming - Detailed duplicate statistics Common Use Cases: - Remove duplicate customer records - Clean email marketing lists - Eliminate redundant survey responses - Prepare data for analysis
Call this tool from your code in three languages.
curl -X POST 'https://api.elysiatools.com/en/api/tools/data-deduplicator' \
-H 'Content-Type: application/json' \
-d '{"inputData":"name,email,phone\nJohn Doe,[email protected],123-456-7890\nJane Smith,[email protected],123-456-7890","deduplicationColumns":"email, phone or name, email","strategy":"first","fuzzyMatching":false,"fuzzyThreshold":85,"caseSensitive":false,"trimValues":true,"preserveOriginalOrder":true}'Send a POST request with your inputs as JSON. File parameters require a separate upload first.
POST https://api.elysiatools.com/en/api/tools/data-deduplicator| Name | Type | Required | Description |
|---|---|---|---|
| inputData | textarea | Yes | — |
| deduplicationColumns | textarea | No | — |
| strategy | select | No | — |
| fuzzyMatching | checkbox | No | — |
| fuzzyThreshold | range | No | — |
| caseSensitive | checkbox | No | — |
| trimValues | checkbox | No | — |
| preserveOriginalOrder | checkbox | No | — |
Text result
{
"result": "Processed text content",
"error": "Error message (optional)",
"message": "Notification message (optional)",
"metadata": {
"key": "value"
}
}Add this tool to your Model Context Protocol server so AI agents can list and call it.
Add this block to your MCP client configuration:
{
"mcpServers": {
"elysiatools-data-deduplicator": {
"name": "data-deduplicator",
"description": "Remove duplicate rows from CSV files based on multiple column combinations. Perfect for cleaning customer lists, survey responses, and database exports.\n\nFeatures:\n- Multi-column combination deduplication\n- Fuzzy matching for similar records\n- Custom deduplication strategies (keep first, last, or most complete record)\n- Case-insensitive matching option\n- Whitespace trimming\n- Detailed duplicate statistics\n\nCommon Use Cases:\n- Remove duplicate customer records\n- Clean email marketing lists\n- Eliminate redundant survey responses\n- Prepare data for analysis",
"baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=data-deduplicator",
"command": "",
"args": [],
"env": {},
"isActive": true,
"type": "sse"
}
}
}After connecting to the SSE endpoint, list the exposed tools:
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/list"
}Invoke the tool by its id, passing arguments built from its parameters:
{
"jsonrpc": "2.0",
"id": 2,
"method": "tools/call",
"params": {
"name": "data-deduplicator",
"arguments": {
"inputData": "name,email,phone\nJohn Doe,[email protected],123-456-7890\nJane Smith,[email protected],123-456-7890",
"deduplicationColumns": "email, phone or name, email",
"strategy": "first",
"fuzzyMatching": false,
"fuzzyThreshold": 85,
"caseSensitive": false,
"trimValues": true,
"preserveOriginalOrder": true
}
}
}Questions or issues? Contact [email protected]