Text Processing

Remove Duplicate Lines

Deduplicate lines in a list or text block. Keep the first or last occurrence, with options for case sensitivity, whitespace trimming, and dropping empty lines.

text· Text resultOpen tool

Quick start

Call this tool from your code in three languages.

cURL

curl -X POST 'https://api.elysiatools.com/en/api/tools/remove-duplicate-lines' \
  -H 'Content-Type: application/json' \
  -d '{"text":"apple\nbanana\napple\nApple\n","keep":"first","caseSensitive":true,"trimWhitespace":false,"ignoreEmpty":false}'

API reference

Send a POST request with your inputs as JSON. File parameters require a separate upload first.

Endpoint

HTTP

POST https://api.elysiatools.com/en/api/tools/remove-duplicate-lines

Parameters

Name	Type	Required	Description
text	textarea	Yes	—
keep	select	Yes	—
caseSensitive	checkbox	No	—
trimWhitespace	checkbox	No	—
ignoreEmpty	checkbox	No	—

Response format

MCP integration

Add this tool to your Model Context Protocol server so AI agents can list and call it.

Server configuration

Add this block to your MCP client configuration:

mcp.json

{
  "mcpServers": {
    "elysiatools-remove-duplicate-lines": {
      "name": "remove-duplicate-lines",
      "description": "Deduplicate lines in a list or text block. Keep the first or last occurrence, with options for case sensitivity, whitespace trimming, and dropping empty lines.",
      "baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=remove-duplicate-lines",
      "command": "",
      "args": [],
      "env": {},
      "isActive": true,
      "type": "sse"
    }
  }
}

List available tools

After connecting to the SSE endpoint, list the exposed tools:

tools/list

{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/list"
}

Call this tool

Invoke the tool by its id, passing arguments built from its parameters:

tools/call

{
  "jsonrpc": "2.0",
  "id": 2,
  "method": "tools/call",
  "params": {
    "name": "remove-duplicate-lines",
    "arguments": {
  "text": "apple\nbanana\napple\nApple\n",
  "keep": "first",
  "caseSensitive": true,
  "trimWhitespace": false,
  "ignoreEmpty": false
}
  }
}

Chain multiple tools in one session with a comma-separated toolId list, e.g. /mcp/sse?toolId=png-to-webp,jpg-to-webp,gif-to-webp (max 20).

Questions or issues? Contact [email protected]

Browse tools Open tool