Validation

Robots.txt Lint Validator

Lint robots.txt syntax, flag risky rules, and test important URLs before you ship crawler directives

json· JSON resultOpen tool

Quick start

Call this tool from your code in three languages.

cURL

# 1) Request a presigned URL → returns { uploadUrl, storageKey }
curl -X POST 'https://api.elysiatools.com/api/upload/presign/robots-txt-lint-validator' \
  -H 'Content-Type: application/json' \
  -d '{"filename":"robotsFile.ext","contentType":"application/octet-stream","size":12345}'

# 2) PUT the file bytes directly to the presigned uploadUrl
curl -X PUT '<presigned uploadUrl>' \
  --data-binary @/path/to/file.ext

# 3) Call the tool, passing the returned storageKey for each file field
curl -X POST 'https://api.elysiatools.com/en/api/tools/robots-txt-lint-validator' \
  -F 'robotsText=User-agent: *
Disallow /admin
Allow: /admin/help' \
  -F 'robotsFile=uploads/2026/01/01/your-tool-1700000000000-abc123.ext' \
  -F 'siteOrigin=https://example.com' \
  -F 'testUrls=/admin
/admin/help
/blog'

API reference

Send a POST request with your inputs as JSON. File parameters require a separate upload first.

Endpoint

HTTP

POST https://api.elysiatools.com/en/api/tools/robots-txt-lint-validator

Parameters

Name	Type	Required	Description
robotsText	textarea	No	—
robotsFile	fileupload required	No	—
siteOrigin	text	Yes	—
testUrls	textarea	No	—

File-type parameters must be uploaded first via POST /upload/robots-txt-lint-validator, then the returned filePath is passed to the corresponding file field.

Response format

JSON result

JSON

{
  "key": {...},
  "metadata": {
    "key": "value"
  },
  "error": "Error message (optional)",
  "message": "Notification message (optional)"
}

MCP integration

Add this tool to your Model Context Protocol server so AI agents can list and call it.

Server configuration

Add this block to your MCP client configuration:

mcp.json

{
  "mcpServers": {
    "elysiatools-robots-txt-lint-validator": {
      "name": "robots-txt-lint-validator",
      "description": "Lint robots.txt syntax, flag risky rules, and test important URLs before you ship crawler directives",
      "baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=robots-txt-lint-validator",
      "command": "",
      "args": [],
      "env": {},
      "isActive": true,
      "type": "sse"
    }
  }
}

List available tools

After connecting to the SSE endpoint, list the exposed tools:

tools/list

{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/list"
}

Call this tool

Invoke the tool by its id, passing arguments built from its parameters:

tools/call

{
  "jsonrpc": "2.0",
  "id": 2,
  "method": "tools/call",
  "params": {
    "name": "robots-txt-lint-validator",
    "arguments": {
  "robotsText": "User-agent: *\nDisallow /admin\nAllow: /admin/help",
  "robotsFile": "https://example.com/file.ext",
  "siteOrigin": "https://example.com",
  "testUrls": "/admin\n/admin/help\n/blog"
}
  }
}

Chain multiple tools in one session with a comma-separated toolId list, e.g. /mcp/sse?toolId=png-to-webp,jpg-to-webp,gif-to-webp (max 20).

File parameters accept a public file URL only (https://…). Local paths, data: URIs, and Base64 strings are not supported.

Questions or issues? Contact [email protected]