Validation
Lint robots.txt syntax, flag risky rules, and test important URLs before you ship crawler directives
Call this tool from your code in three languages.
# 1) Upload each file first → returns { filePath }
curl -X POST 'https://api.elysiatools.com/upload/robots-txt-lint-validator' \
-F 'file=@/path/to/robotsFile.ext'
# 2) Call the tool with the returned filePath values
curl -X POST 'https://api.elysiatools.com/en/api/tools/robots-txt-lint-validator' \
-F 'robotsText=User-agent: *
Disallow /admin
Allow: /admin/help' \
-F 'robotsFile=/path/to/file.ext' \
-F 'siteOrigin=https://example.com' \
-F 'testUrls=/admin
/admin/help
/blog'Send a POST request with your inputs as JSON. File parameters require a separate upload first.
POST https://api.elysiatools.com/en/api/tools/robots-txt-lint-validator| Name | Type | Required | Description |
|---|---|---|---|
| robotsText | textarea | No | — |
| robotsFile | fileupload required | No | — |
| siteOrigin | text | Yes | — |
| testUrls | textarea | No | — |
Add this tool to your Model Context Protocol server so AI agents can list and call it.
Add this block to your MCP client configuration:
{
"mcpServers": {
"elysiatools-robots-txt-lint-validator": {
"name": "robots-txt-lint-validator",
"description": "Lint robots.txt syntax, flag risky rules, and test important URLs before you ship crawler directives",
"baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=robots-txt-lint-validator",
"command": "",
"args": [],
"env": {},
"isActive": true,
"type": "sse"
}
}
}After connecting to the SSE endpoint, list the exposed tools:
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/list"
}Invoke the tool by its id, passing arguments built from its parameters:
{
"jsonrpc": "2.0",
"id": 2,
"method": "tools/call",
"params": {
"name": "robots-txt-lint-validator",
"arguments": {
"robotsText": "User-agent: *\nDisallow /admin\nAllow: /admin/help",
"robotsFile": "https://example.com/file.ext",
"siteOrigin": "https://example.com",
"testUrls": "/admin\n/admin/help\n/blog"
}
}
}JSON result
{
"key": {...},
"metadata": {
"key": "value"
},
"error": "Error message (optional)",
"message": "Notification message (optional)"
}Questions or issues? Contact [email protected]