Data Analysis
A/B Test Significance Calculator
Compute conversion-rate or mean differences, 95%/99% confidence intervals, two-sided p-values (Z-test for proportions, Welch t for continuous metrics), lift, sample size for 80%/90% power, recommended experiment days, plus sequential-testing and Bonferroni multiple-comparison warnings.
html· HTML resultOpen tool
Quick start
Call this tool from your code in three languages.
cURL
curl -X POST 'https://api.elysiatools.com/en/api/tools/ab-test-significance-calculator' \
-H 'Content-Type: application/json' \
-d '{"testType":"proportion","cSuccess":1200,"cVisitors":20000,"tSuccess":1320,"tVisitors":20000,"cMean":42.5,"cSd":12,"cN":500,"tMean":45.8,"tSd":12.5,"tN":500,"alpha":"0.05","power":"0.8","baselineCr":6,"mdeLift":5,"dailyVisitors":4000,"split":"50","comparisons":1,"decimalPlaces":2}'API reference
Send a POST request with your inputs as JSON. File parameters require a separate upload first.
Endpoint
HTTP
POST https://api.elysiatools.com/en/api/tools/ab-test-significance-calculatorParameters
| Name | Type | Required | Description |
|---|---|---|---|
| testType | select | No | — |
| cSuccess | number | No | — |
| cVisitors | number | No | — |
| tSuccess | number | No | — |
| tVisitors | number | No | — |
| cMean |
MCP integration
Add this tool to your Model Context Protocol server so AI agents can list and call it.
Server configuration
Add this block to your MCP client configuration:
mcp.json
{
"mcpServers": {
"elysiatools-ab-test-significance-calculator": {
"name": "ab-test-significance-calculator",
"description": "Compute conversion-rate or mean differences, 95%/99% confidence intervals, two-sided p-values (Z-test for proportions, Welch t for continuous metrics), lift, sample size for 80%/90% power, recommended experiment days, plus sequential-testing and Bonferroni multiple-comparison warnings.",
"baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=ab-test-significance-calculator",
"command": "",
"args": [],
"env": {},
"isActive": true,
"type": "sse"
}
}
}List available tools
After connecting to the SSE endpoint, list the exposed tools:
tools/list
{
"jsonrpc": "2.0",
"id": 1,
"method": "tools/list"
}Call this tool
Invoke the tool by its id, passing arguments built from its parameters:
tools/call
{
"jsonrpc": "2.0",
"id": 2,
"method": "tools/call",
"params": {
"name": "ab-test-significance-calculator",
"arguments": {
"testType": "proportion",
"cSuccess": 1200,
"cVisitors": 20000,
"tSuccess": 1320,
"tVisitors": 20000,
"cMean": 42.5,
"cSd": 12,
"cN": 500,
"tMean": 45.8,
"tSd": 12.5,
"tN": 500,
"alpha": "0.05",
"power": "0.8",
"baselineCr": 6,
"mdeLift": 5,
"dailyVisitors": 4000,
"split": "50",
"comparisons": 1,
"decimalPlaces": 2
}
}
}