Data Analysis

A/B Test Significance Calculator

Compute conversion-rate or mean differences, 95%/99% confidence intervals, two-sided p-values (Z-test for proportions, Welch t for continuous metrics), lift, sample size for 80%/90% power, recommended experiment days, plus sequential-testing and Bonferroni multiple-comparison warnings.

html· HTML resultOpen tool

Quick start

Call this tool from your code in three languages.

cURL

curl -X POST 'https://api.elysiatools.com/en/api/tools/ab-test-significance-calculator' \
  -H 'Content-Type: application/json' \
  -d '{"testType":"proportion","cSuccess":1200,"cVisitors":20000,"tSuccess":1320,"tVisitors":20000,"cMean":42.5,"cSd":12,"cN":500,"tMean":45.8,"tSd":12.5,"tN":500,"alpha":"0.05","power":"0.8","baselineCr":6,"mdeLift":5,"dailyVisitors":4000,"split":"50","comparisons":1,"decimalPlaces":2}'

API reference

Send a POST request with your inputs as JSON. File parameters require a separate upload first.

Endpoint

HTTP

POST https://api.elysiatools.com/en/api/tools/ab-test-significance-calculator

Parameters

Name	Type	Required	Description
testType	select	No	—
cSuccess	number	No	—
cVisitors	number	No	—
tSuccess	number	No	—
tVisitors	number	No	—
cMean

MCP integration

Add this tool to your Model Context Protocol server so AI agents can list and call it.

Server configuration

Add this block to your MCP client configuration:

mcp.json

{
  "mcpServers": {
    "elysiatools-ab-test-significance-calculator": {
      "name": "ab-test-significance-calculator",
      "description": "Compute conversion-rate or mean differences, 95%/99% confidence intervals, two-sided p-values (Z-test for proportions, Welch t for continuous metrics), lift, sample size for 80%/90% power, recommended experiment days, plus sequential-testing and Bonferroni multiple-comparison warnings.",
      "baseUrl": "https://api.elysiatools.com/mcp/sse?toolId=ab-test-significance-calculator",
      "command": "",
      "args": [],
      "env": {},
      "isActive": true,
      "type": "sse"
    }
  }
}

List available tools

After connecting to the SSE endpoint, list the exposed tools:

tools/list

{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/list"
}

Call this tool

Invoke the tool by its id, passing arguments built from its parameters:

tools/call

{
  "jsonrpc": "2.0",
  "id": 2,
  "method": "tools/call",
  "params": {
    "name": "ab-test-significance-calculator",
    "arguments": {
  "testType": "proportion",
  "cSuccess": 1200,
  "cVisitors": 20000,
  "tSuccess": 1320,
  "tVisitors": 20000,
  "cMean": 42.5,
  "cSd": 12,
  "cN": 500,
  "tMean": 45.8,
  "tSd": 12.5,
  "tN": 500,
  "alpha": "0.05",
  "power": "0.8",
  "baselineCr": 6,
  "mdeLift": 5,
  "dailyVisitors": 4000,
  "split": "50",
  "comparisons": 1,
  "decimalPlaces": 2
}
  }
}

Browse tools Open tool