Categories

Bulk URL/Link Extractor

Extract all HTTP/HTTPS links from text with deduplication and export options

Key Facts

Category
Text Processing
Input Types
textarea, checkbox
Output Type
json
Sample Coverage
4
API Ready
Yes

Overview

The Bulk URL/Link Extractor is a text processing tool that scans input text to find and extract all HTTP and HTTPS links. It supports deduplication to remove repeated URLs, sorting for organized output, and provides statistics on the extracted links.

When to Use

  • When you have a large block of text containing multiple URLs and need to list them all.
  • To clean up and organize URLs by removing duplicates and sorting them alphabetically.
  • For analyzing web content or logs to extract and count all embedded links.

How It Works

  • Paste or input your text into the provided textarea.
  • Configure options such as removing duplicates, sorting results, and including statistics.
  • The tool processes the text, extracts all HTTP/HTTPS links, and outputs them in JSON format.

Use Cases

Extracting URLs from email bodies or message threads for quick reference.
Analyzing website content or sitemaps to gather all outgoing links.
Processing log files to identify and catalog all accessed URLs.

Examples

1. Extracting Links from a Blog Post

Background
A content manager needs to list all external links in a blog post for SEO audit.
Problem
Manually copying URLs from a long article is time-consuming and error-prone.
How to Use
Paste the blog post text into the input field, enable 'Remove Duplicates' and 'Sort Results', then extract.
Outcome
A clean, sorted list of all unique HTTP/HTTPS links from the post, ready for analysis.

2. Analyzing Web Server Logs

Web Administrator
Background
The admin has server logs with numerous URL entries and wants to extract all unique links.
Problem
Logs contain mixed data, making it hard to isolate URLs manually.
How to Use
Input the log text, configure to remove duplicates and include statistics, then run the extraction.
Example Config
Enable 'Remove Duplicates' and 'Include Statistics' options.
Outcome
JSON output with all unique URLs and counts, helping in traffic analysis.

Try with Samples

video, text

Related Hubs

FAQ

What types of links does this tool extract?

It extracts all HTTP and HTTPS links from the input text.

Can I extract links from a file?

Currently, the tool only accepts text input directly; you can paste text from files.

What does the 'Include Statistics' option do?

It adds details like the total number of links found and unique links after deduplication.

Is there a limit to the amount of text I can input?

The tool handles standard text inputs, but very large texts may affect performance.

How are the results formatted?

Results are provided in JSON format, listing the extracted URLs and optional statistics.

API Documentation

Request Endpoint

POST /en/api/tools/bulk-url-extractor

Request Parameters

Parameter Name Type Required Description
textInput textarea Yes -
removeDuplicates checkbox No -
sortResults checkbox No -
includeStats checkbox No -

Response Format

{
  "key": {...},
  "metadata": {
    "key": "value"
  },
  "error": "Error message (optional)",
  "message": "Notification message (optional)"
}
JSON Data: JSON Data

AI MCP Documentation

Add this tool to your MCP server configuration:

{
  "mcpServers": {
    "elysiatools-bulk-url-extractor": {
      "name": "bulk-url-extractor",
      "description": "Extract all HTTP/HTTPS links from text with deduplication and export options",
      "baseUrl": "https://elysiatools.com/mcp/sse?toolId=bulk-url-extractor",
      "command": "",
      "args": [],
      "env": {},
      "isActive": true,
      "type": "sse"
    }
  }
}

You can chain multiple tools, e.g.: `https://elysiatools.com/mcp/sse?toolId=png-to-webp,jpg-to-webp,gif-to-webp`, max 20 tools.

If you encounter any issues, please contact us at [email protected]