# Text Pipeline Builder

Run a portable text-cleaning recipe and inspect every step, diff, timing, and character change.

> Canonical page: https://elysiatools.com/en/tools/text-pipeline-builder

- **Category:** Text Processing

- **Keywords:** text, pipeline, recipe, cleaning, replace, regex, diff, transform

## Overview

Paste text and a version 1 JSON recipe. The local deterministic engine supports trimming, whitespace cleanup, replacement, regex replacement, line filtering, sorting, deduplication, case conversion, and empty-line removal. The result includes normalized recipe JSON, final text, per-step statistics, and bounded line diffs.

## Inputs

- **Text Input** (textarea): Paste text to transform...
- **Recipe JSON** (textarea): {"version":1,"steps":\[{"op":"trim"}\]}

## When to use

- Clean leading and trailing spaces, inconsistent whitespace, and empty lines.
- Replace text with literal strings or regular expressions using repeatable rules.
- Sort, filter, deduplicate, or change the case of text lines while reviewing each step.

## How it works

- Paste the source content into the Text Input field.
- Enter a version 1 JSON recipe with the required transformation steps.
- The local deterministic engine applies the steps in order.
- Review the final text, normalized recipe, step statistics, timing, character changes, and bounded line diffs in the JSON result.

## Use cases

- Standardize pasted lists by trimming, normalizing whitespace, removing empty lines, and sorting entries.
- Clean imported text by replacing unwanted terms or patterns with literal or regular-expression rules.
- Create auditable text transformations with step-by-step diffs and character statistics.

## Frequently asked questions

### What input does the tool require?

It requires pasted text and a version 1 JSON recipe.

### Which text operations are supported?

Supported operations include trimming, whitespace cleanup, replacement, regex replacement, line filtering, sorting, deduplication, case conversion, and empty-line removal.

### Does the tool apply steps in sequence?

Yes. The recipe steps run in the order listed in the JSON recipe.

### What does the result contain?

The JSON result includes final text, a normalized recipe, per-step statistics, timing, character changes, and bounded line diffs.

### Is the transformation deterministic?

Yes. The tool uses a local deterministic engine to apply the recipe.

## Related tools

- [Bulk Email Extractor](https://elysiatools.com/en/tools/bulk-email-extractor): Extract all email addresses from input text, articles, web source code, or mixed content. Supports deduplication and export to JSON.
- [BOM Character Remover](https://elysiatools.com/en/tools/data-bom-remover): Remove BOM (Byte Order Mark) characters from text and file content. Perfect for cleaning up text files that have encoding issues, fixing CSV imports, and preparing data for processing. Features: - Detect and remove UTF-8 BOM (EF BB BF) - Detect and remove UTF-16 BOM (FE FF or FF FE) - Detect and remove UTF-32 BOM (00 00 FE FF or FF FE 00 00) - Support multiple input formats - Visual BOM character display - Detailed detection report - Support for batch text processing Common Use Cases: - Fix CSV file import errors - Clean up text file encoding issues - Prepare data for JSON parsing - Fix XML parsing problems - Resolve API data encoding conflicts - Standardize text data format
- [ECharts Theme Token Extractor](https://elysiatools.com/en/tools/echarts-theme-token-extractor): Extract design tokens — colors, numbers, font sizes and strings — from an ECharts theme JSON and export them straight into your design system. Paste a theme object (the kind registered via echarts.init(dom, themeName)) and the tool walks every leaf, tagging each color (with optional named/rgb → hex normalization), spacing number, font size and string, then emits clean CSS variables, a Tailwind theme.extend config, Style Dictionary tokens.json, or SCSS variables. Bridges the gap between an ECharts visualization theme and Figma/CSS/Tailwind design tokens without copying each value by hand.
- [Data Range Limiter](https://elysiatools.com/en/tools/data-range-limiter): Limit numerical values to specified ranges by clipping, filtering, or marking out-of-bounds values. Perfect for data quality control, sensor data cleaning, business rule enforcement, and data preprocessing. Features: - Range clipping (clip values to min/max boundaries) - Range filtering (remove out-of-bounds rows) - Range marking (flag modified values) - Per-column range configuration - Automatic numeric column detection - Multiple handling strategies - Detailed modification reports - Statistical analysis of changes - Business rule enforcement Common Use Cases: - Sensor data validation and cleaning - Machine learning input preparation - Data quality control and validation - Business constraint enforcement - Outlier management and control - Data preprocessing pipelines
- [Text Encoding Forensics and Repair](https://elysiatools.com/en/tools/text-encoding-forensics-and-repair): Inspect text encoding, BOM, newline style and mojibake symptoms, then produce a scored local repair candidate.
- [JSON Key Extractor](https://elysiatools.com/en/tools/json-key-extractor): Extract all keys from JSON objects with multiple output formats. Perfect for analyzing JSON structure, documentation generation, and understanding complex nested objects.
- [Line Number Remover](https://elysiatools.com/en/tools/line-number-remover): Remove line numbers from text or code with intelligent pattern recognition
- [Range Chart Generator](https://elysiatools.com/en/tools/range-chart-generator): Create range charts to visualize min-max value ranges with median markers and outlier detection

## Samples

- [Distributed Tracing Samples](https://elysiatools.com/en/samples/distributed-tracing-samples): Comprehensive distributed tracing examples using Jaeger, OpenTelemetry, and other modern observability tools for microservices architecture
- [JWT Samples](https://elysiatools.com/en/samples/jwt-samples): Comprehensive JWT examples from basic token structure to advanced security implementations
- [PDF Samples](https://elysiatools.com/en/samples/pdf-samples): Generated PDF samples from tools dated 2026-02-01 to 2026-02-10
- [WebRTC Real-Time Communication Samples](https://elysiatools.com/en/samples/webrtc-samples): Comprehensive WebRTC samples for peer-to-peer audio/video communication, data channels, screen sharing, and signaling server implementation

## Related content

- [Semi-Structured Text Parsing and Table Extraction](https://elysiatools.com/en/hubs/semi-structured-text-table-extraction): Parse fixed-width records, messy delimited text, logs, Markdown tables, and HTML tables into CSV, JSON, XML, or Excel with reviewable cleanup steps.
