Detect and Remove Soft Hyphens (SHY)

Soft Hyphens: The Conditional Break

A soft hyphen (SHY, U+00AD) is an invisible character that marks a position where a word may be hyphenated if it needs to break across lines. Unlike a regular hyphen (-), a soft hyphen is only visible when the word actually wraps at that point; otherwise, it is completely invisible.

Where Soft Hyphens Come From

• Word processors: Microsoft Word, LibreOffice, and Pages insert soft hyphens when you use their hyphenation features.
• Web content: The HTML entity ­ renders as U+00AD in the DOM. When you copy text from a web page, these become actual SHY characters.
• PDF extraction: Text extracted from professionally typeset PDFs often contains soft hyphens at word-break points.
• CMS output: Content management systems may auto-hyphenate long words with soft hyphens.

How the Visualizer Shows SHY

Each soft hyphen appears as a purple [SHY] marker in the visualization. This makes them easy to spot in the output.

Problems Caused by Soft Hyphens

# Search doesn't match:
"inter\u00ADnational" !== "international"

# URL is broken:
https://example.com/inter\u00ADnational-guide

# Variable name is invalid:
const inter\u00ADval = 1000;  // syntax error in most languages

Soft hyphens are particularly insidious because they only become visible when text wraps, so the same text might look different at different window widths.

Detection and Removal

1. Paste your text into the Whitespace Visualizer.
2. Enable the SHY toggle to see [SHY] markers where soft hyphens exist.
3. Check the statistics panel for the count.
4. In the Clean section, enable SHY and click Clean to remove all soft hyphens.
5. Verify the output — the words should now be continuous without any hidden break points.

Soft hyphens are almost always safe to remove unless you specifically need them for typographic layout in HTML (where CSS hyphens property is the modern alternative).