Bidi – What You See isn't What You Get
I stumbled across the problem of bidirectional text in terminals while trying to test a variant of the Unicode Bidirectional Algorithm. The Unicode consortium publishes a set of bidi…
Unicode
From the Unicode website: What began in 1988 as a standard for character encoding has grown into a powerful portfolio of open source standards, code, tools, libraries, and products that ensure global language support, interoperability, and resiliency across billions of devices.
⋮The⋮ ⋮Per⋮ils⋮ ⋮of⋮ ⋮Seg⋮ment⋮ing⋮ ⋮Text⋮
Text processing applications need to segment text into pieces. Segments may be word, sentences, paragraphs and so on. For western languages this is not too hard of a problem,…
