Mailing-List: contact zsh-workers-help@zsh.org; run by ezmlm
Precedence: bulk
MIME-Version: 1.0
From: Sebastian Gniazdowski <sgniazdowski@gmail.com>
Date: Sun, 10 Jan 2016 09:18:38 +0100
Message-ID: <CAKc7PVD7N_xaeXSZHB1Q4kmzayjiPA5BNTwkDM5mQF-Zj9SmFg@mail.gmail.com>
Subject: zle -U "$selected" doesn't handle (some?) multibyte characters
To: Zsh hackers list <zsh-workers@zsh.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

I have a following code in which "$selected" resolves to "The\ Voice\
of\ Poland\ VI\ =E2=80=93\ Marta\ Moszczy=C5=84ska\ =E2=80=93\ =E2=80=9ESai=
l=E2=80=9D\ =E2=80=93\
Live-h9KgwUAlCjE.mkv":

if [ "$REPLY" -gt 0 ]; then
    selected=3D"$reply[REPLY]"
    echo "$selected" > /tmp/d
    # ZLE?
    if [ "${(t)CURSOR}" =3D "integer-local-special" ]; then
        zle redisplay
        zle kill-whole-line
        zle -U "$selected"
    else
        print -zr "$selected"
    fi
else
    [ "${(t)CURSOR}" =3D "integer-local-special" ] && zle redisplay
fi

So two paths, one for the script being run from Zle, and other one
when run as function. The function path works, string is not
disrupted. The "echo" also outputs non-disrupted string. However, zle
-U "$selected" outputs: "The\ Voice\ of\ Poland\ VI\ =E2=80=83\ Marta\
Moszczy=C5=83ska\ =E2=80=83\ =E2=80=83Sail=E2=80=83\ =E2=80=83\ Live-h9KgwU=
AlCjE.mkv"

The quotation marks are missing. The letter "=C5=84" is also disrupted and
outputted as "=C5=83"

Best regards,
Sebastian Gniazdowski