Item2311: WysiwygPlugin not compatible with word-break character

pencil
Priority: Normal
Current State: Closed
Released In: 1.1.0
Target Release: minor
Applies To: Extension
Component: WysiwygPlugin
Branches:
Reported By: MichaelTempest
Waiting For:
Last Change By: KennethLavrsen
A​B
does not survive a roundtrip through WysiwygPlugin.

If I open a topic in TMCE, click WikiText, paste in the above text, click WYSIWYG, and click WikiText again, the text is converted to
A\x{200b}B

If I put that in a sticky block, like this:
<sticky>A&#8203;B</sticky>
into the WikiText editor, I get this when I click WYSIWYG and then click WikiText again:
Foswiki detected an internal error - please check your Foswiki logs and webserver logs for more information.

Wide character in subroutine entry

This was in the apache log:
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] [Fri Oct 30 16:16:27 2009] rest: Wide character in print at /home/config/wiki/foswiki/lib/Foswiki/UI.pm line 347., referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] Wide character in subroutine entry at /usr/lib/perl/5.8/Encode.pm line 166., referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1]  at /usr/lib/perl/5.8/Encode.pm line 166, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tEncode::decode('iso-8859-1', 'A\xe2\x80\x8bB, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] ', 264) called at /home/config/wiki/foswiki/lib/Foswiki/Plugins/WysiwygPlugin.pm line 778, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::Plugins::WysiwygPlugin::returnRESTResult('Foswiki::Response=HASH(0x855efc0)', 200, 'A\xe2\x80\x8bB, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] ') called at /home/config/wiki/foswiki/lib/Foswiki/Plugins/WysiwygPlugin.pm line 879, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::Plugins::WysiwygPlugin::_restHTML2TML('Foswiki=HASH(0x8153648)', 'WysiwygPlugin', 'html2tml', 'Foswiki::Response=HASH(0x855efc0)') called at /home/config/wiki/foswiki/lib/Foswiki/Func.pm line 2222, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::Func::__ANON__('Foswiki=HASH(0x8153648)', 'WysiwygPlugin', 'html2tml', 'Foswiki::Response=HASH(0x855efc0)') called at /home/config/wiki/foswiki/lib/Foswiki/UI/Rest.pm line 187, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::UI::Rest::rest('Foswiki=HASH(0x8153648)') called at /home/config/wiki/foswiki/lib/Foswiki/UI.pm line 299, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::UI::__ANON__() called at /usr/share/perl5/Error.pm line 380, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \teval {...} called at /usr/share/perl5/Error.pm line 372, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tError::subs::try('CODE(0x82f8d5c)', 'HASH(0x8c0aa64)') called at /home/config/wiki/foswiki/lib/Foswiki/UI.pm line 381, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::UI::_execute('Foswiki::Request=HASH(0x8531410)', 'CODE(0x8531368)', 'rest', 1) called at /home/config/wiki/foswiki/lib/Foswiki/UI.pm line 270, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::UI::handleRequest('Foswiki::Request=HASH(0x8531410)') called at /home/config/wiki/foswiki/lib/Foswiki/Engine/CGI.pm line 26, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] \tFoswiki::Engine::CGI::run('Foswiki::Engine::CGI=HASH(0x83ec5bc)') called, referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821
[Fri Oct 30 16:16:27 2009] [error] [client 172.16.225.1] [Fri Oct 30 16:16:27 2009] rest: Wide character in print at /home/config/wiki/foswiki/lib/Foswiki/Logger/PlainFile.pm line 63., referer: http://172.16.225.134/foswiki/bin/edit/Sandbox/TestTopicAUTOINC0?t=160821

-- MichaelTempest - 30 Oct 2009
Bummer, Unicode issue. Trying to decode a string that already contains a wide-byte character. Add it to the pile of UTF8/Unicode issues.

-- CrawfordCurrie - 30 Oct 2009

Note that it breaks horribly on conversion from HTML back to TML. WysiwygPlugin correctly converts
<sticky>&#8203;</sticky>
to
<div class="WYSIWYG_STICKY">&amp;#8203;</div>

-- MichaelTempest - 30 Oct 2009

Fixed on trunk.

-- MichaelTempest - 20 Jun 2010

ItemTemplate edit

Summary WysiwygPlugin not compatible with word-break character
ReportedBy MichaelTempest
Codebase 1.0.7
SVN Range Foswiki-1.0.7, Sun, 20 Sep 2009, build 5061
AppliesTo Extension
Component WysiwygPlugin
Priority Normal
CurrentState Closed
WaitingFor
Checkins distro:a820f29b54a4
TargetRelease minor
ReleasedIn 1.1.0
Topic revision: r5 - 04 Oct 2010, KennethLavrsen
The copyright of the content on this website is held by the contributing authors, except where stated elsewhere. See Copyright Statement. Creative Commons License    Legal Imprint    Privacy Policy