Re: UTF-8 support

The separators can be longer than one character, yes.

I don't have a problem with replacing them with 0xFE or 0xFF sequences
in PmWiki, but keep in mind that 0xFE and 0xFF are used in the iso-8859-1
set.  We'd also have to provide a migration path for existing PmWiki
files that are still using the old \262 character.  $KeepToken and $LinkToken
are never stored in files as tokens--they're only used as internal markers
when processing the wiki markup.

Any other comments from people out there?  Would changing the separators
cause a huge problem for anyone?

Pm


On Mon, Jun 30, 2003 at 11:04:34PM +0300, Serge Semashko wrote:
> Hello All,
> 
> Is it possible to make UTF-8 support in PmWiki?
> 
> I can change "charset=iso-8859-1" to "charset=UTF-8", but the
> following separators create problems when using russian language:
> 
> $Newline = "\262";
> $KeepToken = "\263";
> $LinkToken = "\264";
> 
> The third language of russian alphabet in UTF-8 conflicts with one of
> them. Can these separators be longer than 1 letter, and can they be
> replaced with UTF-8 friendly ones?
> 
> The bytes 0xFE and 0xFF are never used in the UTF-8 encoding.
> 
> 
> _______________________________________________
> Pmwiki-users mailing list
> Pmwiki-users@xxxxxxxxxxxx
> http://pmichaud.com/mailman/listinfo/pmwiki-users_pmichaud.com
>