[ tidy-Bugs-1266647 ] Runaway memory usage when parsing malformed comment

Bugs item #1266647, was opened at 2005-08-23 01:06
Message generated for change (Comment added) made by hoehrmann
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=390963&aid=1266647&group_id=27659

Please note that this message will contain a full copy of the comment thread,
including the initial issue submission, for this request,
not just the latest update.
Category: HTML/XML/XHTML Parser
Group: Current - all platforms
>Status: Pending
>Resolution: Fixed
Priority: 7
Submitted By: Paul Battley (pbattley)
>Assigned to: Björn Höhrmann (hoehrmann)
Summary: Runaway memory usage when parsing malformed comment

Initial Comment:
When a document containing the following sequence of
octets is parsed as UTF-8 input, tidy exhibits runaway
memory usage.

3c 21 2d 2d 2d 2d e3 80  90 2d 2d 2d 2d 3e 0a

NB: This is valid UTF-8.

Some variations on this string, with more or fewer
leading hyphens, also produce the same problem.

Symptoms occur on both OS X/PPC and Linux/x86. 
Symptoms occur both when using the console utility and
when using libtidy via Ruby bindings.

The problem can be reproduced with a version of tidy
built from the 2005-08-17 tarball using the attached
HTML file with the following command:

tidy -utf8 dirty.html

----------------------------------------------------------------------

>Comment By: Björn Höhrmann (hoehrmann)
Date: 2005-08-23 01:39

Message:
Logged In: YES 
user_id=188003

Fixed in CVS, see the tidy-cvs mailing list for the patch 
(the public cvs repository requires some time to update.)

----------------------------------------------------------------------

Comment By: Björn Höhrmann (hoehrmann)
Date: 2005-08-23 01:28

Message:
Logged In: YES 
user_id=188003

This is caused by corrupting the UTF-8 sequence in the 
lexbuf in the comment parsing code.

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=390963&aid=1266647&group_id=27659


-------------------------------------------------------
SF.Net email is Sponsored by the Better Software Conference & EXPO
September 19-22, 2005 * San Francisco, CA * Development Lifecycle Practices
Agile & Plan-Driven Development * Managing Projects & Teams * Testing & QA
Security * Process Improvement & Measurement * http://www.sqe.com/bsce5sf