3 commits

Author	SHA1	Message	Date
Max Wipfli	2404ad6897	LibWeb: Fix assertion failure when tokenizing JS regex literals ... This fixes parsing the following regular expression: /</g; It also adds a simple script element to the HTMLTokenizer regression test, which also contains that specific regex.	2021-07-15 01:47:22 +02:00
Max Wipfli	a9a54914bf	Tests: Add comments to the HTMLTokenizer regression test file	2021-07-15 00:48:45 +02:00
Max Wipfli	5a44a0b9f4	Tests: Add a basic test suite for HTMLTokenizer ... The test suite includes a few basic tests and a very crude regression test, which just concatenates the to_string() of all tokens and checks the String's hash to be equal. This relies on the format of HTMLToken::to_string() to stay the same, which is not ideal.	2021-07-14 23:03:36 +02:00