ladybird/Tests/LibWeb/tokenizer-test.html

<!DOCTYPE html>
<html lang="en">
<head>
    <meta charset="UTF-8">
    <title>This is a test page :^)</title>
    <script>
        let foo = 2;
        var bar = 3;
        if (foo < bar)
            alert("Check happens with HTML special <characters>.");
        let regex = /</g;
    </script>
</head>
<body>
    <p>This is the first paragraph.</p>
    <p foo="bar">The second paragraph has an attribute!</p>
    <!-- This is a standard HTML comment. -->
    <!----- This comment has a few too many dashes. ----->
    <!----> <!-- <= There is an empty comment over there. -->
</body>
</html>
Tests: Add a basic test suite for HTMLTokenizer The test suite includes a few basic tests and a very crude regression test, which just concatenates the to_string() of all tokens and checks the String's hash to be equal. This relies on the format of HTMLToken::to_string() to stay the same, which is not ideal. 2021-07-12 13:12:47 +00:00			`<!DOCTYPE html>`
			`<html lang="en">`
			`<head>`
			`<meta charset="UTF-8">`
			`<title>This is a test page :^)</title>`
LibWeb: Fix assertion failure when tokenizing JS regex literals This fixes parsing the following regular expression: /</g; It also adds a simple script element to the HTMLTokenizer regression test, which also contains that specific regex. 2021-07-14 23:25:34 +00:00			`<script>`
			`let foo = 2;`
			`var bar = 3;`
			`if (foo < bar)`
			`alert("Check happens with HTML special <characters>.");`
			`let regex = /</g;`
			`</script>`
Tests: Add a basic test suite for HTMLTokenizer The test suite includes a few basic tests and a very crude regression test, which just concatenates the to_string() of all tokens and checks the String's hash to be equal. This relies on the format of HTMLToken::to_string() to stay the same, which is not ideal. 2021-07-12 13:12:47 +00:00			`</head>`
			`<body>`
			`<p>This is the first paragraph.</p>`
			`<p foo="bar">The second paragraph has an attribute!</p>`
Tests: Add comments to the HTMLTokenizer regression test file 2021-07-14 22:43:18 +00:00			`<!-- This is a standard HTML comment. -->`
			`<!----- This comment has a few too many dashes. ----->`
			`<!----> <!-- <= There is an empty comment over there. -->`
Tests: Add a basic test suite for HTMLTokenizer The test suite includes a few basic tests and a very crude regression test, which just concatenates the to_string() of all tokens and checks the String's hash to be equal. This relies on the format of HTMLToken::to_string() to stay the same, which is not ideal. 2021-07-12 13:12:47 +00:00			`</body>`
			`</html>`