html5_testing.html
11 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
<?xml version="1.0"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<style type="text/css" media="all">
@import "/QA/2006/01/blogstyle.css";
</style>
<meta name="keywords" content='html html5' />
<meta name="description" content="We need all the help we can get to make the test suite relevant and informative. Unless the community starts helping W3C, we won't be able to properly test HTML5." />
<meta name="revision" content="$Id: html5_testing.html,v 1.23 2011/08/12 14:36:21 mirror Exp $" />
<link rel="alternate" type="application/atom+xml" title="Atom" href="http://www.w3.org/QA/atom.xml" />
<link rel="alternate" type="application/rss+xml" title="RSS 1.0" href="http://www.w3.org/QA/news.rss" />
<title>HTML5 Testing - W3C Blog</title>
<link rel="start" href="http://www.w3.org/QA/" title="Home" />
<link rel="prev" href="http://www.w3.org/QA/2010/10/w3c_technical_plenary_to_html5.html" title="W3C Technical Plenary: To HTML5 and beyond!" />
<link rel="next" href="http://www.w3.org/QA/2010/11/a_toucan_describedby_data.html" title="A toucan describedby data" />
<!--
<rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
xmlns:trackback="http://madskills.com/public/xml/rss/module/trackback/"
xmlns:dc="http://purl.org/dc/elements/1.1/">
<rdf:Description
rdf:about="http://www.w3.org/QA/2010/11/html5_testing.html"
trackback:ping="http://www.w3.org/QA/sununga/mt-tb.cgi/362"
dc:title="HTML5 Testing"
dc:identifier="http://www.w3.org/QA/2010/11/html5_testing.html"
dc:subject="HTML"
dc:description="We need all the help we can get to make the test suite relevant and informative. Unless the community starts helping W3C, we won't be able to properly test HTML5."
dc:creator="Philippe Le Hégaret"
dc:date="2010-11-04T08:24:22+00:00" />
</rdf:RDF>
-->
<!-- <script type="text/javascript" src="http://www.w3.org/QA/mt.js"></script>-->
</head>
<body class="layout-one-column">
<div id="banner">
<h1 id="title">
<a href="http://www.w3.org/"><img height="48" alt="W3C" id="logo" src="http://www.w3.org/Icons/WWW/w3c_home_nb" /></a>
W3C Blog
</h1>
</div>
<ul class="navbar" id="menu">
<li><strong><a href="/QA/" title="W3C Blog Home">[ W3C Blog ]</a></strong></li>
<li><a href="/QA/Library/" title="Documents and Publications on Web and Quality">Documents</a></li>
<li><a href="/QA/Tools/" accesskey="3" title="Validators and other Tools">Tools</a></li>
<li><a href="/2007/12/qa-blog-help/index#feedback">Feedback</a></li>
</ul>
<div id="searchbox">
<form method="get" action="http://www.google.com/custom" enctype="application/x-www-form-urlencoded">
<p id="formbox"><input type="text" size="15" class="textfield" name="q" accesskey="E" maxlength="255" /> <input type="submit" class="submitfield" value="Search" id="goButton" name="sa" accesskey="G" /> <input type="hidden" name="cof" value="T:black;LW:72;ALC:#ff3300;L:http://www.w3.org/Icons/w3c_home;LC:#000099;LH:48;BGC:white;AH:left;VLC:#660066;GL:0;AWFID:0b9847e42caf283e;" /><input type="hidden" id="searchW3C" name="sitesearch" checked="checked" value="www.w3.org/QA" /><input type="hidden" name="domains" value="www.w3.org/QA" /></p>
</form>
</div>
<div id="main"><!-- This DIV encapsulates everything in this page - necessary for the positioning -->
<p class="content-nav">
<a href="http://www.w3.org/QA/2010/10/w3c_technical_plenary_to_html5.html">« W3C Technical Plenary: To HTML5 and beyond!</a> |
<a href="http://www.w3.org/QA/">Main</a>
| <a href="http://www.w3.org/QA/2010/11/a_toucan_describedby_data.html">A toucan describedby data »</a>
</p>
<h2 class="entry-header">HTML5 Testing</h2>
<div class="entry-body">
<p>
One month ago, I wrote an article about our recent <a href='http://www.w3.org/QA/2010/09/how_do_we_test_a_web_browser_o.html'>progress on testing</a>. Among several items, I mentioned <cite>"The HTML test suite only contains 97 approved tests for the moment so don't draw too many conclusion from the result table. The number of tests needs to increase significantly if we want to test HTML5 properly"</cite>. 135 tests later, it seems that people are trying to draw conclusions from the tests or from the results, including whether one browser or another is better.
</p>
<p>
An increase of 135 tests isn't meaningful. It's way far from making the results significant in fact. We'll need several dozens of thousands of tests to make those results indicative. Still, while working on the HTML5 specification, there is an advantage to figure out where we have interoperability issues already.
</p>
<p>
Sure enough, the test report page was misleading but like other items, that's work in progress. We'd like people who care about HTML5 interoperability to come and help us make it better. We simply fixed the page once we received input on it. Feel free to see the discussion on <a href='http://lists.w3.org/Archives/Public/public-html-testsuite/latest'>public-html-testsuite</a> if you're wondering what's happening. You'll even see in the minutes of the calls who has been participating and who has not.
</p>
<p>
The report is still bogus by the way and the percentages are incorrect. I might get to fix that once I'm done with <a href='http://www.w3.org/QA/2010/10/w3c_technical_plenary_to_html5.html'>TPAC 2010</a> but I'm hoping someone else will be faster than me.
</p>
<p>
Since I've got your attention, let me repeat it again:
</p>
<p>
We need all the help we can get to make the test suite relevant and informative. Unless the community starts helping W3C, we won't be able to properly test HTML5.
</p>
<p>
<strong>
The Web browsers of tomorrow are being developed and tested today, so don't wait and help us make the Web a better place!
</strong>
</p>
</div>
<div id="more" class="entry-more">
</div>
<p class="postinfo">Filed by <a href="http://www.w3.org/People/LeHegaret/">Philippe Le Hégaret</a> on November 4, 2010 8:24 AM in <a href="http://www.w3.org/QA/archive/technology/html/">HTML</a><br />
<span class="separator">|</span> <a class="permalink" href="http://www.w3.org/QA/2010/11/html5_testing.html">Permalink</a>
| <a href="http://www.w3.org/QA/2010/11/html5_testing.html#comments">Comments (2)</a>
| <a href="http://www.w3.org/QA/2010/11/html5_testing.html#trackback">TrackBacks (0)</a>
</p>
<h3 class="comments-header" id="comments">Comments</h3>
<div class="comment" id="comment-206629">
<p class="comment-meta" id="c206629">
<span class="comment-meta-author"><strong>Julien </strong></span>
<span class="comment-meta-date"><a href="#c206629">#</a> 2010-11-15</span>
</p>
<div class="comment-bulk">
<p>Thank you for this reminder, I totally understand that the testing period may take a bit longer...</p>
<p>Keep up the good work guys !</p>
<p>Julien, CEO of TDM</p>
</div>
</div>
<div class="comment" id="comment-211366">
<p class="comment-meta" id="c211366">
<span class="comment-meta-author"><strong>dave sinclair </strong></span>
<span class="comment-meta-date"><a href="#c211366">#</a> 2011-01-22</span>
</p>
<div class="comment-bulk">
<p>Does a person have to be very knowledgeable about making web sites to participate in testing?</p>
</div>
</div>
<div class="comments-open" id="comments-open">
<h3 class="comments-open-header">Leave a comment</h3>
<div class="comments-open-moderated">
<p>
Note: this blog is intended to foster <strong>polite
on-topic discussions</strong>. Comments failing these
requirements and spam will not get published. Please,
enter your real name and email address. Every
individual comment is reviewed by the W3C staff.
This may take some time, thank you for your patience.
</p>
<p>
You can use the following HTML markup (a href, b, i,
br/, p, strong, em, ul, ol, li, blockquote, pre)
and/or <a href="http://daringfireball.net/projects/markdown/syntax">Markdown syntax</a>.</p>
</div>
<div id="comments-open-data">
<form method="post" action="http://www.w3.org/QA/sununga/beach.pl" id="comments-form">
<h4>Your comment</h4>
<div id="comments-open-text">
<textarea id="comment-text" name="text" rows="20" cols="100"></textarea><br />
<label for="comment-text">Write your comment text here. Remember, keep the discussion on topic and courteous.</label>
</div>
<h4>About you</h4>
<div id="comment-form-name">
<input type="hidden" name="static" value="1" />
<input type="hidden" name="entry_id" value="8951" />
<input type="hidden" name="__lang" value="en" />
<label for="comment-author">Your Name</label>
<input id="comment-author" name="author" size="30" value="" />
</div>
<div id="comment-form-email">
<label for="comment-email">Your Email Address</label>
<input id="comment-email" name="email" size="30" value="" />
</div>
<div id="comments-open-footer">
<input type="submit" accesskey="s" name="post" id="comment-submit" value="Submit" />
</div>
</form>
</div>
</div>
<p id="gentime">This page was last generated on $Date: 2011/08/12 14:36:21 $</p>
</div><!-- End of "main" DIV. -->
<address>
This blog is written by W3C staff and working group participants,<br />
and maintained by <a href="/People/CMercier/">Coralie Mercier</a>.<br />
Authorized parties may <a href="/QA/new">log in</a> to create a new entry.<br/>
<span id="poweredby">Powered by Movable Type, magpierss and a lot of Web Technology</span>
</address>
<p class="copyright">
<a rel="Copyright" href="http://www.w3.org/Consortium/Legal/ipr-notice#Copyright">Copyright</a> © 1994-2011
<a href="http://www.w3.org/"><acronym title="World Wide Web Consortium">W3C</acronym></a>®
(<a href="http://www.csail.mit.edu/"><acronym title="Massachusetts Institute of Technology">MIT</acronym></a>,
<a href="http://www.ercim.eu/"><acronym title="European Research Consortium for Informatics and Mathematics">ERCIM</acronym></a>,
<a href="http://www.keio.ac.jp/">Keio</a>),
All Rights Reserved.
W3C <a href="http://www.w3.org/Consortium/Legal/ipr-notice#Legal_Disclaimer">liability</a>,
<a href="http://www.w3.org/Consortium/Legal/ipr-notice#W3C_Trademarks">trademark</a>,
<a rel="Copyright" href="http://www.w3.org/Consortium/Legal/copyright-documents">document use</a>
and <a rel="Copyright" href="http://www.w3.org/Consortium/Legal/copyright-software">software licensing</a>
rules apply. Your interactions with this site are in accordance
with our <a href="http://www.w3.org/Consortium/Legal/privacy-statement#Public">public</a> and
<a href="http://www.w3.org/Consortium/Legal/privacy-statement#Members">Member</a> privacy
statements.
</p>
</body>
</html>