|
0
|
1 <?xml version="1.0" encoding="utf-8"?>
|
|
|
2 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
|
|
|
3 "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
|
|
|
4 <html lang="en-GB" xml:lang="en-GB" xmlns="http://www.w3.org/1999/xhtml">
|
|
|
5 <head>
|
|
|
6 <title>DAWG: Implementation Reporting - EARL results</title>
|
|
|
7 <link rel="stylesheet" type="text/css" href="http://www.w3.org/StyleSheets/TR/base.css" />
|
|
|
8
|
|
|
9 <style type="text/css">
|
|
|
10
|
|
|
11 pre.diag { background-color: #f0f0f0 ; padding: 0.5em ; border: 1px solid black ; margin-right: 4em ; }
|
|
|
12 span.code { font-family: monospace;}
|
|
|
13 pre.cvs-id {color: gray}
|
|
|
14
|
|
|
15 #tableResult td, th { padding-left:0.5em; padding-right: 0.5em; padding-top:0.2ex ; padding-bottom:0.2ex ;}
|
|
|
16
|
|
|
17 </style>
|
|
|
18 <meta name="RCS-Id" content="$Id: earl.html,v 1.3 2007/08/12 17:54:28 lfeigenb Exp $" />
|
|
|
19 </head>
|
|
|
20 <body>
|
|
|
21 <div class="head">
|
|
|
22 <a href="http://www.w3.org/"><img height="48" width="72" alt="W3C" src="
|
|
|
23 http://www.w3.org/Icons/w3c_home" /></a>
|
|
|
24 <h1 id="main">DAWG: Implementation Reporting - EARL results</h1>
|
|
|
25 <dl>
|
|
|
26 <dd> </dd>
|
|
|
27 <dt>Document Editor</dt>
|
|
|
28 <dd><a href="mailto:feigenbl@us.ibm.com">Lee Feigenbaum</a> –
|
|
|
29 invited expert</dd>
|
|
|
30 <dt>Version:</dt>
|
|
|
31 <dd><code>$Revision: 1.3 $</code></dd>
|
|
|
32 </dl>
|
|
|
33
|
|
|
34 <p class="copyright"><a href="
|
|
|
35 http://www.w3.org/Consortium/Legal/ipr-notice#Copyright">Copyright</a> ©
|
|
|
36 2004 <a href="http://www.w3.org/"><acronym title="
|
|
|
37 World Wide Web Consortium">W3C</acronym></a><sup>®</sup> ( <a href="
|
|
|
38 http://www.csail.mit.edu/"><acronym title="
|
|
|
39 Massachusetts Institute of Technology">MIT</acronym></a>, <a href="
|
|
|
40 http://www.ercim.org/"><acronym title="
|
|
|
41 European Research Consortium for Informatics and Mathematics">ERCIM</acronym></a>,
|
|
|
42 <a href="http://www.keio.ac.jp/">Keio</a>), All Rights Reserved. W3C
|
|
|
43 <a href="
|
|
|
44 http://www.w3.org/Consortium/Legal/ipr-notice#Legal_Disclaimer">liability</a>,
|
|
|
45 <a href="
|
|
|
46 http://www.w3.org/Consortium/Legal/ipr-notice#W3C_Trademarks">trademark</a>,
|
|
|
47 and <a href="
|
|
|
48 http://www.w3.org/Consortium/Legal/copyright-documents">document use</a>
|
|
|
49
|
|
|
50 rules apply.</p></div>
|
|
|
51
|
|
|
52 <hr title="Separator for header" />
|
|
|
53 <div>
|
|
|
54 <h2 id="abstract">Abstract</h2>
|
|
|
55 <p>This document describes the use of <a href="http://www.w3.org/TR/EARL10-Schema/">EARL</a> by the
|
|
|
56 <a href="http://www.w3.org/2001/sw/DataAccess/">RDF Data Access Working
|
|
|
57 Group</a>. The Working Group is using EARL to collect reports of implementations' experience
|
|
|
58 running the group's <a href="http://www.w3.org/2001/sw/DataAccess/tests/r2">test suite</a>.</p>
|
|
|
59 </div>
|
|
|
60 <div>
|
|
|
61 <h2><a name="status" id="status">Status of This Document</a></h2>
|
|
|
62 <p>Working Document.</p>
|
|
|
63 </div>
|
|
|
64 <hr />
|
|
|
65 <p>
|
|
|
66 The
|
|
|
67 <a href="http://www.w3.org/2001/sw/DataAccess/">RDF Data Access Working
|
|
|
68 Group</a> (DAWG) uses a test-driven process. The
|
|
|
69 <a href="r2">test area</a> is a collection of
|
|
|
70 collection of the current test cases of the working group. </p>
|
|
|
71 <p>As one of the exit criteria to transition the <a href="http://www.w3.org/TR/rdf-sparql-query/">SPARQL Query Language</a> specification to
|
|
|
72 <a href="http://www.w3.org/2004/02/Process-20040205/tr.html#RecsPR">Proposed Recommendation</a> the group is seeking to demonstrate that
|
|
|
73 <blockquote>
|
|
|
74 <i>Each identified SPARQL feature has at least two implementations.</i>
|
|
|
75 </blockquote>
|
|
|
76 To do this, the group is asking for implementors of SPARQL to run their implementations against the <a href="r2">test suite</a> and report the results to the group. Reports can be submitted to <tt>public-rdf-dawg-comments@w3.org</tt>, a mailing list with a public archive. This document presents an example of EARL results and highlights a few best practices that will help the Working Group produce the implementation report.
|
|
|
77 </p>
|
|
|
78
|
|
|
79 <h4>The Structure of an EARL Report</h4>
|
|
|
80
|
|
|
81 <p><i>(In this section, the <tt>earl:</tt> prefix is shorthand for <tt>http://www.w3.org/ns/earl#</tt>.)</i></p>
|
|
|
82
|
|
|
83 <p>An <a href="http://www.w3.org/TR/EARL10-Schema/">EARL</a> report consists of one <tt>earl:assertion</tt> per test run. Each assertion is <tt>earl:assertedBy</tt> the person or software that is responsible for running the test. Each assertion references the test being run via the <tt>earl:test</tt> predicate and identifies the implementation being tested via the <tt>earl:subject</tt> predicate.</p>
|
|
|
84
|
|
|
85 <p>The result of the single test run against an implementation is given by the <tt>earl:result</tt> predicate. The object of this predicate is an <tt>earl:TestResult</tt> that uses the <tt>earl:outcome</tt> predicate to specify the test's result (e.g. <tt>earl:pass</tt>, but see the EARL Schema for other possible <a href="http://www.w3.org/TR/EARL10-Schema/#outcomevalue">outcome values</a>).
|
|
|
86
|
|
|
87 <h4>Best Practices for Reporting EARL to the DAWG</h4>
|
|
|
88
|
|
|
89 <p>In order to assemble a consistent implementation report, the DAWG asks that EARL reports submitted to the group observe the following conventions:</p>
|
|
|
90
|
|
|
91 <ul>
|
|
|
92 <li>An EARL assertor (the object of <tt>earl;assertedBy</tt>) can be a URI or a blank node, but should itself contain a <tt>foaf:homepage</tt> triple that uniquely identifies the assertor.</li>
|
|
|
93 <li>The object of <tt>earl:subject</tt> should be a URI. We use the <a href="http://usefulinc.com/doap/">DOAP</a> vocabulary to provide further information on the implementation being tested.</li>
|
|
|
94 <li>The canonical URIs for a test (the objects of <tt>earl:test</tt>) should be based on the test's URI as given by its manifest file. (For example, <tt>http://www.w3.org/2001/sw/DataAccess/tests/data-r2/graph/manifest#dawg-graph-01</tt>.)
|
|
|
95 </ul>
|
|
|
96
|
|
|
97 <h4>Example EARL</h4>
|
|
|
98
|
|
|
99 <p>The following example of EARL reporting is excerpted from <a href="http://lists.w3.org/Archives/Public/public-rdf-dawg/2007JulSep/0005.html">an example report</a> by DAWG participant Chimezie Ogbuji.</p>
|
|
|
100
|
|
|
101 <pre>
|
|
|
102 @prefix _6: <http://>.
|
|
|
103 @prefix _7: <http://www.w3.org/2001/sw/DataAccess/tests/data-r2/graph/manifest#>.
|
|
|
104 @prefix _8: <http://purl.org/net/chimezie/foaf#>.
|
|
|
105 @prefix _9: <http://purl.org/net/chimezie/>.
|
|
|
106 @prefix doap: <http://usefulinc.com/ns/doap#>.
|
|
|
107 @prefix earl: <http://www.w3.org/ns/earl#>.
|
|
|
108 @prefix foaf: <http://xmlns.com/foaf/0.1/>.
|
|
|
109 @prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>.
|
|
|
110 @prefix rdfs: <http://www.w3.org/2000/01/rdf-schema#>.
|
|
|
111 @prefix xml: <http://www.w3.org/XML/1998/namespace>.
|
|
|
112
|
|
|
113 _8:chime a foaf:Person;
|
|
|
114 rdfs:seeAlso _9:foaf;
|
|
|
115 foaf:homepage <http://metacognition.info>;
|
|
|
116 foaf:name "Chimezie Ogbuji".
|
|
|
117
|
|
|
118 <http://rdflib.net> a doap:Project;
|
|
|
119 doap:name "RDFLib";
|
|
|
120 doap:release
|
|
|
121 [ a doap:Version;
|
|
|
122 doap:created "2007-07-06"^^<http://www.w3.org/2001/XMLSchema#date>;
|
|
|
123 doap:name "rdflib-2.4.1.dev-r1155"].
|
|
|
124
|
|
|
125 [ a earl:Assertion;
|
|
|
126 earl:assertedBy _8:chime;
|
|
|
127 earl:result [ a earl:TestResult;
|
|
|
128 earl:outcome earl:pass];
|
|
|
129 earl:subject <http://rdflib.net>;
|
|
|
130 earl:test _7:dawg-graph-02].
|
|
|
131
|
|
|
132 [ a earl:Assertion;
|
|
|
133 earl:assertedBy _8:chime;
|
|
|
134 earl:result [ a earl:TestResult;
|
|
|
135 earl:outcome earl:pass];
|
|
|
136 earl:subject <http://rdflib.net>;
|
|
|
137 earl:test _7:dawg-graph-01].
|
|
|
138
|
|
|
139 [ a earl:Assertion;
|
|
|
140 earl:assertedBy _8:chime;
|
|
|
141 earl:result [ a earl:TestResult;
|
|
|
142 earl:outcome earl:pass];
|
|
|
143 earl:subject <http://rdflib.net>;
|
|
|
144 earl:test _7:dawg-graph-05].
|
|
|
145
|
|
|
146 [ a earl:Assertion;
|
|
|
147 earl:assertedBy _8:chime;
|
|
|
148 earl:result [ a earl:TestResult;
|
|
|
149 earl:outcome earl:pass];
|
|
|
150 earl:subject <http://rdflib.net>;
|
|
|
151 earl:test _7:dawg-graph-10].
|
|
|
152
|
|
|
153 [ a earl:Assertion;
|
|
|
154 earl:assertedBy _8:chime;
|
|
|
155 earl:result [ a earl:TestResult;
|
|
|
156 earl:outcome earl:pass];
|
|
|
157 earl:subject <http://rdflib.net>;
|
|
|
158 earl:test _7:dawg-graph-08].
|
|
|
159
|
|
|
160 [ a earl:Assertion;
|
|
|
161 earl:assertedBy _8:chime;
|
|
|
162 earl:result [ a earl:TestResult;
|
|
|
163 earl:outcome earl:pass];
|
|
|
164 earl:subject <http://rdflib.net>;
|
|
|
165 earl:test _7:dawg-graph-03].
|
|
|
166
|
|
|
167 [ a earl:Assertion;
|
|
|
168 earl:assertedBy _8:chime;
|
|
|
169 earl:result [ a earl:TestResult;
|
|
|
170 earl:outcome earl:pass];
|
|
|
171 earl:subject <http://rdflib.net>;
|
|
|
172 earl:test _7:dawg-graph-06].
|
|
|
173
|
|
|
174 [ a earl:Assertion;
|
|
|
175 earl:assertedBy _8:chime;
|
|
|
176 earl:result [ a earl:TestResult;
|
|
|
177 earl:outcome earl:pass];
|
|
|
178 earl:subject <http://rdflib.net>;
|
|
|
179 earl:test _7:dawg-graph-04].
|
|
|
180
|
|
|
181 [ a earl:Assertion;
|
|
|
182 earl:assertedBy _8:chime;
|
|
|
183 earl:result [ a earl:TestResult;
|
|
|
184 earl:outcome earl:pass];
|
|
|
185 earl:subject <http://rdflib.net>;
|
|
|
186 earl:test _7:dawg-graph-11].
|
|
|
187
|
|
|
188 [ a earl:Assertion;
|
|
|
189 earl:assertedBy _8:chime;
|
|
|
190 earl:result [ a earl:TestResult;
|
|
|
191 earl:outcome earl:pass];
|
|
|
192 earl:subject <http://rdflib.net>;
|
|
|
193 earl:test _7:dawg-graph-07].
|
|
|
194
|
|
|
195 [ a earl:Assertion;
|
|
|
196 earl:assertedBy _8:chime;
|
|
|
197 earl:result [ a earl:TestResult;
|
|
|
198 earl:outcome earl:pass];
|
|
|
199 earl:subject <http://rdflib.net>;
|
|
|
200 earl:test _7:dawg-graph-09].
|
|
|
201 </pre>
|
|
|
202 <p> </p>
|
|
|
203 </body>
|
|
|
204 </html>
|
