report.html 21.4 KB

Raw Blame History Permalink

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
    "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en">
<head>
<meta http-equiv="content-type" content="application/xhtml+xml; charset=utf-8" />
<title>W3C Workshop: Augmented Reality on the Web</title>
<link rel="stylesheet" href="http://www.w3.org/2007/08/video/style.css" type="text/css" media="all" />
  <link rel="stylesheet" href="http://www.w3.org/2007/08/video/print.css" type="text/css" media="print" />
<style type="text/css" media="screen">
div#page {
	background-image: none;
}

div#main {
  padding-bottom:1em;
}

dl {margin: 1em 2em;}
dt {margin: 0 0 0 1em;
    font-weight: bold;
}
dt a {font-weight: bold;}
dd {margin: 0 0 0 2em;}
div#navigation li.current {
   color: white;
  font-weight: bold;
}

div.image {
  float: right;
  margin: 1em;
}


div.imageLeft {
  float: left;
  margin: 1em;
}
div.imageCentre {
  margin: 0 auto;
}

div.thumbs img {
  margin: 0 0.2em;
  padding: 0 0.2em;
}

div.image p, div.imageLeft p, div.image p, div.imageCentre p, div.thumbs p {
  font-size:small;
  font-style:italic;
  text-align:center;
}
div.image span.source, blockquote p.source {
  font-size: x-small;
  font-style: italic;
}
div.report h2, div.report h3 {
 clear: both;
}

div#sponsors {
  width:250px;
  float:right;
  margin-left:1em;
  border-left:1px solid black;
  padding-left:0.5em;
}

div#sponsors h2 {
 margin-top:0;
}
</style>
</head>

<body>

<div id="page">
<h1>W3C Workshop: Augmented Reality on the Web <span class="baseline">15 - 16 June 2010, Barcelona</span></h1>
</div>
<div id="navigation">
<ul>
<li><a href="http://www.w3.org/Consortium/">About W3C</a></li>
<li><a href="http://www.w3.org/2010/04/W3C-augmented-reality-workshop-omweb.htm">Call for Participation</a></li>
<li><a href="http://www.w3.org/2010/06/w3car/papers.html">Papers</a></li>
<li class='current'>Report</li>
<li><a href="http://www.w3.org/2010/06/w3car/">Agenda</a></li>
</ul>
</div>
<div id="main">
<p class="logo" style="float:right;margin-left:1em;"><a href="/"><img src="/Icons/WWW/w3c_home_nb" alt="W3C" height="48" width="72" /></a></p>
<h2 id="report" style="clear:left;">Workshop Report</h2>

<h3 id="intro">Introduction</h3>
<div class="image" style="width:310px">
  <a href="http://www.w3c.or.kr/~hollobit/album/w3car-photos-small/target21.html"><img src="generalshot_small.jpg" width="300" height="210" alt="General shot of the workshop participants." /></a>
  <p>General shot of the workshop participants</p>
</div>
<p>This W3C Workshop was held to discuss whether and how the exciting opportunities offered by Augmented Reality
can benefit from Web technologies. <em>Augmented Reality on the Web</em> was hosted in Barcelona by Escola T&egrave;cnica Superior d'Enginyeria
 de Telecommunicaci&oacute; de Barcelona (ETSETB) at Universitat Polit&egrave;cnica de Catalunya (UPC).
It attracted over 40 <a href="http://www.w3.org/2010/06/w3car/attendees.html">attendees</a> and 22
<a href="http://www.w3.org/2010/06/w3car/papers.html">papers</a>. The participants represented a broad range of businesses including
telecom operators, device manufacturers, AR content and platform developers, AR users from the advertising world,
academics and standards bodies.</p>

<p>The <a href="http://www.w3.org/2010/06/w3car/">agenda</a> provided time for everyone present to participate
in the presentations and discussions. The primary outcome of the workshop is the strong desire to
form a new W3C working group to:</p>
<ol>
  <li>create a standard for representing multi-dimensional Point of Interest data;</li>
  <li>survey and report on how AR standards can take into account and benefit from work ongoing in other areas such as privacy, linked data,
	geolocation, device APIs and more.</li>
</ol>

<p>The remainder of this report summarizes the presentations and discussions. More detailed minutes are
available from <a href="http://www.w3.org/2010/06/15-w3car-minutes.html">day 1</a> and <a href="http://www.w3.org/2010/06/16-w3car-minutes.html">day 2</a>.</p>
<p>Jonghong Jeon's photographs of the event, several of which are used here, are available in <a href="http://www.w3c.or.kr/~hollobit/album/w3car-photos-small/">small</a>
and <a href="http://www.w3c.or.kr/~hollobit/album/w3car-photos-large/">large</a> sizes.</p>

<h3 id="session1">What Needs to Happen for AR to Become an integral element of the Web?</h3>

<div class="imageLeft" style="width:200px; margin-right:4em;">
  <img src="jonghong.jpg" width="200" height="396" alt="Jonghong Jeon takes a photo over the head of W3C's Francois Daoust." />
  <p>Jonghong Jeon takes a photo over the head of W3C's Francois Daoust. Also pictured are Alex Philips (IBM) and workshop co-chair Rittwik Jana (AT&amp;T)</p>
</div>


<p>This was the central question of the workshop and the focus of the first session. Layar (AR service provider),
Sony Ericsson (mobile device manufacturer) and Canon (image specialists) set out their use cases for
Web standards work, reinforcing points made in the opening paper &amp; presentation by ETRI. A highlight of that paper
was when authors Jonghong Jeon, Sunghan Kim and Seungyun Lee identified 12 issues to be
addressed before AR content providers and AR User Agents can truly be interoperable. Since these were referred to
by several speakers throughout the workshop it's appropriate to list them here:</p>
<ol id="jj">
  <li>AR content markup &amp; format</li>
  <li>AR content transport/interaction method</li>
  <li>Representing 3D interactive AR content</li>
  <li>Event Scripting</li>
  <li>Local caching method</li>
  <li>Additional functionality of AR user agent</li>
  <li>Device capability access APIs</li>
  <li>AR data mashup methods</li>
  <li>AR data format - POI (images, text, 3D models, URIs)</li>
  <li>AR data service API</li>
  <li>Open marker database</li>
  <li>Security &amp; privacy</li>
</ol>

<p>(See slide 14 of <a href="http://www.w3.org/2010/06/w3car/pres/W3C-GFR-hollobit-r2.pdf">Johnhong's presentation</a>).</p>

<p>Considering all the presentations in the first session, it was clear that consensus was already beginning to coalesce around
the need for a standard method of representing Point of Interest data as a minimum, although several other areas are of key
interest. Notable among these is the need for rich device APIs, exposing the functionality of devices and their sensors to Augmented
Reality services and applications. This is particularly true for mobile devices.</p>

<h3 id="roleforstandards" style="clear:both">What Role for Standards?</h3>
<p>The workshop focused on the general topic of standards for AR and the Web throughout so distinctions between the theme
of each session is necessarily blurred. However, the second session looked at the kind of standards and data interactions that
might help the advancement of AR. Participants presented a range of ideas on how AR can be seen in a broader context: social networking,
the uploading of relevant data, and context-based filtering of the mass of data available and potentially relevant to a given
user at a given location at a given time.</p>

<p>These themes are familiar from the Web as we know it today but bringing that paradigm to Augmented Reality is, as yet, largely unrealized.
Some sort of extension or new application of existing standards is required.</p>

<p>Wolfgang Damm from Mobilizy (makers of Wikitude) presented a comparison of two efforts to create a standard to describe
Points of Interest. One, <a href="http://openarml.org/">ARML</a>, was produced largely by his own company and is used in the
Wikitude browser. Another, <a href="https://research.cc.gatech.edu/polaris/content/karml-reference">KARML</a>, was developed by
a team at Georgia Tech lead by Blair McIntyre as part of the <a href="https://research.cc.gatech.edu/polaris/">KHARMA</a> environment. The latter
uses a lot of familiar Web technologies to create an open platform to which users can contribute in much the same way as
the <a href="http://libregeosocial.morfeo-project.org/">LibreGeoSocial Open Source</a> project presented at the workshop.</p>

<p>An <a href="http://groups.google.com/group/openARweb/browse_thread/thread/9489ed85e2e7722f">e-mail thread</a> directed at the workshop that
includes contributions from some of the people close to the KHARMA project and others can be seen on the
<a href="http://groups.google.com/group/openARweb/">Open AR Googlegroup</a>.</p>

<p>In his <a href="http://www.w3.org/2010/06/w3car/web_apps.pdf">paper</a>, Jens de Smit pointed out that much of the processing behind
current AR applications can be and is done using standard Web technologies. Further standards are required, however, such as full access
to the camera, accelerometer and compass within mobile devices, if the Web technologies like HTML 5 &lt;video&gt; element, JavaScript
are to support AR fully. Current W3C work on, for example, the <a href="http://www.w3.org/TR/2010/WD-capture-api-20100401/">camera API</a>,
is clearly important in this regard.</p>

<div class="imageCentre" style="text-align:center; width:774px">
  <a href="http://www.w3c.or.kr/~hollobit/album/w3car-photos-small/target23.html"><img src="panel.jpg" width="774" height="189" alt="The first panel" /></a>
  <p>One of the panels. From left to right: Dirk Groten (Layar), Claudio Venezia (Telecom Italia), Alex Philips (IBM), Timo Engelke (Fraunhofer), Chris Burman (Connected Environments).</p>
</div>

<h3 id="widerContext">AR in a wider Context</h3>
<p>The session entitled "Data, Reality and Things" looked at the subject of Augmented Reality from different perspectives. In
their <a href="http://www.w3.org/2010/06/w3car/ar_for_iot.pdf">paper</a>, BDigital posited AR as an enabler for the Internet
of Things. Connected Environments work in this space too through their product <a href="http://www.pachube.com/">Pachube</a>
(pronounced "patch bay"), which can use AR to visualize a variety of sensor data. Chris Burman <a href="http://www.w3.org/2010/06/w3car/pres/cburman-w3cAR.pdf">presented</a>
a list of requirements for AR that includes some items not discussed in earlier sessions:</p>
<ul>
  <li>Markers or 'hooks' for orientating content. Do we really need to stick QR codes on everything?</li>
  <li>Image recognition/processing. Generic surfaces like desktops are really hard to process).</li>
  <li>Object-scale (rather than "city scale or global scale") geo-location.</li>
  <li>Efficient caching of 3D interest (mobile Web 3D is still a bit rubbish but it's coming!)</li>
</ul>


<div class="imageLeft" style="width:200px">
  <img src="wolfgang.jpg" width="200" height="240" alt="Wolfgang Damm, Mobilizy" />
  <p>Mobilizy's Wolfgang Damm</p>
</div>

<p>If AR is to develop further as a key tool for city planning then sensor data, object data and more will perhaps need a
common infrastructure but different users may need different levels of access to the data.</p>

<p>This segued into the presentation from DERI about the potential for linked data in AR. Vinny Reynolds <em>et al</em>
observed in their <a href="http://www.w3.org/2010/06/w3car/exploiting_lod_for_ar.pdf">paper</a> that some aspects of the
proprietary systems currently used in AR browsers won't scale. How can new data be discovered and integrated into a particular
augmented view? Available contextual information is generally under-utilized. Linked Data has a great deal to offer in
this space. Current estimates put the number of data items available at 20 billion and it's growing rapidly with governments
publishing more data (such as through <a href="http://www.data.gov/">data.gov</a> and <a href="http://data.gov.uk/">data.gov.uk</a>) and
the adoption of <a href="http://www.w3.org/TR/xhtml-rdfa-primer/">RDFa</a> by Facebook and other major players. Much of this data is already geolocated through <a href="http://www.geonames.org/">GeoNames</a>,
<a href="http://linkedgeodata.org/About">LinkedGeoData</a> and <a href="http://dbpedia.org/About">DBPedia</a>.</p>

<p>There is a tendency to think of AR information superimposed in the user's visual field. Jacques
Lemordant of INRIA <a href="http://www.w3.org/2010/06/w3car/pres/ARA_Lemordant.pdf">presented</a> a very different take
on AR - Augmented Reality Audio. The sound capabilities of the iPhone and similar products makes this all
the more feasible for applications including audio walking tours, geolocalized games, navigation systems and, for the pure aesthetic
pleasure of it, soundscapes. Using a dialect of XML called A2ML, that takes its inspiration from SVG, it's
possible to cue specific audio files or mix several files to generate complex sounds in response to events.
Work with a very <a href=" http://www.w3.org/2010/06/w3car/pres/SoundscapeVE_Demo_WC3AR_2010.pdf">similar theme</a> is also being
carried out in Barcelona by Nathanial Finney and Jordi Janner of Universitat Pompeu Fabra.</p>

<p>So far all the discussion about AR on the Web has made the implicit assumption that the HTTP protocol will be
used to transfer data from server to client. But is this appropriate? Thomas Wrobel, for one, thinks not, preferring
Google's <a href=" http://www.lostagain.nl/websiteIndex/projects/Arn/WFPforAR.html">Wave protocol</a>. For all
its strengths, the mood in the room, however, is that content publishers at least will be much more comfortable with what they know (i.e. HTTP).</p>

<h3 id="getreal">Augmented Reality Gets Real</h3>
<p>The final paper-based session centered on commercial aspects of AR. It began with a reminder of the
potential <a href=" http://www.w3.org/2010/06/w3car/trusted_broker_framework.pdf">social impact</a> of widespread AR from Dan
Romescu, and ended with the HCI Computer Group from the University of Oviedo <a href=" http://www.w3.org/2010/06/w3car/pres/Shubai_Project.pdf">presenting</a>
the SHUBIA Project that applies AR to an area where there is substantial potential for development - providing supplementary information for disabled people.</p>


<div class="image" style="width:400px">
  <img src="dinner.jpg" width="400" height="280" alt="Diners at Post Maratim" />
  <p>Diners enjoy the conference dinner at Posit Maritim sponsored by Acrossair. From left to right: Mohit Virmani (Pec University), workshop co-chair Christine Perey,
  F&aacute;tima Ac&iacute;en Martinez (ARPA SOlutions), Manel Medina (UPC) &amp; Romain Bellasort (Canon Research, France).</p>
</div>

<p>Other contributions in this session looked at AR prototypes and industrial solutions other than those commonly found in an 'AR Browser'
such as those <a href=" http://www.w3.org/2010/06/w3car/pres/AR_at_IBM.pdf">in use and under development at IBM</a>
together with <a href=" http://www.w3.org/2010/06/w3car/pres/Building_and_Medical_AR.pdf">medical and building industry</a> applications.
It's clear that the collection of technologies loosely defined as being part of Augmented Reality do have
very real commercial applications with significant potential for future profitable growth.
The possible business models for AR on mobile
were examined by Manel Medina <em>et al.</em>'s <a href=" http://www.w3.org/2010/06/w3car/Payment_for_AR_information.pdf">paper</a>].</p>

<p>The GeoBuyMe
project, which worked with QPORAMA, provides a solid use case. A variety of marketing and social-media tactics were used
within an AR context, essentially alerting users when they pass within a short distance of a store that sells items they have
added to their wish list. Printed promotional material including both coupons and point of sale displays carry QR codes (markers) and, depending on
things like how often a user has recommended the GoBuyMe service to others, they receive smaller or larger discounts.

Additional commercially-attractive use case for AR and the requirements of industrial users
were discussed by Total Immersion, <a href=" http://www.w3.org/2010/06/w3car/arpa.pdf">ARPA Solutions</a>
and the <a href=" http://www.w3.org/2010/06/w3car/young_generation.pdf">Young Generation</a>, who were all represented on the final panel.</p>

<h3 id="demos">Demos</h3>
<p>At the end of the first day those advertising and marketing-based companies offered a series of striking
demos of Augmented Reality in use. Other demos were presented by Claudio Venezia of Telecom Italia
(<a href=" http://www.w3.org/2010/06/w3car/enhance_your_brain.pdf">paper </a>) and Timo Engelke of Fraunhofer who
<a href=" http://www.w3.org/2010/06/w3car/pres/w3carsymposium_timo.pdf">showed</a>  an iPhone application that used various Web technologies including X3D.</p>

<p>Before the end of the demo session, the workshop members saw a video demo of the
<a href=" http://www.youtube.com/watch?v=o_mUFS992Cw ">Acrossair AR Browser</a>. Close attention was paid to
this video - <a href=" http://www.acrossair.com/ ">Acrossair</a> sponsored the dinner!</p>

<h3 id="discussion">Discussions</h3>
<div class="imageLeft" style="width:300px; margin-right:2em">
  <img src="vinneyetal.jpg" width="300" height="191" alt="DERI's Vinny Reynolds leads one of the breakout sessions" />
  <p>DERI's Vinny Reynolds leads one of the breakout sessions</p>
</div>
<p>In order to generate as much discussion including as many people as possible, the workshop split into three groups.</p>

<p>The three groups discussed the AR landscape in the context of the Web and standards. They developed what they felt were the most pressing
issues or matters of highest risk.</p>

<p style="clear:both">Recurring themes include:</p>
<ul style="margin-bottom:1em">
  <li>how to publish Point of Interest data once for representation across many AR services, a common AR data &quot;tagging&quot; standard;</li>
  <li>the importance of 3D (including X3D, the Web 3D Consortium and others)</li>
  <li>the opportunities for using and reusing Linked Data;</li>
  <li>how to make it easier to deliver the best user experience;</li>
  <li>substantial and repeated concerns over privacy;</li>
  <li>Jonghong's <a href="#jj">12 points</a>;</li>
  <li>what is a point of interest? An object? A location?</li>
  <li>interaction can come from geo-social content with crowd sourcing to increase confidence levels;</li>
  <li>inputs from other sensors, haptics, temperature can be important;</li>
  <li>existing standards need to work together with new standards;</li>
  <li>what is the origin/provenance of the data?</li>
  <li>temporal dimension as important to understanding of context as geolocation;</li>
  <li>AR is currently defined by what we have rather than what we want to do.</li>
</ul>
<div class="imageCentre" style="width:620px">
  <a href="christeam.jpg"><img src="christeam_sml.jpg" width="200" height="267" alt="Chris's Team flip chart thumbnail" /></a> <a href="damonteam.jpg"><img src="damonteam_sml.jpg" width="200" height="267" alt="Damon's Team flip chart thumbnail" /></a> <a href="vinnyteam.jpg"><img src="vinnyteam_sml.jpg" width="200" height="267" alt="Vinny's Team flip chart thumbnail" /></a>
  <p>Click the thumbnail for full size images of the flip charts from the three breakout sessions (in order: Chris Burman's team, Damon Hernandez's team, Vinny Reynolds' team).</p>
</div>
<h3 id="action">Call to action</h3>
<div id="sponsors">
<h2>Thanks!</h2>
<a href="http://www.upc.edu/"><img src="upc_logo.png" width="239" height="54" alt="logo of Universitat Politecnica de Catalunya, Bracelona Tech (UPC" /></a><br /><a href="http://www.acrossair.com/"><img src="http://www.w3.org/2010/04/acrossair.png" width="189" height="35" alt="acrossair (logo)" id="acrossairLogo" /></a><br /><a href="http://openmediaweb.eu/"><img src="http://www.w3.org/2010/04/OMWEB_200.png" width="200" height="167" alt="Open Media Web" /></a>
</div>
<p>During the event, and especially during the discussion during the final two sessions of the workshop, it became clear that the need for a
standard for publishing Point of Interest data was pressing. After considering the
<a href="http://www.w3.org/2010/Talks/phila-w3car-options/#(1)">various options</a>, it was agreed that work on such a
standard should, if possible, begin without delay. Jonghong Jeon pointed out that
this is also of interest to other relevant organizations such as the
<a href="http://www.w3c.or.kr/~hollobit/ARKR/20100603-workshop/arsw2-3.pdf">Open Mobile Alliance</a> (OMA).</p>

<p>The <a href="http://www.w3.org/2010/06/16-w3car-minutes.html#item09">minutes from this discussion</a> show clear support for
a full Working Group with two principal aims:</p>
<ol>
  <li>To develop a standard for representing Point of Interest (POI) data.</li>
  <li>To contribute to the industry a Working Group Note on how AR standards can take into account and benefit from work ongoing in other
	areas such as privacy, linked data, geolocation, device APIs and more.</li>
</ol>

<p>To facilitate the evolution and future working of the group, a public mailing list has been established (with <a href="http://lists.w3.org/Archives/Public/public-poiwg/">archive</a>) to which you are encouraged to <a href="mailto:public-poiwg-request@w3.org?subject=subscribe">subscribe</a>!</p>

<p>Finally, the participants thanked our host, professor <a href="http://personals.ac.upc.edu/medina/">Manel Medina</a> of UPC, the sponsors of the conference dinner,
	Acrossair and
	recognized the important contribution made by the OMWeb project which is funded by
	the European Union through the Seventh Framework Programme (FP7/2007-2013) under grant agreement n&deg; 248687 - Open Media Web (OMWeb).</p>
<p><a href="mailto:phila@w3.org">Phil Archer</a> $Date: 2010/07/22 09:01:06 $ by $Author: phila $ with additional input gratefully received from <a href="http://www.perey.com/">Christine Perey</a>.</p>

</div>
</body>
</html>