{"id":4865,"date":"2016-02-05T14:02:36","date_gmt":"2016-02-05T14:02:36","guid":{"rendered":"https:\/\/teach.alimomeni.net\/2016spring1\/?p=4865"},"modified":"2016-02-07T01:24:48","modified_gmt":"2016-02-07T01:24:48","slug":"virtual-reality-for-data-visualization","status":"publish","type":"post","link":"https:\/\/teach.alimomeni.net\/2016spring1\/virtual-reality-for-data-visualization\/","title":{"rendered":"R3 &#8211; Virtual Reality for Data Visualization"},"content":{"rendered":"<div style=\"left: 0; width: 100%; height: 0; position: relative; padding-bottom: 56.25%; padding-top: 30px;\"><iframe title=\"virtual reality for data visualization\" src=\"https:\/\/docs.google.com\/presentation\/d\/1uMQjWD1jF0IQzQ7IeXDRjdWLIK5IaELI4qvLZZNOmt0\/preview?usp=embed_googleplus\" style=\"border: 0; top: 0; left: 0; width: 100%; height: 100%; position: absolute;\" allowfullscreen scrolling=\"no\" allow=\"encrypted-media\"><\/iframe><\/div>\n<p><script type=\"text\/javascript\">window.addEventListener(\"message\",function(e){\n                window.parent.postMessage(e.data,\"*\");\n            },false);<\/script><\/p>\n<p><strong>VR for the web<\/strong><\/p>\n<p>In the currently unfolding rapid expansion of virtual reality in the consumer market, a brief\u00a0study of the available technologies\u00a0for bringing web content into VR devices seems to indicate that we&#8217;re in the competing-standards era of this emerging technology. Different individual developers\u00a0and software\/web companies are creating\u00a0their own ways of porting wraparound images, movies, and interactive experiences to consumers via the web, and it seems that at the moment there&#8217;s no clear winner in this area. Some examples of standards presently available, any of which may be useful to us in our effort to bring material to consumer devices:<\/p>\n<p>Mozilla&#8217;s &#8220;<a href=\"http:\/\/mozvr.com\" target=\"_blank\">Mozvr<\/a>&#8221; platform includes the ability to provide VR imagery data to iOS and Android devices via Cardboard viewer or similar, and also Oculus Rift. The user operation for iOS and Android is quite simple: load a VR enabled webpage and then click the &#8220;VR&#8221; button on the page, and load the phone into the viewer. Oculus instructions require the installation of the latest nightly build\u00a0of Firefox or Chromium (the open-source browser project that Google Chrome is built on), and in Firefox additionally require installing a WebVR enabler add-on. Examples of wraparound images for VR using this standard are available at this <a href=\"https:\/\/mozvr.github.io\/panorama-viewer\" target=\"_blank\">panorama viewer website<\/a>. (For disambiguation, this standard also seems to be referred to as <a href=\"http:\/\/webvr.info\" target=\"_blank\">WebVR<\/a>, described on its site as &#8220;an experimental Javascript API.&#8221;)<\/p>\n<p>Another Google platform is designed for Chrome and I honestly cannot tell if it&#8217;s meaningfully different technically from the Mozilla platform, though it has a different name and different website. It uses WebGL and Three.js, and is available to\u00a0preview with a Cardboard or similar device at <a href=\"http:\/\/vr.chromeexperiments.com\" target=\"_blank\">vr.chromeexperiments.com<\/a>.\u00a0It is described with good\u00a0technical specificity in <a href=\"http:\/\/blog.tojicode.com\/2014\/07\/bringing-vr-to-chrome.html\" target=\"_blank\">this 2014 blog post<\/a> by Brandon Jones, a Google Chrome developer, though I don&#8217;t find any more recent discussion than that for some reason. (Also the latest nightly builds appear to date from mid-2015.) Jones\u00a0reveals some testing data indicating that the latency for Oculus Rift with WebVR for Chrome was 64 milliseconds, when about 20 milliseconds is apparently the gold standard for making a VR experience feel more real. (Contrarily, a 1998 study by Watson et. al. actually finds that 82 milliseconds is the relevant threshold here; Jones does not cite his source but it&#8217;s likely to be more recent.)<\/p>\n<p>A third standard that appears to be under more active public development is <a href=\"http:\/\/janusvr.com\" target=\"_blank\">Janus VR<\/a>, which is designed to turn individual websites into &#8220;rooms&#8221; in a vast connected network with &#8220;portals&#8221; connecting them to each other. This virtualizes the web browsing experience in a very particular metaphorical fashion. However, in addition to displaying regular webpages as rooms, it also supports display of various 3D web content in addition to wraparound VR imagery using an HTML tag called FireBoxRoom. This standard allows for video and also shaders so that surfaces can take advantage of the user&#8217;s graphics card to quickly process imagery.<\/p>\n<p><strong>Research in data visualization for virtual reality<\/strong><\/p>\n<p>An interesting ambiguity emerges when searching for academic writing about virtual reality data visualization: for a long time, &#8220;virtual reality&#8221; referred to any system displaying simulated 3D imagery, including simple things like cubes rotating on flat computer screens! (Recently\u00a0the term always refers to systems using headsets or the like, which are designed to be\u00a0responsive to the user&#8217;s head movement.)<\/p>\n<p>There&#8217;s good evidence in this that the use of virtual reality systems increases &#8220;situational awareness&#8221; of visualized data, as one would expect. This is borne out by a series of studies which show, among other findings, that the immediacy of the virtual reality environment allows for a greater sense of presence in the data itself, and a much deeper ability to explore that data. (See Lin 1999, Bayyari 2006, and Laha 2012.) Note that these studies generally refer to volumetric data, for instance showing the extent of geological formations or paleontological findings. It is still relevant for our present purposes, though, because at least for the larger datasets we have looked at such as\u00a0CREATE Lab&#8217;s EVA, the data takes on a volumetric form.<\/p>\n<p>My\u00a0biggest finding in searching for information about data visualization in virtual reality environments, though, is the deafening silence one comes across: after reviewing ~30 papers, I didn&#8217;t find any example, either in the academic literature or the broader web, that addressed questions of visualization\u00a0of datasets other than large and volumetric ones. I\u00a0didn&#8217;t find an\u00a0example\u00a0using a virtual environment to tell a tale about a small-scale story about\u00a0one neighborhood or community, for instance, or really any data exploration that wasn&#8217;t fundamentally scientific in motivation.\u00a0This likeliest indicates that more artful storytelling modes have mostly not yet been explored. A wonderful opportunity for us to break new ground!<\/p>\n<p><strong>The nose knows<\/strong><\/p>\n<p>Finally, an interesting tidbit. VR users frequently complain of nausea, and it&#8217;s known anecdotally that having a &#8220;cockpit&#8221; or other stable feature of the VR image can help allay the problem. Of course many environments, such as a panoramic image, aren&#8217;t especially amenable to any fixed feature in the landscape. An undergraduate working on this research problem came up with a very smart\u00a0solution:\u00a0draw a virtual nose right where we usually expect our noses to be. (This acts as a stable object, and certainly one we&#8217;re well attuned\u00a0to seeing.) With the virtual nose in place, a 2015 Purdue <a href=\"http:\/\/www.purdue.edu\/newsroom\/releases\/2015\/Q1\/virtual-nose-may-reduce-simulator-sickness-in-video-games.html\" target=\"_blank\">study found<\/a>, users took longer to become nauseated while experiencing certain types of virtual environments. Clever! And maybe we should look into incorporating\u00a0it ourselves as we build our own systems.<\/p>\n<p>&nbsp;<\/p>\n<p>References:<\/p>\n<p>Bayyari, Ahmed, and M. Eduard Tudoreanu. &#8220;The impact of immersive virtual reality displays on the understanding of data visualization&#8221;. 2006 Virtual Reality Software and Technology conference.<em>\u00a0Proc. of ACM Symp. on Virtual Reality Software and Technology<\/em>, pp. 368\u2013371. <a href=\"http:\/\/dx.doi.org\/10.1145\/1180495.1180570\">http:\/\/dx.doi.org\/10.1145\/1180495.1180570<\/a><\/p>\n<p>Gould, Duncan K. \u201cStimulating a beneficial human response by using visualization of medical scan data to achieve psychoneuroimmunological virtual reality\u201d. US patent 5546943 A. 1996. Google Patents link:\u00a0<a href=\"https:\/\/www.google.com\/patents\/US5546943\">https:\/\/www.google.com\/patents\/US5546943<\/a><\/p>\n<p>Laha, Bisrewar et al. &#8220;Effects of Immersion on Visual Analysis of Volume Data&#8221;.\u00a0<em>Visualization and Computer Graphics, IEEE Transactions on<\/em>. vol. 18, no. 4 (2012). pp. 597\u2013606.\u00a0<a href=\"http:\/\/dx.doi.org\/10.1109\/TVCG.2012.42\">http:\/\/dx.doi.org\/10.1109\/TVCG.2012.42<\/a><\/p>\n<p>Lin, Ching-Rong. &#8220;Applications of Virtual Reality in the Geosciences.&#8221; Order No. 9917207 University of Houston, 1998. Ann Arbor: <i>ProQuest.<\/i>\u00a0<a href=\"http:\/\/search.proquest.com\/docview\/304436371\">http:\/\/search.proquest.com\/docview\/304436371<\/a><\/p>\n<p>Watson, Benjamin, et al. &#8220;Effects of variation in system responsiveness on user performance in virtual environments.&#8221; <i>Human Factors<\/i> 40.3 (1998): 403. <i>General OneFile<\/i>.\u00a0<a href=\"http:\/\/dx.doi.org\/10.1518\/001872098779591287\">http:\/\/dx.doi.org\/10.1518\/001872098779591287<\/a><\/p>\n<p>&nbsp;<\/p>\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>VR for the web In the currently unfolding rapid expansion of virtual reality in the consumer market, a brief\u00a0study of the available technologies\u00a0for bringing web content into VR devices seems to indicate that we&#8217;re in the competing-standards era of this<\/p>\n","protected":false},"author":121,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[213,99,93,209,33,215,216],"tags":[],"_links":{"self":[{"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/posts\/4865"}],"collection":[{"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/users\/121"}],"replies":[{"embeddable":true,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/comments?post=4865"}],"version-history":[{"count":6,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/posts\/4865\/revisions"}],"predecessor-version":[{"id":4892,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/posts\/4865\/revisions\/4892"}],"wp:attachment":[{"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/media?parent=4865"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/categories?post=4865"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/teach.alimomeni.net\/2016spring1\/wp-json\/wp\/v2\/tags?post=4865"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}