32nd Annual Stereoscopic Displays and Applications Conference

Page created by Donald Singh
 
CONTINUE READING
32nd Annual Stereoscopic Displays and Applications Conference
https://doi.org/10.2352/ISSN.2470-1173.2021.2.SDA-B02
 This work is licensed under the Creative Commons Attribution 4.0 International License.
 To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

32nd Annual Stereoscopic Displays and Applications Conference
- Introduction
Andrew J. Woods1, Nicolas S. Holliman2, Gregg E. Favalora3, Takashi Kawai4, Bjorn Sommer5
1
 Curtin University, Australia; 2Newcastle University, United Kingdom; 3The Charles Stark Draper Laboratory, Inc., USA; 4Waseda
University, Japan; 5Royal College of Art, United Kingdom.

Abstract This year the conference had 21 oral presentations
 This document provides an overview of the 32nd Stereoscopic across the three days of the conference. Two of the
Displays and Applications conference and also serves as an conference sessions were held jointly with the Engineering
introduction to the conference proceedings. Reality of Virtual Reality conference (ERVR).
 The final conference program is available on the long-
 running SD&A conference website:
Introduction
 www.stereoscopic.org/2021
 The 32nd annual Stereoscopic Displays and Applications
 The program page also lists which presentations have an
(SD&A) conference was very different to all previous SD&A
 accompanying manuscript (and where to find it) and those
conferences because it was held fully online. The 2020 SD&A
 that don’t. Some of the papers are published in the Journal of
conference was fortunate to just clear the start of the
 Imaging Science and Technology (JIST) and are indicated
widespread outbreak of the COVID-19 pandemic, but no such
 with the designation “JIST first” since manuscripts submitted
luck for the 2021 conference. The 2021 SD&A conference
 this way go through an accelerated full review process.
was originally planned to be held in downtown San Francisco,
 All of the published manuscripts from SD&A 2021 along
however it was soon obvious this was not going to be
 with the other papers from the 2021 Electronic Imaging
possible, and “the show must go on” so the IS&T and
 Symposium will be published in the IS&T Digital Library on the
conference chairs worked very hard to quickly pivot the SD&A
 Ingenta Connect platform at:
conference, and the whole Electronic Imaging (EI)
 http://ist.publisher.ingentaconnect.com/content/ist/ei
Symposium, to a fully online format.
 Papers in the joint sessions can only appear in one
 The online version of the Electronic Imaging Symposium
 proceedings volume so they may appear in the proceedings
necessitated some careful adjustments to the schedule since
 volume of one of the contributing conferences rather than the
attendees were located all around the world in almost every
 SD&A proceedings. The SD&A 2021 program page will
time zone. The first adjustment was to hold the symposium
 provide a direct link to each of the manuscripts without
over a period of three weeks (11-28 January), rather than the
 needing to worry about which particular conference or journal
usual five days. This created a more relaxed schedule which
 site they appear in – just visit:
allowed more flexibility. The first week was short courses, and
 www.stereoscopic.org/2021
week two and three were the conference presentation
 All manuscripts from the SD&A 2021 conference and the
sessions.
 wider Electronic Imaging Symposium are published Open
 The other adjustment was that the daily schedule was
 Access which significantly improves the accessibility of SD&A
split into a US East Coast morning session (which was also
 authors’ work and help you, the reader, access new and
convenient for attendees in Europe) and a (US East Coast)
 important developments in this field.
late afternoon/evening session (which was also convenient for
 As well as the conference sessions running fully online,
attendees in the Asia/Pacific region). Of course, some of the
 the technical short course “Stereoscopic Imaging
sessions would occur at an inconvenient time for some of the
 Fundamentals” hosted by Andrew Woods also ran online over
attendees so all presentations were recorded and made
 two days, and perhaps even more challenging, the annual 3D
available for offline viewing.
 theater session also ran online.
 The online format used a range of different session types
to try to reproduce the friendly and personable atmosphere
that EI is known for. As well as the online presentation SD&A 3D Theater Session
sessions which allowed for real-time question and answer The 3D Theater session has been a regular fixture of the
option for the audience, as well as break-out rooms, SD&A conference for the past 20+ years, and with the move
demonstration sessions, and also a Discord channel for online of this year’s conference to an online event it provided an
chat. opportunity for us to do something different this year. Thanks
 This introduction document provides a summary of the to the organisational efforts of lead-producer John Stern,
wide range of activities and events that took place at the 2021 expert online production by Eric Kurland, and production
online conference. One thing that didn’t change was that the assistance by Dan Lawrence, this year’s 3D Theater session
conference still attracted a strong mix of attendees from both was also held fully online and attendees were able to watch
industry and academia including those who spoke in the the SD&A 3D Theater session films from the comfort of their
plenaries, keynotes and technical sessions. loungeroom. The films screened in the 2021 3D Theater
 session were selected from winning films over the past ten
 years of the SD&A 3D Theater session. The event was

IS&T International Symposium on Electronic Imaging 2021
Stereoscopic Displays and Applications XXXII B02-1
32nd Annual Stereoscopic Displays and Applications Conference
“broadcast” live on YouTube in both anaglyph 3D (for people The event was well attended and received very good
to watch using red/cyan anaglyph glasses) and over-under 3D feedback from attendees. There were 185 event registrants
formats (for people to watch on a 3DTV), and was hosted by via Eventbrite, and the screening on YouTube received the
Eric Kurland in 3D from his studio in Los Angeles, along with following attendance numbers of the two format options
a 3D cross to Andrew Woods in Australia for the introduction. combined:
 There were three identical staggered “live-stream” o Screening 1 (New York): 77
screenings of the 3D Theater session timed to suit attendees o Screening 2 (Tokyo): 33
in the Americas, Europe, and Asia. The session was free and o Screening 3 (Paris): 57
open to public, and started Saturday 16 January. o Total: 167
 The approximate mix of viewers watching in Full-3D vs.
 The 3D films, and which SD&A award they won, are listed anaglyph was: 60% / 40%.
below: An informal favorite amongst the producers was “All is
1. Stereo: A Love Song to 3D, Creator and star: Robert Not Lost” – see Figure 1. In 3D the film had a special extra
 Bloomberg; Motion graphics and co-animator: Pad dimension – pardon the pun.
 McLaughlin (USA),
 2018 Animation Award.
2. Albuquerque Balloon Festival – Mass Ascension, John
 Hart (USA),
 2019 Live Action Award.
3. White Knuckles, OK Go, OK Go (USA),
 2011 Live Action Award.
4. Amongst, Chisa Hidaka and Benjamin Harley (USA),
 2016 Live Action Award.
5. Chlamydomonas reinhardtii 3D – From Biological Cells
 to Biofuels, Niklas Biere, Bjorn Sommer (Germany /
 Australia),
 2016 Animation Award.
6. ENT3D Project Explained, Peter J. Casano, M.D. Figure 1. A still frame from 2012 Best of Show Award winner “All Is Not Lost”
 (USA), by OK Go and Pilobolus (USA).
 2020 Hybrid Award.
7. Chrysalis, Ina Conradi and Mark Chavez (Singapore), First Day
 2017 Animation Award. The first day of the conference had five technical
8. Ninety Three Million Miles, Site-Eye Time-Lapse Films sessions – three in the morning and two in the evening.
 (dir: Brian McClave and Gavin Peacock) (UK), The conference kicked off with a special invited session
 2013 Live Action Award. with two presentations. The first technical presentation of
9. The Simple Carnival – Go Away I Like You Too Much, SD&A 2021 was titled “Looking back at a wonderful decade
 Jeff Boller (USA), shooting live-action 3D” by Demetri Portelli, I.A.T.S.E.
 2019 Animation Award. International Cinematographer's Guild (Canada) – see
10. Interrupted Dreams, Aleksey Osipenkov (Russia), Figure 2. His presentation built upon his experience working
 2020 Animation Award. on multiple high-budget high-profile 3D movies as
11. Dead Boring 3D, Dave Edwardz, Australian Film and stereographer or stereoscopic supervisor.
 Television School (Australia),
 2011 VFX Award.
12. Morpheos Trailer, John Hart (USA),
 2014 Animation Award.
13. Formosa 3D, Charlie Chu (Taiwan),
 2018 Live Action Award.
14. Cochemare, Chris Lavis and Maciek Szczerbowski
 (Canada),
 2015 Animation Award.
15. All Is Not Lost, OK Go and Pilobolus (USA),
 2012 Best of Show Award.
16. The Whitewashing of 5 Pointz, Ben Schwartz (USA),
 2015 Live Action Award.
17. Little Planet in Stereoscopic 3-D, STEREOeYe / Figure 2. Demetri Portelli delivers his SD&A Invited presentation “Looking
 back at a wonderful decade shooting live-action 3D”.
 Takashi Sekitani (Japan),
 2020 Live Action Award.
 The second presentation of SD&A Invited session was
 titled “When 3D headache will be over: A decade of movie
 quality measurements” by Dmitriy Vatolin, Lomonosov

 IS&T International Symposium on Electronic Imaging 2021
B02-2 Stereoscopic Displays and Applications XXXII
32nd Annual Stereoscopic Displays and Applications Conference
Moscow State University (Russian Federation) – see In the evening there was an SD&A session on
Figure 3. Dmitriy and his colleagues have been doing an “Stereoscopic Content and Quality”, a short demonstration
amazing amount of work analysing and quantifying session for one of the papers, and the second SD&A Keynote
stereoscopic alignment anomalies and other metrics in presentation on “Digital Stereoscopic Microscopy” by Michael
theatrically released 3D films, and this presentation Weissman, SB3D Technologies, Inc. (United States) – see
overviewed this work. Figure 5. Michael’s presentation discussed the history of
 stereoscopic microscopy and future opportunities with new
 design techniques.

 Figure 5. Michael Weissman delivers his SD&A Keynote presentation “Digital
Figure 3. Dmitriy Vatolin delivers his SD&A Invited presentation “When 3D Stereoscopic Microscopy”. The image on the right is from his presentation and
headache will be over: A decade of movie quality measurements”. describes the first stereoscopic microscope developed in 1671.

 Completing the morning session were two sessions on Third Day
“Stereoscopic Developments” and “Stereoscopic Displays, The third day of the SD&A conference started with the
Cameras, and Algorithms”. second symposium-wide plenary session titled “The
 In the evening session things kicked off with a session on development of integral color image sensors and cameras” by
“Autostereoscopic Displays” followed by the conference’s Kenneth A. Parulski, Expert Consultant: Mobile Imaging
second keynote presentation, this time “Underwater 3D (United States).
system for ultra-high resolution imaging” by Pawel Achtel from In the evening there were two technical sessions of the
Achtel Pty Limited (Australia) – see Figure 4. Pawel’s Engineering Reality of Virtual Reality conference titled
presentation provided an important insight into the technology “Immersive Experiences” and “VR and 3D Applications” held
and analysis behind obtaining high-quality underwater 3D jointly with the SD&A conference.
visuals for the three Avatar movie sequels and other projects.
 Demonstration Session
 The 2021 SD&A Demonstration Session was held 6-8pm
 New York time on Wednesday 20 January. This year our
 Demonstration Chair Bjorn Sommer outdid himself by using a
 new online platform called “Gather.Town” to hold the session.
 The Demonstration Session has been an incredibly important
 part of the SD&A conference for almost the entire 32-year
 history of the conference. The Demonstration Session
 provides the opportunity for attendees to meet individually
 with authors, look at and hear about new technologies, and
 informally bump into other conference attendees and chat.
Figure 4. Pawel Achtel delivers his SD&A Keynote presentation “Underwater Most online conference platforms don’t reproduce this type of
3D system for ultra-high resolution imaging”. The image on the right in his atmosphere – mostly being suitable for lecture, seminar or
presentation is an underwater stereoscopic cinematography camera used to
film underwater sequences for the three Avatar sequel films.
 workshop type environments, but Gather.Town allows users
 to see each other in the hall but only talk to them via video
 and audio when they approach each other.
 The full listing of the individual presentation in these
 In preparation for the session, Bjorn setup a map which
sessions are listed on the conference program web page:
 reproduced the look of the usual SD&A Demonstration
 www.stereoscopic.org/2021
 Session hall – as can be seen in Figure 6. Presenters have
 tables around the hall and they are able to chat with attendees
Second Day when approached. Of course, this is all reproduced digitally.
 The second day of the conference started with a All attendees and presenters have an animated character
symposium-wide plenary session titled “Deep internal they can ‘walk’ around the map. When two (or more)
learning—Deep learning with zero examples” by Michal Irani, characters approach each other (within a nominated range)
Professor in the Department of Computer Science and an audio/video channel is activated, and they can see each
Applied Mathematics at the Weizmann Institute of Science other and talk to each other. The power of the platform is that
(Israel). multiple conversations can be happening in parallel without

IS&T International Symposium on Electronic Imaging 2021
Stereoscopic Displays and Applications XXXII B02-3
32nd Annual Stereoscopic Displays and Applications Conference
interrupting each other. Each of the presenters can be
individually video-chatting with people at their booth, and
equally attendees in the central part of the hall who are close
to each other can be chatting to each other there too.

 Figure 7. Chris Ward and Dan Lawrence from DepthQ demonstrated their
 DepthQ VR AQUA experience.

Figure 6. The SD&A Demonstration Session hall on Gather.Town.

 This year the demonstration session presenters and their
demonstrations were:
  Takashi Kawai from Waseda University (Japan)
 introduced an award ceremony held in a virtual space
 by the Japan Chapter of the Advanced Imaging
 Society titled “Application of 3D Avatars in a Virtual
 Event”
 Figure 8. Bjorn Sommer presented his new StereoCompass app which can be
  Chris Ward and Dan Lawrence from DepthQ (USA) used to plan and document stereo camera settings: Left: StereoCompass app,
 demonstrated their DepthQ VR AQUA experience Centre: Two analogue SLR cameras on a tripod; Right: Red-Cyan photo of the
 (see Figure 7). Magic Column of Peter Lenk in Meersburg.
  Bjorn Sommer from the Royal College of Art (UK)
 presented the working prototype for his paper Hybrid
 Stereoscopic Photography - Analogue Stereo
 Photography meets the Digital Age with the
 StereoCompass app” (see Figure 8).
  Andrew Woods from Curtin University (Australia)
 demonstrated the method of testing passive-polarised
 4K 3D TVs for correct operation using a simple test
 pattern.
  Eric Kurland from 3-D Space Museum (USA)
 demonstrated his live 3D video streaming studio
 solution which he used for the 2021 SD&A 3D
 Theater Session (see Figure 9,10,11). Figure 9. Eric Kurland from 3-D Space Museum demonstrated his live 3D
  Pawel Achtel from Achtel.com (Australia) presented video streaming studio solution using OBS Studio and other tools. You will
 his 3D Film Services and Equipment for Giant Screen also notice Eric’s Gather.Town booth was crowded with attendees – bottom-
 left of image.
 and IMAX Cinema.

 IS&T International Symposium on Electronic Imaging 2021
B02-4 Stereoscopic Displays and Applications XXXII
32nd Annual Stereoscopic Displays and Applications Conference
Figure 12. Associate Professor Ramesh Raskar is awarded the Electronic
Figure 10. Eric Kurland from 3-D Space Museum demonstrated the audio Imaging 2921 Scientist of the Year by EI 2021 chair Jonathan Phillips.
mixing solution he was using tor his live 3D video streaming
 Also receiving an award at this event was long-time
 SD&A conference attendee, and also SD&A Keynote
 alumnus, Kurt Hoffmeister who was presented with an IS&T
 Honorary Membership by IS&T President Scott Silence – see
 Figure 13.

Figure 11. Eric Kurland was streaming himself in anaglyph 3D and some of
the attendees were wearing their anaglyph 3D glasses to see Eric in 3D.

 During the demonstration session attendees could be
seen wandering the hall, visiting all the booths, and having a
fun time chatting with exhibitors – all whilst in lock-down.

Second Week
 In the subsequent week, as well as more EI conferences Figure 13. Kurt Hoffmeister receives his Honorary Member award from IS&T
 President Scott Silence.
and more EI technical presentations, there were two
additional symposium-wide plenary presentations:
  “Making invisible visible” by Associate Professor Discussion
 Ramesh Raskar, MIT Media Lab (United States), and Many individuals and companies contribute each year in
  “Revealing the invisible to machines with various ways to make the SD&A conference a successful
 neuromorphic vision systems: Technology and event.
 applications overview” by Luca Verre, CEO and Co- Most importantly, we thank the conference authors and
 Founder at Prophesee (France). attendees, who make this meeting such a successful event.
 Importantly the EI Symposium was also very pleased to Thanks to the demonstration session presenters for
be able to award Professor Raskar with the 2021 Electronic bringing equipment to show – especially to the presenters
Imaging Scientist of the Year Award! (See Figure 12) who brought equipment from overseas.
Professor Raskar presented a keynote presentation at the We are grateful to all of the providers of 3D content for
SD&A conference in 2011 and we were very pleased to see allowing their content to be shown to the conference audience
him receive this year’s award. at the 3D Theater Session.
 The conference committee plays an important role
 throughout the year, ensuring the correct technical direction
 of the meeting. Sincere thanks go to our founding chair, John
 Merritt, and our committee: Neil Dodgson, Justus Ilgner, Eric
 Kurland, Bjorn Sommer, John Stern, Chris Ward and Laurie
 Wilcox.
 Thanks also to the staff at IS&T - the organizing society
 instrumental in organizing all manner of aspects for the

IS&T International Symposium on Electronic Imaging 2021
Stereoscopic Displays and Applications XXXII B02-5
32nd Annual Stereoscopic Displays and Applications Conference
meeting – and in particular Suzanne Grinnan, Marion The 2022 SD&A conference will continue a tradition of
Zoretich, Ann McCarthy and Donna Smith. presenting and demonstrating the latest technologies relevant
 This was a very different year for SD&A so we wish to to stereoscopic displays and applications. Please consider
thank everyone for adapting so quickly to the new attending, presenting, or demonstrating at the 2022 event. We
circumstances and attending virtually. Despite the rolling time hope to see you there – either online or in-person!
zones, some of our attendees attended all of the SD&A
sessions, regardless of their regular sleeping pattern. Author Biographies
 Conference activities do not stop at the end of the annual Andrew Woods is an Associate Professor at Curtin University where he
meeting. The SD&A conference website and LinkedIn group manages the HIVE visualisation facility and is a Research Engineer at the
provide a focus for conference activities during the time Centre for Marine Science & Technology. He specialises in visualisation,
between conferences. We will soon be actively seeking stereoscopic 3D imaging, 3D reconstruction, 3D cameras and displays,
abstracts for the 2022 conference, with a submission deadline video electronics, underwater vehicles (ROVs), and engineering software
in mid-2022 – see the Electronic Imaging website development, with applications in offshore oil and gas, and maritime
www.ElectronicImaging.org and the SD&A website archaeology. He has BEng and MEng degrees in electronic engineering
www.stereoscopic.org for details and deadlines. and his PhD was on the topic of crosstalk in stereoscopic displays. He was
 The SD&A website also has an extensive collection of the technology lead on the Sydney-Kormoran Project which surveyed the
photographs highlighting the activities of past conferences. In wrecks of HMAS Sydney (II) and HSK Kormoran in 2015, and imaging
addition, the website hosts the stereoscopic virtual library, lead for the survey of the wreck of HMAS AE1 in 2018. In 2017 he was
which contains several historically important books that have recognised as one of Australia's Most Innovative Engineers by Engineers
been digitized, in full, into PDF format, and are available for Australia. He has been co-chair of the Stereoscopic Displays and
free download. Applications conference since 2000.
 The SD&A conference maintains a Tweeter feed at Nick Holliman is Professor of Visualization at Newcastle University
@SDnAconf to keep everyone informed about SD&A events researching the science and engineering of visualization and visual
and activities. Check out the conference Twitter feed for analytics including the fundamental challenges of visualizing big data. This
details: includes working with psychologists to understand how the human visual
 system processes information, developing novel computational algorithms
 https://twitter.com/SDnAconf for the control of image content and demonstrating how these algorithms
 work in practice in cloud-based software tools and award winning
 The SD&A conference also has a LinkedIn group which stereoscopic 3D visualizations. He has worked in both industrial and
is available at: academic environments and is experienced in delivering commercial
 impact from research outputs.
 www.linkedin.com/groups?gid=1945944
 Gregg Favalora is Group Leader: Sensors and Imaging Systems at Draper
 (Cambridge, MA, USA) where his work includes the development of
 Let’s also not forget the SD&A conference announce-only
 electroholographic light modulator systems. He holds a BS (EE) from Yale
mailing list. Visit here to sign up:
 University and an SM from Harvard University. From 1997 - 2009, Gregg
 was CTO of autostereoscopic display developer Actuality Systems, Inc.,
 https://lists.curtin.edu.au/mailman/listinfo/sdalist which created the Perspecta volumetric display and other advances in
 visualization.
 Since this year’s event was online, there aren’t as many
photographs as we usually take – apart from the ones that are Takashi Kawai is a Professor in the Department of Intermedia Art and
included in this document. Photographs from previous SD&A Science, Faculty of Science and Engineering, Waseda University, Japan.
conferences are available in a special album on Flickr: He received his Ph.D., M.A. and B.A. in Human Sciences from Waseda
 University in 1998, 1995 and 1993, respectively. His research interests
 https://www.flickr.com/photos/124926259@N05/albums/ include ergonomics and human factors in advanced imaging technologies
with/72157665961383588 such as stereoscopic imaging, virtual / augmented / mixed reality and
 cross-modal systems. He is a Certified Professional Ergonomist (CPE).
 You can visit the conference website to gain an Bjorn Sommer is a Research Tutor at the Royal College of Art (London)
understanding of the past, present, and future of stereoscopic where he is leading Year One of the Innovation Design Engineering
imaging. Please think now about submitting a paper or program. He is working on Immersive Analytics of collective behaviour as
attending next year’s conference. The Stereoscopic Displays well as mesoscopic and molecular data modelling and visualization. He
and Applications conference website is at: has experience since more than a decade in the development of 3D-
 www.stereoscopic.org stereoscopic applications. He holds a B. Sc. in Media Informatics, an M.A.
 in Interdisciplinary Media Sciences, and a PhD in Bioinformatics from
Conclusion Bielefeld University. From 2015-2016 he was working as a Research
 Next year’s SD&A conference will be held in January Fellow at Monash University (Melbourne), and from 2016-2019 at the
2022 as part of annual IS&T Electronic Imaging Symposium. University of Konstanz.
At this stage the event is planned to be a hybrid online and in-
person event. The in-person event will be held at the Parc 55
San Francisco Hotel in downtown San Francisco, California.
The hotel is within one block of the Powell Street BART station
which provides easy access to San Francisco International
(SFO) airport.

 IS&T International Symposium on Electronic Imaging 2021
B02-6 Stereoscopic Displays and Applications XXXII
32nd Annual Stereoscopic Displays and Applications Conference
JOIN US AT THE NEXT EI!

 IS&T International Symposium on

 Electronic Imaging
 SCIENCE AND TECHNOLOGY

Imaging across applications . . . Where industry and academia meet!

• SHORT COURSES • EXHIBITS • DEMONSTRATION SESSION • PLENARY TALKS •
• INTERACTIVE PAPER SESSION • SPECIAL EVENTS • TECHNICAL SESSIONS •

 www.electronicimaging.org
 imaging.org
32nd Annual Stereoscopic Displays and Applications Conference 32nd Annual Stereoscopic Displays and Applications Conference 32nd Annual Stereoscopic Displays and Applications Conference
You can also read