Reimagining futures: Collaborations between artists, designers, and scientists as a roadmap to help solve the climate crisis

Page created by Ricky Wheeler
 
CONTINUE READING
Reimagining futures: Collaborations between artists, designers, and scientists as a roadmap to help solve the climate crisis
Tosca, MG, et al. 2021. Reimagining futures: Collaborations between artists,
                                                             designers, and scientists as a roadmap to help solve the climate crisis.
                                                             Elem Sci Anth, 9: 1. DOI: https://doi.org/10.1525/elementa.2021.00016

RESEARCH ARTICLE

Reimagining futures: Collaborations between
artists, designers, and scientists as a roadmap to
help solve the climate crisis
Mika G. Tosca1,2,*, Adrian Galvin2, Ilai Gilbert1, Kelvin L. Walls II1, Grant E. Tyler1,
and Abigail M. Nastan2

                                                                                                                                            Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
As the climate crisis intensifies amid some persistent public denial of the science, there exists a necessary
opportunity for scientists to engage in transdisciplinary collaborations, such as those with artists and
designers, in an effort to both improve the communication of climate science, but also to bolster the
production of scientific knowledge. We demonstrate how art and design can activate the human
imagination and promote collaboration across disciplines in a way that the post-Enlightenment scientific
endeavor has historically been unable to do and can provide a framework for developing sustainable
solutions to the climate crisis. Here, we describe 2 studies that involved collaboration between artists and
designers and climate scientists. The first study paired a team of designers and computer scientists with
climate and atmospheric scientists from the Jet Propulsion Laboratory in an effort to (re)build an exploratory
research interface for the Multi-Angle Spectroradiometer Plume Height Project dataset.This project not only
produced an aesthetic visualization interface with highly improved functionality, but it also demonstrated
how an improved interface can enable scientists to pursue more and “better” research hypotheses. For the
second study, we worked with artists at the School of the Art Institute of Chicago to create three sonic-
based art pieces that effectively communicated the science of climate change, appealed to human aesthetic
judgment, and expanded the scope of our “ecological awareness.” We show that, while collaborations between
artists and scientists are not necessarily novel, the integration of art, design, and science from a project’s
inception can improve both the production of knowledge and constitute an entry point for regular people to
understand and engage with their rapidly changing planet.

Keywords: Imagination, Climate crisis, Art and science, Human-centered design, Sustainable futures

1. Introduction                                                      limitless potentiality of human imagination in a way that
The science fiction novel Parable of the Sower, by Octavia           the post-Enlightenment scientific endeavor has histori-
Butler, follows a young woman as she remakes her life and            cally been less able to do can provide a framework for
rebuilds society in the wake of devastating climate change.          developing sustainable solutions to the climate crisis. In
In this work—and in all of her novels—Butler implores us             this article, we explore the ways that science, art, and
to use our imaginations as her characters construct new              design can be combined to accomplish this. After a brief,
worlds in the ruins of environmental disaster. As Pough              3-year stabilization of the increase in annual global green-
and Hood (2005) note, Octavia Butler often posits in her             house gas emissions offered hope for the climate crisis
public speeches that “science fiction is not only about the          (Jackson et al., 2016; Jackson et al., 2017), annual anthro-
problems of the world, but also about solving problems of            pogenic carbon emissions grew almost 3% in 2018 and
the world,” a sentiment, when expanded to include the                reached their highest recorded level in human history
broader art world, suggests an important role for art in             (Jackson et al., 2018; Le Quéré et al., 2018). Although the
confronting the urgency of climate change. We surmise                coronavirus pandemic, which began in late 2019 and en-
that the propensity of art and design to harness the                 gulfed the planet in 2020, catalyzed a historically unprec-
                                                                     edented reduction in carbon emissions (Liu et al., 2020),
1
    Department of Liberal Arts, School of the Art Institute of       researchers agree that because this reduction came pri-
    Chicago, Chicago, IL, USA                                        marily from the transportation sector, it is not likely to
2
    Jet Propulsion Laboratory, California Institute of Technology,   persist once the world recovers from the pandemic in
    Pasadena, CA, USA                                                2022 (Quéré et al., 2020).
* Corresponding author:                                                 The running mean globally averaged temperature is
Email: mtosca1@saic.edu                                              more than 1 C warmer than it was 120 years ago (Hansen
Reimagining futures: Collaborations between artists, designers, and scientists as a roadmap to help solve the climate crisis
Art. 9(1) page 2 of 15                                        Tosca et al: Reimagining futures: Art, design, and climate science

et al., 2010; Hawkins et al., 2017; http://www.columbia.          hypothesize that the intersection of art, design, and sci-
edu/~mhs119/Temperature/) and continues to increase at            ence is likewise a similarly fruitful territory for exploration
rates never experienced by humankind (Hansen et al.,              and productivity. And while our approach in this work is
2006). Consequently, the impacts of climate change are            not entirely novel—designers have been working with
no longer the hypotheticals of future dystopian narratives.       scientists for years (e.g., Ito, 2016)—the collaborations
Sea levels are rising at accelerated rates (Church and            described in this article expanded on previous attempts
White, 2006; Cazenave and Llovel, 2010), disease is               in a comprehensive and unique way. We also note that
spreading (Rocklöv and Dubrow, 2020), extreme storms             interdisciplinary fields that are proximal to climate sci-
are becoming more common (Reidmiller et al., 2018),               ence—such as sustainability science—have long employed
drought is multiplying (Cook et al., 2018), and heat waves        interdisciplinary collaboration in pursuit of creative solu-
are becoming increasingly dangerous (Hayhoe et al., 2010;         tions to complex problems (Haider et al., 2018).
Mitchell et al., 2016), to name a few. The challenges pre-            Integral to our hypothesis is an augmentation of the
sented by these individual impacts, however, are com-             scientific method with principles from the design method
pounded by the complexity, unpredictability, and                  (Figure 1). A simplified model of the scientific method
nonlinearity of interactions (and cascading effects) among        (depicted in Figure 1) posits that the generation of scien-

                                                                                                                                    Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
and within the climate system (Rocha et al., 2018; Lenton         tific knowledge begins with a hypothesis, continues with
et al., 2019; Keys et al., 2019). A recent report by Spratt et    experimentation and analysis, and concludes with the
al. (2019) goes as far as to suggest that the climate crisis      publication and/or presentation of results. Despite the
may pose an existential risk for the continuation of              similarities between the design process and the scientific
human civilization.                                               method, artists and designers routinely initiate a new pro-
    And yet, much of this knowledge remains abstruse,             ject with a robust “understanding” phase where they
cumbersomely documented, and opaquely presented                   engage with stakeholders and users to empathize with,
(sometimes deliberately so by fossil fuel propagandists),         learn from, and listen to their concerns and desired out-
making engagement with it by nonscientists difficult. This        comes. This initial human engagement step is unique to
is likely one reason why many English-speaking people             the design process and is integral to the creation of a de-
across the globe remain convinced that human beings are           signed object. We contend, in this article, that it can be
not responsible for the observed 20th and 21st century            equally influential in the production of scientific knowl-
climate change (Goldberg et al., 2019; https://www.ipsos.         edge. If nothing else, collaborations across radically un-
com/en/global-trends-2020-understanding-complexity).              ique disciplines can inspire “out-of-the-box” thinking that
Perhaps this is also why a recent poll of Americans by Pew        results in improved outcomes. Commercial designers who
Research found that, while 89% of respondents thought             engage with scientists sometimes call this first step “front
scientists were “intelligent,” only 54% of respondents            end development,” and it has proven to be an effective
thought of them as “good communicators” (https://                 strategy. In the case of many large-scale environmental
pewrsr.ch/2Z2lX8S).                                               sensing platforms, such as satellites or meteorological net-
    Scientists, artists, and designers therefore have an excit-   works, the absence of this engagement can limit the utility
ing and necessary opportunity to collaborate. While much          and reach of the data beyond the technical experts in the
has been written of the benefits of effective visualization       field. Figure 1 is similar to—and inspired by—Figure 2
for the communication of scientific research—and there            from Purdy et al. (2019), an indication that this augmen-
appears to be some movement among scientific institu-             tation of the scientific method has been proposed by
tions to recognize the importance of storytelling and             other scientists and is a credible approach.
design—little has been published about the ways that de-              In this article, we describe 2 case studies that pursued
signers and artists may participate in and contribute to the      collaboration between artists, designers, and climate
process of scientific knowledge generation within the             scientists in support of our thesis. The first study, con-
framework of the scientific method (Board, 2018; Adam,            ducted between 2018 and 2020 under a grant awarded
2020). This article builds on previous work by Galafassi et       by the California Institute of Technology (Caltech),
al. (2018) and Pereira et al. (2019) and explores the me-         brought together a team of designers and computer scien-
chanisms by which design practice and artistic abstraction        tists with climate and atmospheric scientists from the
can be leveraged not just for improved communication              Multi-angle Imaging Spectroradiometer (MISR) instru-
but also for enriched production of scientific knowledge          ment group to collaboratively build a new exploratory
and stimulation of scientific imagination. Wetlands, as           research interface for the MISR Plume Height Project
a transition biome, are an appropriate metaphor to                (MPHP) dataset and then explored whether that process,
describe the possibilities that arise from collaborations         and the new interface, sparked more (and better) mo-
between artists, designers, and scientists. Wetlands are          ments of scientific insight. During the assembly of this
transition zones between permanently terrestrial and per-         interface, the principles of design and science were inte-
manently aquatic biomes and are known for their distinc-          grated from the project’s inception. For the second study,
tively high biodiversity, as well as their ability “to cleanse    we worked with young artists at the School of the Art
polluted waters, protect shorelines, and recharge ground-         Institute of Chicago (SAIC) in an effort to create three
water aquifers” (Mitsch et al., 1986). Wetlands are uniquely      distinct sonic art pieces that effectively communicated the
productive precisely because they occur at the intersection       science of climate change, appealed to human aesthetic
of radically different biomes (Gosz and Sharpe, 1989). We         judgment, and expanded the scope of what philosopher
Reimagining futures: Collaborations between artists, designers, and scientists as a roadmap to help solve the climate crisis
Tosca et al: Reimagining futures: Art, design, and climate science                                          Art. 9(1) page 3 of 15

Figure 1. A comparison of the human-centered design process (top) and a simplified depiction of the

                                                                                                                                     Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
  scientific method (bottom). The design process begins with extensive conversation and collaboration with
  stakeholders and community members in what is described as the understand phase. This is followed by an
  ideation phase (ideate), a prototyping phase (prototype), and then finally a refinement (refine) and production
  phase (materialize). Similarly, the scientific method (depicted here in simplified form) begins with a hypothesizing
  phase, where preliminary research often leads to the formulation of a question, which is analogous to the Ideation
  step of the design process and typically entails scientists engaging with preliminary data to form a hypothesis,
  continues with an experiment phase (analogous to prototype) and ends with a conclude phase (analogous to
  refine). We argue that the scientific method would be better served if it also included an understanding phase as
  a precursor to hypothesizing (depicted here by the box with the question mark). DOI: https://doi.org/10.1525/
  elementa.2021.00016.f1

Timothy Morton calls our “ecological awareness” (Morton,             The main consideration for any researcher is discovery.
2013). In this article, we discuss that while collaborations         Arriving at an insight often sparks the critical break-
between artists, designers, and scientists are not necessar-         through that leads to discovery: suddenly seeing some-
ily novel, the integration of art, design, and science from          thing that previously passed unnoticed or seeing
a project’s inception can improve both the production of             something familiar in a new light. The primary function
knowledge and constitute an entry point for “regular”                of any visualization and analysis tool is to make it easier
people to intuitively understand the world in which they             for an investigator to glean insight.” Saraiya et al. (2005)
live. The examples presented in this article illustrate how          submit that effective visualization allows insight into da-
transdisciplinary collaborations can challenge and                   tasets that can seem impenetrable—or at least exceedingly
enhance the traditional ways that climate scientists have            impractical to comprehend analytically or numerically—
constructed and communicated vital information about                 and they describe a methodology for assessing the efficacy
the climate crisis.                                                  that a visualization system has to stimulate scientific
                                                                     insight. In this case study, we expanded the scope of these
2. Case Study 1: A design-driven reimagination                       conclusions and explored whether designers can spark
of climate data visualization software                               moments of insight for scientific researchers by creating
2.1. Background                                                      visual forms that literally show the researcher their data in
We posit that designers, as specialists in the visual repre-         a novel way.
sentation of data, can provide tangible support to a scien-             Researchers from the University of Washington Interac-
tific research team by creating visualizations that                  tive Data Lab conclude that significant interface latency
harmonize the way that climate researchers think and                 decreases user activity and dataset coverage by depressing
work with approachable aesthetics. This study, led by                rates of observation, generalization, and hypothesis dur-
designer A. Galvin, climate scientist M. Tosca, and applied          ing exploratory research tasks (Liu and Heer, 2014). This
science systems engineer Abigail Nastan (at the Jet Propul-          statement can seem obvious to some. It is unsurprising to
sion Laboratory [JPL]), extended the capacities of an exist-         conclude that slower visualization systems reduce explo-
ing data delivery system in the service of improved climate          ration; however, the authors argue for a deeper, more
research production. Follow-on qualitative experiments               impactful, and surprising conclusion. They demonstrate
suggested that this approach enabled researchers to ask              that the inverse of the previous statement is also true:
new and “better” questions of their data.                            Systems that respond at the speed of a researcher’s
    This study supports conclusions made by other visual-            thoughts enable greater dataset coverage by increasing
ization usability researchers operating in transdisciplinary         rates of observation, generalization, and hypothesis (O’Do-
spaces. Namely, Saraiya et al. (2005) establish fundamen-            noghue et al., 2018).
tal definitions for insight and discovery and conclude that             Human–computer interaction and visualization
“a primary purpose of visualization is to generate insight.          researcher Dr. Scott Davidoff, manager of the human-
Art. 9(1) page 4 of 15                                     Tosca et al: Reimagining futures: Art, design, and climate science

                                                                                                                                Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
Figure 2. Sketches made during contextual inquiry. These sketches were made by designer Adrian Galvin during the
  “understand” phase (left column) and “ideation” phase (right column) of the design process (e.g., Figure 1 top). The
  sketches on the left were made by the designer as he listened to climate scientists describe the Multi-angle Imaging
  Spectroradiometer instrument. These sketches are Adrian’s interpretation of the information. The sketches on the left
  were made by Adrian Galvin during the “ideate” and “prototype” phases of the design process. The top right panel is
  a sketch of what the designers thought the final redesigned web interface could look like, and the middle right panel
  is a revised sketch of what the web interface could look like based on feedback from the scientists to the top right
  sketch. The bottom right photo is computer software engineer Jared Boone sketching the potential new web interface
  on a whiteboard during the Prototype phase. DOI: https://doi.org/10.1525/elementa.2021.00016.f2

centered design group (https://hi.jpl.nasa.gov/) at the JPL,      The MISR instrument team at the NASA JPL is a group
takes these conclusions a step further in both informal        of scientists, engineers, and software specialists who col-
magazine articles (e.g., https://plasma-magazine.com/          lect, format, host, and distribute imagery data collected by
2019/06/12/visualize-your-science/) and personal corre-        the NASA TERRA satellite (Diner et al., 1998). The instru-
spondence with the authors. He argues that improve-            ment, which circles the entire planet from pole to pole
ment of a visualization system does not necessarily            every 90 min, is a passive sensor that measures the
lead researchers to the same conclusions faster; rather,       amount of solar radiation that is reflected from surface
it enables them to reach more—and “more novel”—con-            and atmospheric features in each of 4 spectral bands cen-
clusions. This axiom supports the idea that there is a rich    tered at 446 (blue), 558 (green), 672 (red), and 866 nm
territory of opportunity in which designers, through           (near infrared, NIR) wavelengths from 9 distinct cameras.
novel visualization, can have a catalyzing impact on sci-      The cameras are fixed to unique angles ranging from
entific research.                                              directly overhead (nadir) to 70.5 forward and afterward
Tosca et al: Reimagining futures: Art, design, and climate science                                           Art. 9(1) page 5 of 15

of nadir. The MISR Interactive Explorer (MINX) software              First, in spite of their expertise, the climate scientists knew
applies a stereoscopic algorithm (e.g., Figure 2) to these           little or nothing about the design process, and, second,
multiangular data and calculates, among other things, the            the amount of knowledge exchange necessary for effective
altitude of smoke plumes produced by landscape fires                 collaboration between a designer and a scientist was
(Nelson et al., 2008; Nelson et al., 2013). MINX has been            greater than between a designer and a nonexpert. During
used to analyze smoke plumes in North America (Val Mar-              the contextual inquiry/understanding phase, our de-
tin et al., 2010), equatorial Asia (Tosca et al., 2011; Zender       signers had to process large volumes of information and
et al., 2012), Australia (Mims et al., 2010), and Alaska             then identify the relevant information.
(Kahn et al., 2008) among others. Prior to performing                    Since this study extended the capacities of an existing
altitude calculations, MINX utilizes a graphical user inter-         system in the service of researchers, A. Galvin and his
face (GUI) that requires a human being to make choices               design team applied a multimodal course of discovery
about which smoke plumes should be digitized (Nelson et              tactics in order to ascertain from their scientist collabora-
al., 2013).                                                          tors where they thought the opportunities were. Specifi-
    Beginning in the summer of 2013 (and continuing                  cally, to overcome the challenge of deciphering the
through 2019), scientists at the JPL used MINX to manu-              overwhelming quantity of specialized information, the

                                                                                                                                       Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
ally collect the locations and properties (including alti-           design team used a specialized type of sketching—called
tude) of more than 70,000 fire smoke plumes occurring                “reflective sketching”—applied as a follow-up to any con-
around the globe in an effort to construct a comprehensive           textual inquiry, interview, or codesign activity. The goal of
dataset of smoke plume heights (Val Martin et al., 2018).            this approach was to categorically distill, interpret, and
This dataset, dubbed the Plume Height Project (MPHP;                 then reassemble the scientific information that the de-
https://.jpl.nasa.gov/getData/accessData/MinxPlumes2/),              signers received from the climate scientists onto sketch-
begins in 2008 and currently includes over 4 full years of           book pages which captured what the designer(s) believed
data. These data are critical for understanding the complex          to be the key information. The left column of Figure 2, for
and regionally divergent relationship between smoke                  example, shows sketches made by A. Galvin depicting his
plumes and climate and how that relationship will evolve             interpretation of the information he received from con-
in a warming world.                                                  versations with the scientists about the MISR instrument.
    Prior to the initiation of this study, the MPHP, despite         The sketches were then presented to the scientists in a fol-
its clear utility, was vastly underused by the global com-           low-up conversation, a step that allowed the designer(s) an
munity of climate and atmospheric scientists because the             opportunity to substantiate and clarify the accuracy and
data were stored in a difficult to access archive as individ-        pertinency of the information received. This process al-
ualized, confusing text files. The interface for exploring           lowed the team to not just make progress toward the
these data was old, designed by software scientists at JPL,          redesign of the data delivery interface but also to under-
and did not provide sufficient visual feedback, filter con-          stand how scientists construct knowledge about the phe-
trol, abstract high-level visualization, or download func-           nomena that they study. As a result, this project expanded
tionality. To address these obvious deficiencies, first              beyond the initial creation of a new visualization system
identified by scientists M. Tosca and A. Nastan, the science         and subsequently catalyzed a series of insight-focused
team applied for (and received) a generous “Data to Dis-             usability studies, an in situ longitudinal workflow analysis,
covery” art, design, and science grant from the California           and a descriptive insight process questionnaire.
Institute of Technology, in partnership with California                  Sketching had several additional advantages and is
Institute of the Arts. Designer A. Galvin was then added             something that can easily be replicated and employed
to the project and worked with a team of designers, com-             by other research teams. First, visually articulating the
puter scientists, and climate and atmospheric scientists             received information onto a sketchbook page helped the
during the summer of 2018 to build an effective explor-              designers refine and codify the design team’s conceptual
atory research interface for this data product, which aimed          understanding of the problem and eased the recall and
to improve on the existing interface in all of the previously        application of the new knowledge at a later time in the
mentioned dimensions. The end result of this endeavor                design process. Second, the sketchbook, as an external
was the creation of the Exploratory Research and Lookup              artifact, provided the climate scientists with context into
Interface (MERLIN), which now joins a long and illustrious           the design process and helped them offer more concrete
line of software named with nested acronyms (a NASA                  feedback on the progression of the project. This collabo-
specialty).                                                          ration showed that future users (aka the climate scientists)
                                                                     of the designed object were more willing to critique a de-
2.2. Contextual inquiry, human engagement, and                       signer’s sketch than to critique a designer’s interpretation
reflective sketching                                                 of information in direct conversation. Third, the sketches
Designer A. Galvin and his team of 3 began this project by           themselves focused the direction of the collaboration, so
first engaging in an exhaustive period of human engage-              that the ongoing conversation between scientists and de-
ment and contextual inquiry (e.g., the first step in the             signers did not divert from the narrowly defined task.
design process described in Figure 1). Climate scientists            Fourth, the sketches provided users clear visual evidence
possess an immense breadth of information in order to                of how the scientific information they shared was inter-
perform their work, but this specialized expertise pre-              preted by the designer, perpetuating a feedback loop
sented 2 challenges to our collaborative design team:                which was useful throughout the development and
Art. 9(1) page 6 of 15                                       Tosca et al: Reimagining futures: Art, design, and climate science

progression of a close and long-term relationship between       column of Figure 2) as the design team worked through
the scientists and designers. Finally, the sketches helped      various iterations of how the new interface would look
build consensus among the design team and set a standard        and work. At the conclusion of each iteration, the design
for what the team considered to be the most crucial in-         team met with the science team to assess whether the
sights and information as the project moved on to subse-        project was still on track to meet their needs, as well as
quent phases.                                                   to contextualize the harmony between the designed ele-
    Lawson (2004) notes the importance of sketching for         ments and their own research process. As the design
design and discusses 3 methods of sketching that closely        became more detailed and appropriately adapted, it
correspond to the reflective sketching that A. Galvin and       merged effective scientific utility with aesthetic beauty,
his team used for this project. Lawson (2004) first de-         suggesting that the strict societal dichotomy between “art”
scribes presentation drawings, in which a designer              and “science” is not based in reality.
“communicate(s) their work to clients and others from               The ideation phase of design was intended to expand
whom they may need some agreement, consent or per-              the solution space after the human needs and scientific
mission to continue.” This type of sketching similarly in-      context had been sufficiently understood in the first step.
volves a conversation between designers and “users”

                                                                                                                                  Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
                                                                The design team, led by A. Galvin, produced as many ideas
(analogous to the climate scientists in our work). However,     as possible in ultralightweight whiteboard sketches, at-
reflective sketching is not meant to act as persuasion, and     tempting to push the space of design as wide as possible
we worked tirelessly to ensure that they were, in fact,         while maintaining connection to the core understanding
a nonpersuasive part of the dialogue. The right column          of the climate scientists’ needs. Artifacts created during
in Figure 2 displays a few examples of reflective sketching     this phase were as ephemeral as possible, allowing the
that might be considered similar to these “presentation         team to move quickly, and define as large a territory as
drawings.”                                                      possible. The ideation phase used here was nearly analo-
    Lawson (2004) also introduces “proposition drawings,”       gous to the process that scientists engage in when they
which are similar to Donald Schön’s classical description      generate and revise hypotheses before moving to more
of drawings as a space of conversation for the designer,        detailed analysis (Figure 1). Following each ideation, the
which he refers to as “reflection-in-action.” The syntactic
                                                                design team met with the climate scientists in a modified
similarity is no mistake: Both the “reflective sketching”
                                                                continuation of the human engagement and contextual
used by A. Galvin and Schön’s reflection-in-action rely
                                                                inquiry process that preceded ideation.
on reflection as process. In Schön’s formulation, a designer
                                                                    After the expansive ideation phase, the experimental
progresses through the design method by continuously
                                                                prototype phase aimed to iteratively increase the fidelity
adding information to an initial sketch and then consid-
                                                                of the most promising pathways while identifying the
ering whether the added information is in harmony or
                                                                flaws in the least effective ideas and eliminating them
conflict with the intent of the future designed object. If
                                                                from the pool of potential design candidates until a sci-
the added information is harmonious, the designer pre-
                                                                entifically meaningful and visually clear set of core
serves the sketch and continues to draw. This method
                                                                design propositions were selected. One of the most crit-
ensures that a conversation continues between designer
                                                                ical characteristics of these core design proposals was
and sketch; a conversation that becomes a kind of exper-
imental dance that, over time, builds a coherent image.         that they must facilitate exploration and should help the
The sketches in Figure 2 can also function as analogies of      science team glean insight from the data more rapidly
these “proposition drawings.”                                   and effectively. In this project, these proposals served as
    Ultimately, the intent of sketching—in this project and     an intermediary between higher order analysis of physi-
for all future projects—was to maintain a conversation          cal climate phenomena and the ability to interact with
between designer and scientist and to distill relevant sci-     cumbersome and difficult-to-manage datasets. As com-
entific information into a coherent, agreed-upon aggrega-       puting power and storage capacity have increased in
tion of knowledge that influenced the design. Close             recent decades, the size and complexity of climate data-
collaboration between scientists and designers—especially       sets has also grown. Most physical climate scientists are
in this initial stage—was the only way we could ensure that     not explicitly trained to manipulate large datasets
the outcome would be acceptable to all stakeholders. The        (though many do learn several computer programming
sketches described in this section are a low cost, simple       languages and how to operate within a Unix operating
way that science teams can incorporate more                     system). The ever-expanding size of these datasets has
“understanding” into the initial step of the scientific         made them impractical to explore and comprehend
method (as proposed in Figure 1).                               freely, which has substantially slowed the process of
                                                                insight formation (Saraiya et al., 2005). The design team’s
2.3. Ideation, prototyping, and refinement                      user-centered approach of understanding human needs,
Following the contextual inquiry phase, A. Galvin and his       exploring as great a range of design propositions as pos-
design team assumed full control of the direction of the        sible, and testing each proposition until the most prom-
project, progressing through the ideation, prototyping,         ising candidates were identified (and made high fidelity),
and refinement phases described in Figure 1. Sketching          allowed for the creation of a coherent set of solutions
was still utilized during ideation and prototyping, but it      which, through their contextual clarity, simultaneously
became more focused and less abstract (e.g., the second         achieved scientific validity and aesthetic beauty.
Tosca et al: Reimagining futures: Art, design, and climate science                                          Art. 9(1) page 7 of 15

    Although the goal of this project was to produce                 can be found at A. Galvin’s project space: http://
a web-based data delivery interface, the first prototype             adriangalvin.space/merlin. We show that a designer can
was completed using paper and pen only (Figure S2).                  function as a useful component of a research team, recur-
Generally speaking, a science research interface pre-                sively introducing visual forms that have the potential to
sents unique challenges for a design team in the pro-                spark novel or unexpected moments of insight. This state-
totyping phase because real data must be used in the                 ment was especially true when designers were involved at
prototype in order to gain any insight. For this project,            the initiation of the research process. Generally speaking,
those challenges necessitated a close, flexible collabo-             data visualizations of appropriate clarity and flexibility
ration between the designers and the computer scien-                 allow scientists to offload some of the cognitive work of
tists. Computer programmer Jarod Boone first created                 understanding complex datasets prior to more detailed
a flexible, searchable postgreSQL and Django database,               analysis. This then allows for an examination of more
which, if queried appropriately, returned basic visualiza-           complicated phenomena and eliminates the need for
tions, but had no GUI. After consulting the science                  abstruse and laborious data partitioning prior to any
team’s most prominent research papers, A. Galvin imag-               climate-driven analysis.
ined realistic workflows and worked with J. Boone to                    Our initial hypothesis proposed that a visualization

                                                                                                                                      Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
create hybrid prototypes that allowed the science team               interface of appropriate clarity would allow researchers
to make real observations, detect interesting anomalies,             to access understanding that they might not otherwise
and gain insights. This hybrid prototyping technique                 have been able to. After the initial construction of MERLIN
involved realistic data and interface components that                in the summer of 2018, we tested whether more and
were often presented to the scientists using sticky notes            “better” novel insights could be generated via the rede-
with permanent marker drawings. This removed aes-                    signed interface and whether scientists were able to con-
thetic distractions and allowed the scientists to focus              nect those insights into a coherent story or hypothesis. To
entirely on the data, while the design team continued                test this, we designed 3 qualitative investigations. First, we
to imagine and test those interface components that                  asked climate scientists who use the MPHP to substitute
would be most useful. Each new prototype became                      the new interface for the old one and then record their
increasingly and contextually specific and, over itera-              daily research activity using MERLIN over a 2-week time
tions, evolved into a well-adapted interface. This process           period and to note their moments of insight in a logbook.
facilitated an approachable collaboration with the sci-              We present an example of this process in Figure 3, where
ence team, allowing them to glean more insight and                   the dark blue dots indicate when the user readjusted the
express their needs more completely to the designers.                new MERLIN interface, the light orange bars specify when
This, in turn, helped the design team eliminate less                 the user was inspired to ask a new question of the data,
suitable choices. Once the interface elements were cho-              and the dark orange bars denote when the user felt con-
sen and evolved to a point where the whole team felt                 fident enough in her data exploration to posit a fully-
confident, the refinement phase began.                               formed hypothesis.
    During refinement, the design team improved on the                  We next performed a controlled environment “think
elements of the interface that were evolved and developed            aloud” study where we observed climate scientists inter-
with the science team, a process that ensured that the               acting with the newly designed interface and qualitatively
resulting interface could support each individual scien-             measured when new moments of insight were reached.
tist’s unique research needs and be appropriately simple             These studies are also still ongoing and summarized in
to use, especially for new users. This required a detailed           Figure S3 (the diagram is similar to the diagram in Figure
examination (and reexamination) of every interactive pat-            3). Finally, we also asked 7 climate researchers, working at
tern, button, slider, type style, and color choice. The de-          4 distinct institutions, who are actively publishing in the
signers removed every extraneous detail and eliminated               scientific literature, to describe in writing how they under-
any element that was distracting or unsuitable to the now            stood their own process of insight and discovery in the
well understood needs of the science. This slow, careful             context of their self-selected “most impactful paper.”
process of refinement ensured contextual accuracy and                These summaries provided historical, longitudinal, and
produced the interface’s best version of scientific utility          observational evidence that climate and atmospheric
balanced with aesthetic beauty.                                      scientists construct knowledge through the complex non-
                                                                     linear process of insight and discovery (Figure S4). Mean-
2.4. Results, discussion, and insights                               while, work at JPL is ongoing to publish an operational
The primary objective of the design team was to produce              version of the MERLIN interface at the Atmospheric Sci-
a visualization interface with appropriate clarity and flex-         ence Data Center that will replace the current MPHP data
ibility to allow scientists to offload some of the cognitive         access hosted on the MISR website. MERLIN is expected to
work of understanding complex datasets, which helps                  go live in late 2021; this will aid, greatly, in the expansion
them to examine more complicated phenomena than                      of these qualitative studies.
pure abstract or numeric data analysis. The newly de-                   These initial results provide some qualitative evidence
signed data delivery interface—delightfully named the                that thoughtful design can catalyze the production of
MISR Exploratory Research and Lookup Interface: MER-                 knowledge and that intentional collaborations between
LIN—successfully incorporated both functionality and aes-            designers and scientists can augment the scientific
thetics (Figure S1); more detail on the finalized interface          method in ways that improve its utility and output. It is
Art. 9(1) page 8 of 15                                       Tosca et al: Reimagining futures: Art, design, and climate science

                                                                                                                                  Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
Figure 3. Insight process map created by A. Galvin interpreting and depicting the workflow of users
  interacting with the new MERLIN interface. This “insight process diagram” tracks the workflow of an
  atmospheric scientist utilizing the new MERLIN interface. The user’s original notes were made in logbooks
  designed by A. Galvin (and depicted in the 2 images at the bottom). The dark blue dots represent moments when
  the user/scientist readjusted the interface, and the royal blue bars represent those time periods when the user
  interacted continuously with the new interface. The light orange bars correspond to periods when the user
  conceived of a brand new question about the observations they made using the newly adjusted interface, and the
  orange dots indicate when the user felt confident enough to declare a new hypothesis about the fire plume data.
  These workflow diagrams (one of which is depicted here) conclude only when the user arrives at a novel hypothesis
  (orange bar). DOI: https://doi.org/10.1525/elementa.2021.00016.f3

beyond the scope of this article—and our expertise as           designers play an important and critical role in catalyzing
designers and physical scientists—to determine whether          moments of insight that may prove beneficial to climate
the change was statistically significant, but we note that      change research, and we encourage scientists to incorpo-
our qualitative results present a compelling case. Future       rate reflective sketching and a robust “understanding”
work will continue both the qualitative and quantitative        phase into the beginning of their scientific knowledge
assessments of our approach. Ultimately, we show that           production process.
Tosca et al: Reimagining futures: Art, design, and climate science                                          Art. 9(1) page 9 of 15

                                                                                                                                     Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
Figure 4. Self Patcher music video scenes (top row and bottom left) are shown alongside a frame from the
  original source rendering of the city (bottom right). The music video (https://www.youtube.com/watch?
  v¼H3Y7pmYTmRs) starts with an exposition explaining the setting, narrative, and function of the city, followed by
  MTV-style music video opening credits (top). An air vehicle is shown approaching the Plastic City in an image taken
  from the real-time 3D animation (bottom right). The skyscraper-like spires in view evoke a typical city skyline but
  elude definition, perhaps not acting as buildings at all but rather as parts of the city’s ecological infrastructure. The
  related frame in the final music video (bottom left) was produced by running the original animation through the
  Sandin Image Processor, a modular analog video processing system and video synthesizer from the 1970s that
  prototyped open-source technology ethics. DOI: https://doi.org/10.1525/elementa.2021.00016.f4

3. Case Study 2: Artists create sonic                                 the future where people live sustainably in the ocean. In
abstractions of climate data                                          this work, a speculative vision of a self-determined, sea-
This project, led by artists from the SAIC, was an aural              bound city made from recycled plastic emerges depicted
investigation into how climate data can be rendered into              through an electronic music album In Water, and its
sonic art in an effort to increase the access to—and com-             peripheral multimedia works consisting of zines, ani-
prehensibility of—abstruse climate knowledge in the service           mated music videos (Figure 4), and art software.
of engaging the public imagination. Here, we describe 3                   Exclusively powered by renewable energy, the “Plastic
distinct works: The first, by Ilai Gilbert, is titled Plastic City;   City” floats through the Earth’s oceans filtering and col-
the second, by Kelvin Wells, is titled Additive Synthesis of          lecting plastics and microplastics from the water to repur-
a Climate Crisis; and the third was a panel discussion, orga-         pose into infrastructure or convert into synthetic fuels.
nized and led by Grant Tyler, called Climate Technics: Dance          The “Plastic City” operates on what the artist calls
Music as Climate Activism? All 3 pieces utilized the poten-           “waste-to-energy and circular economics.” Since its infra-
tial afforded by music and sound to engage with the cli-              structure is based on environmental restoration, the gov-
mate crisis and are publicly available for viewing and                erning system is based on resource efficiency, ecological
listening on the internet. This case study is markedly differ-        balance, and the residents’ quality of life.
ent from the first in that, for these 3 art pieces, public                The city’s technology responds and adapts to natural
knowledge and engagement with the climate crisis was the              cycles rather than manipulating them, in contrast to our
focus instead of the usability of climate data and robustness         current way of life. The first song from the album In Water,
of the scientific method addressed in Case Study #1.                  titled Aquatic Mechanis, portrays the harmony between the
                                                                      synchronous movements of the city’s machinery and the
3.1. Plastic City                                                     ocean’s amorphous waves by entangling driving rhythms
Plastic City, a multimedia piece by artist Ilai Gilbert (who          with flowing synthesizer sounds. The city changes shape
uses the moniker “11ai”), portrays a fictional location in            with modular computer-controlled tensor structures to
Art. 9(1) page 10 of 15                                         Tosca et al: Reimagining futures: Art, design, and climate science

preserve or collect heat depending on the weather, while           (CO2) as sinusoids which enhance the resolution of the
wind, solar, and water provide abundant energy.                    dire situation conferred by the climate crisis.
    Songs with titles such as Subpass Racing and Hammer-              Within the selected span of years of CO2 data—the
head Aquarium vividly illustrate the technological and rec-        length of which is scaled to the duration of the audio
reational nature cultures that give the city life. The music       recording—individual years can be heard as oscillations
video for Self Patcher tangents on the street-hover racing         in total signal gain. Starting at zero and concluding with
subculture that develops alongside more efficient and              a total of 71,955 million tonnes, each year’s cumulative
novel transportation methods. The zine references these            sum of carbon emissions is rescaled to be represented by
flying machines as well, listing electrified road and rail         a range of sinusoid quantities from 16 to 524,288. This
vehicles along with gliders as options for transit within          piece’s audio synthesis uses the Fast Fourier Transform
the city, all powered by renewable energy or plastic-              (FFT) algorithm. Because the number of sinusoids in an
derived ethanol.                                                   FFT window must be a power of 2, the relationship
    As a playful experiment in hypothesizing and imagin-           between tonnes of carbon and number of sinusoids is not
ing what a sustainable future could look like, this work           precisely proportional. Instead, the relationship is con-
purposefully does not focus on the impossibilities of the          veyed through the gradual passing of certain thresholds

                                                                                                                                     Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
technological scope of such a city. Instead, it opts to            defined by possible FFT sizes. At various moments during
remain immersed in the potential for a climate change–             the audio’s playback, the time elapsed corresponds to
centered story that isn’t driven by pessimism. In this way,        a year during which rescaled carbon levels are equal to
then, “Plastic City” could be considered a work of                 or greater than a previously unsurpassed power of 2. Dur-
“Solarpunk” art, similar to work by Dr. Andrew Merrie              ing such an occurrence, the audio becomes represented by
(https://radicaloceanfutures.earth/oceans-back-from-the-           a number of sinusoids equal to the just surpassed power
brink) and Gerson Lodi-Ribeiro (Lodi-Ribeiro et al., 2018).        of 2. This quantity of sinusoids is maintained until the
Solarpunk, an emerging genre of science fiction-based art          rescaled CO2 levels correspond to the next viable quantity
and literature, was recently defined by Reina-Rozo (2021)          of sinusoids.
as a                                                                  The recording of Jimi Hendrix’s interpretation of “The
                                                                   Star Spangled Banner” at Woodstock was chosen for its
   [ . . . ] movement [ . . . ] characterized by the creation      political implications. Furthermore, the performance
   of speculative worlds where social ecology,                     occurred in 1969 which, for a dataset that extends to
   democratic technology, and solar, wind, and tidal               2019, delineates a convenient time span of 50 years. More
   energy are crucial elements for collective well-being           importantly, Hendrix’s performance offered a depiction of
   that surpass the capitalocene and its roots in social           the U.S.’s collective anxieties which, at the time, mostly
                                                                   centered on the war in Vietnam. Additive Synthesis of
   inequality and the extraction and burning of fossil
                                                                   a Climate Crisis appropriates the core expression of Hen-
   fuels.
                                                                   drix’s “Star Spangled Banner” and applies it to the most
                                                                   severe crisis facing our contemporary world: climate
    By depicting an equitable and sustainable future that
                                                                   change.
does not deny the reality of climate change but rejects the
                                                                      Like “Plastic City,” “Additive Synthesis of a Climate
inaction of contemporary institutions, the “Plastic City”
                                                                   Crisis” explores how music can function as a uniquely
project aims to embody new ways of imagining a response
                                                                   powerful medium through which people can engage with
to the climate crisis.
                                                                   recondite information. Music, as both an experiential and
    In this way, the creation and existence of “Plastic City”
                                                                   interpretative practice, can trigger human imagination in
is similar to the creation of MERLIN, described in Case
                                                                   ways that graphs, figures, numbers, and even aesthetic
Study 1. Specifically, because nonscientists interpret scien-
                                                                   imagery cannot (Bolderman, 2020). Through music, our
tific information differently than scientists, the visual and
                                                                   minds can access abstract worlds and futures and, simul-
sonic artifacts created by artists in response to scientific
                                                                   taneously, move toward an improved understanding of
information can foster a conversation between artists and
                                                                   complex scientific concepts. This project adds to the grow-
scientists much like the “reflective sketches” that have
                                                                   ing body of climate change–focused sound art.
been previously described.
                                                                   3.3. Climate Technics: Dance music as climate
3.2. Additive Synthesis of a Climate Crisis                        activism
Additive Synthesis of a Climate Crisis is a digitally manip-       “Climate Technics” was a panel conversation organized by
ulated recording, composed by artist Kelvin Walls, of Jimi         authors Mika Tosca and Grant Tyler, which sought to illu-
Hendrix performing “The Star Spangled Banner’” at Wood-            minate the potential of art—specifically techno music—to
stock in 1969. The number of sinusoids representing the            affect climate change awareness and reform. The goal of
frequency content of this recording increases through              this initiative was to initiate the formation of a collective
the duration of its playback at a rate corresponding to the        of techno DJs, critics, and promoters that would organize
cumulative sum of carbon emissions emitted by the                  performances and events to fundraise and advocate for
United States as measured at the beginning of each year            climate change reform. This panel, which also included
from 1969 to 2019. The piece aims to interpret Earth’s             exclusive DJ sets inspired by the climate crisis (https://
atmosphere as a spectral domain and carbon dioxide                 soundcloud.com/clubchow/clubchow-mix-for-climate-
Tosca et al: Reimagining futures: Art, design, and climate science                                          Art. 9(1) page 11 of 15

technics-5_22_2020 and https://www.dropbox.com/s/                    natural scientist, the panelists argued that, like techno,
ojb7selj6swlrcw/ARIEL%20C%20MINUS%20TV.m4v?                          the production of scientific knowledge was also an artifact
dl¼0), was the first step toward that goal. We had initially         of its historical moment and an abstract representation of
intended for the panel to be a live event where attendees            the complicated observations of our world. When colla-
could first listen to the panelists and then engage with the         borations between art and science are successful, they can
exclusive mixes, but the Covid-19 pandemic forced us to              demystify and provide access to the aesthetics that under-
hold the panel virtually, through Zoom. The panel, broad-            lie all scientific knowledge, and they can mediate knowl-
cast during the spring of 2020, ultimately hosted a conver-          edge and practice. The panelists stressed that techno does
sation between Ariel Zetina, a Chicago DJ signed to techno           all of these things and more, and they asserted that art
label Discwoman, Kimwei McCarthy, a UK-based musician                about climate change doesn’t have to be didactic to be
and activist associated with Extinction Rebellion, Kevin             useful in fomenting solutions to the climate crisis. Techno
Chow, an independent Chicago-based techno DJ who uses                music, in its multifarious manifestations—from the mini-
the pseudonym “Club Chow,” climate scientist Mika Tosca,             malist tones of Robert Hood to the thumping ecstasy of
and artist Grant Tyler.                                              Jeff Mills—can inspire human imagination by activating
    We began by asking our panelists how techno/club                 the aesthetics and making us think, of the material world

                                                                                                                                       Downloaded from http://online.ucpress.edu/elementa/article-pdf/9/1/00016/477537/elementa.2021.00016.pdf by guest on 17 November 2021
practitioners could and should engage with the question              in a way that the often narrow and insular discipline of
of climate change. Specifically, we encouraged panelists to          climate science cannot.
consider how art can respond to science and prompt soci-
etal change and whether techno can mobilize and ener-                3.4. Discussion and insights
gize demands for climate action. We also asked our                   The 3 works of art described here offer a unique depiction
panelists to address whether political reform needed to              of the climate crisis through the utilization of sonic art.
be paired with changes to the techno movement and                    Artist 11ai’s “Plastic City” offers a vision of the future that
community and whether the history of techno as an inher-             is not constrained by technological unknowns and that
ently political art positions it as a vanguard toward actu-          challenged our imaginations in ways that traditional sci-
alizing solutions to the climate crisis.                             ence communication does not. Kelvin Wall’s “Additive
    Some of the discussion centered on lifestyle choices;            Synthesis of a Climate Crisis” transforms a known musical
panelists asserted that techno fans should support local             experience into a less familiar—and substantially less
artists to reduce the level of air travel by touring DJs, and        “comfortable”—one by the incorporation of sonically mod-
promoters should power their raves with solar panels.                ified representation of the CO2 concentration in the atmo-
Beyond that, though, the panelists agreed that the histor-           sphere. And, finally, Grant Tyler’s Climate Technics panel,
ical relationship of techno music to social and political            and associated DJ mixes, addresses the question of how
movements—that is, techno was created as a liberating                the techno music community should leverage the political
force in the ongoing struggle for queer and Black equity             nature of electronic music to affect changes to climate
in the United States, and as the ecstatic sound of freedom           policy and spur climate action.
in the wake of the Berlin Wall’s collapse—has a responsi-                While the first case study (MERLIN) focused on the
bility to thoughtfully engage with the climate crisis. We            potential benefits to the production of scientific knowl-
concluded the panel by broadcasting 2 exclusive mixes                edge resulting from close collaboration between scientists
created by artists Club Chow and Ariel Zetina that were              and designers, this second case study shows how art—and
inspired by, and centered on, climate change; links to               specifically sonic art—can engage the public imagination
those mixes are above and in the Data accessibility section.         and inspire climate action. The 3 works of art were not
Both mixes are publicly available and, as with the previ-            produced in a vacuum but were instead the result of a se-
ously described sound projects, add to the growing body              mester’s worth of extensive climate change–related
of work that fuses climate science with sound art. Ariel’s           research. And while all 3 artists engaged with the climate
mix, which is paired with a video depicting natural land-            research in unique ways, it is notable that each artist only
scapes, is downtempo (to contrast with the more “earthly”            conceived of the form their eventual work of art would
landscapes depicted in the video), serene, experimental,             take after weeks of meandering, directionless exploration
and builds to a powerful and thought-provoking conclu-               of the scientific research and regular weekly engagement
sion. Kevin’s mix, which begins with the sound of birds              with a climate scientist. In a way, then, the process that
chirping, is ethereal and full of techno that sounds like            these 3 artists practiced in the creation of the work
(and in some cases, mimics) different natural landscapes;            described was similar to the initial “understand” step of
his mix is also faster than Ariel’s but comes to a very              the design-making process employed by Adrian Galvin
serene and inspiring conclusion.                                     and his team of designers in the first case study, providing
    This panel explored the utility of art—specifically              more qualitative evidence that transdisciplinary collabora-
techno—to develop a more complete and adaptive under-                tion can help solve the climate crisis.
standing of the magnitude and breadth of the climate
crisis. Successful art, the panelists argued, actualizes the         4. Conclusions
aesthetic experience of its historical moment in the form            Artists and designers can catalyze novel moments of
of a visual or sonic object and should effectively stimulate         insight for climate researchers, help augment the scien-
the imagination of its audience. While these ideas might             tific method to improve its utility, and enlighten the gen-
seem distant from the historically defined task of the               eral public to complex scientific concepts by visualizing,
You can also read