un|fold

un|fold

un|fold is a multidimensional light and sound sculpture, created for the historic Turbine Hall at the KTH Royal Institute of Technology, as part of the Nobel Week Lights 2022. It contrasts the simplicity of digital actions that can be used to explain complex chemical processes with the actual complexity and intricacies of the software traces that perform these actions.

From outside

Context

In 2020, the Nobel Prize in Chemistry was awarded to E. Charpentier and J. Doudna “for the development of a method for genome editing.” One way of explaining genome editing is to liken it to editing in a text document, specifically to “search and replace”, since the key to the CRISPR technology is the ability to identify and replace a part of the DNA. While the processes that enable the CRISPR search and replace action on genomes are extremely sophisticated, people draw parallels with text editing as a simple analogy in order to make the complex chemistry more accessible.

A search and replace operation in a text editor is appropriate to illustrate the complexity of CRISPR with a mundane digital operation that is easier to grasp than the intricate chemical processes involved in DNA engineering. It is fascinating to notice that, in contrast to this apparent simplicity, the software processes involved in a search and replace are intricate and complex. Even what we perceive as the simplest digital sections is an invisible and intangible set of processes that run millions of operations per second, on top of world-wide networks. With this software art installation, called un|fold, we wish to draw attention to the hidden yet impressive and beautiful complexity that lies below the most basic digital actions. Our goal is to create appreciation and interest in the intricate layers of code involved in the actions of search and replace, through a multidimensional light and sound sculpture.

The installation

un|fold’s lights and sound are algorithmically generated based on data. The data is the recording of all software operations that are performed by a text editor when a human user performs the following task: search for “Hello there” and replace it by “Hi there”. For this artwork, we record the function calls performed in a Java virtual machine. un|fold then plays back the sequence of functions at a constant speed of 25ms per event, mapping them to a LED and sound artwork. The quasi instantaneous search and replace software is turned into a 2h30 multimedia piece, letting the audience appreciate the sublime nature of the invisible digital world that’s around us.

un|fold unveils one specific aspect of software’s nature: modern software is built in layers upon layers through decades of work by many, often practically anonymous, individuals. Programmers of new software rely on collections of code written by others, which in turn relies on code written by others, and so on. These layers are referred to as the software supply chain.

In un|fold, we reveal the deep software supply chain of search and replace, LEDs referencing how far away we are from the code written especially for that action, and sound reflecting on the diversity of sections of code.

From inside 1 From inside 2 From inside 3
From inside the Turbine Hall, by @glidephotos - Martynas Justinevicius

data <-> sculpture

  • The more LEDs light up, the further away we are into the layers of software dependencies.
  • The color of a row of LEDs corresponds to different dependencies, and therefore different programmers contributing to the functioning of the software.
  • The brighter the timbre of the sound is, the more diverse that section of software activity.
  • The movement of pitch in the sonification directly maps to the movement of the computer through the software structures.

From outside
From outside

Window projections

Around the LED sculpture, six live-generated animations are projected on the windows, three on each side. They visualize the above-mentioned data in different ways, thus enriching the experience, providing more context and exploring the software/biology metaphors.

See the animations:

Window projections One half of the projections

Prints

A small print series was produced, featuring yet another visualization of the data on the left, with one software event represented by one pixel.

print23 print42
The two versions of the print

Iterations

After Nobel Week Lights 2022, un|fold was presented at other events and venues:

When What Where
2023-04-22 Kulturnatt Royal College of Music (KMH)
2023-05-04 re|cord release party Den Fantastiska Platsen
2023-10-05 to 2023-10-08 Affordable Art Fair Nacka Strandsmässan
2023-11-25 80 Feet Under (french, swedish) Reaktorhallen 1 (R1)

KMH at night close KMH at night far
Kulturnatt, at KMH

In R1 close In R1 far
80 Feet Under, in R1

un|fold in the world

2023-10-18 80 Feet Under: An artistic immersion in Stockholm's Nuclear Reactor (french, swedish)
2023-08-16 Meet the artists: re|thread on the Affordable Art Fair website
2023-04-19 un|fold at KMH for Kulturnatt 2023 (in Swedish)
2022-12-07 E. Charpentier and J. Doudna visited un|fold in December 2022
2022-11-09 un|fold: Making sense of software through emotions (WASP)
2022-11-09 On the Nobel Week Lights website
2022-12-07 Campus art installation captures the richness of basic software actions (KTH EECS News)
2022-12-09 Nobel laureates visited Un|fold during ongoing Nobel week lights (WASP)

On social media

2023-11-28 French Institute in Sweden on Instagram and Facebook
2023-04-19 Affordable Art Fair Stockholm on Instagram
2022-12-06 KTH communication on Facebook and LinkedIn
2022-12-07 Innovative Genomics Institute on Twitter

Credits

un|fold was designed and developed by the re|thread collective: Erik Natanael Gustafsson, Maria Kling, Roni Kaufman, and Benoit Baudry. For un|fold, re|thread collective features Deepika Tiwari and César Soto Valero, software experts.

rethread group From left to right: César, Deepika, Benoit, Erik, Roni and Maria

un|fold was supported by the KTH Royal Institute of Technology, The Nobel Week Lights and the Wallenberg Autonomous Systems, Software and AI Program (WASP). Special thanks to Leif Handberg (KTH) for his support and for giving us access to an amazing space.

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.