The example of “Huff n’Puff” evidences yet another problematic aspect which digital artists might face when incorporating unique features to their narratives. This is due to the fact that the activation of the sound is dependent on the reader, which could, if not advertised well enough, be missed or ignored. The relevance of the sound is then called into question, as it would be possible to get two different reading experiences, one with music and one without, giving the reader control in the mutation of the story. The agency ascribed to the reader further calls into question the role of the sound and its function. Evidencing the need, as outlined by Murray in Hamlet on the Holodeck, for a set of conventions for exercising agency and handling mutability in fluid mediums (Murray 1998, 155).
The notion of mutability and ascribing agency to the reader is heavily linked to digital comics and particularly, to the user interface. The user interface (UI) is the medium through which the writer/creator allows the reader to exchange information and instructions with the device. The immersive nature of digital comics permits this, and can lead to enhanced freedom in the reading experience. The problem stems from the reader’s agency over the story and what that entails. In Playing the Text, Performing the Future, Felicitas Meifert-Menhard focuses on the user’s immersion in the text and defends that open narrative structures will create a beneficial sense of freedom in the reader.
This is evident in “Murat”, by Motiv studio, an immersive digital comic that requires certain inputs from the viewer to allow the story to continue. One of these is a puzzle that is presented at the beginning of the story, transforming the panels into puzzle pieces and needs to be resolved before being able to continue (Collective 2014) (see Figure 10). Not only does the puzzle require solving but once completed there are certain buttons that resolve actions so that the story progresses.
However, these inputs can sometimes feel out of place and unjustified. The puzzle does not affect the narrative or relate to it in any way, but merely plays with the structural layout of the panels, making it feel gimmicky. Meifert-Menhard acknowledges this possibility and warns that “the pitfall of openness is randomness, and any pleasurable feelings resulting from the possibility of doing anything, going anywhere is quickly decreased when the action of selection becomes haphazard or unmotivated” (Meifert-Menhard 2013, 30).
An example in which Unit interface can prove to detract from the overall narrative and reading experience is in “The Ocean is Broken” by Sutu in which the screen is navigated by scrolling horizontally through the page. The limitation in this case is that on many internet browsers the way by which one returns to the previous window is by doing the same action (scrolling horizontally), consequentially, by trying to advance in the story the reader would only end up in their previously visited page. It also causes problems if the reader's mouse directions are inverted. Furthermore, the sensitivity of the trackpad or mouse can lead to the reading of the comic being choppy and too fast, as it does not prove to be a fluid scroll. Therefore, the reading experience can result frustrating due to the navigational tools offered, potentially putting the reader off.
The UI of a digital comic does not necessarily have to grant agency to the reader, but can also give the illusion of it. An example of this is the scene of the slot machine in “Murat”, where the panels need to be clicked on to put a coin in and activate the machine. The machine then goes on to spin to finally reveal a losing combination.
“The Art of Pho” shows a wide variety of examples in which UI can be used, from clicking and scrolling to dragging objects and using the trackpad to simulate movement. As well as through the incorporation of mini games and other interactive features, as seen in the Pho making mini game, through which the reader is left responsible of gathering the necessary ingredients for the dish. Also, in part 3 of episode 3 the reader is presented with the option to choose to close the elevator or keep it open for the person that is coming (Submarine Channel and Hashaw 2011). Although the actions of the reader don’t affect the story flow immensely (the outcome is always almost the same), it still gives the reader a sense of participation that connects them further with the story.
UI has also recently been explored in more experimental and revolutionary ways, particularly by using technologies that fiddle with reality, such as virtual reality (VR) and augmented reality (AR). “Modern Polaxis” is a comic by Sutu that tells the story of Polaxis, a time traveller who believes that reality is a holographic projection and that he must therefore find the projectionist. The physical comic is Polaxis’ diary and the AR feature is a layer of hidden information the protagonist wants to keep secret (Campbell 2014) (see Figure 11). This narrative wouldn’t be possible to explain if it wasn’t for the possibility of bringing it to life, and experiencing what the protagonist is experiencing.
By using this technology, certain fictional aspects of a story can be rendered possible, furthering the possibilities of any narrative medium.
User Interface therefore allows for new navigational possibilities through technological advancements unique to the digital format. By dictating the user´s ability to engage with the story, UI grants the author greater control over how their story is told and read, and the agency the reader can exercise within it. However, it is important to note that restraint is key when granting the reader agency as it can prove detrimental if used unnecessarily.
[Fig.10] Collective Motiv (2014)
Murat
Available at: http://nonstopbar.com/
(Accessed: 20 October 2017)
Although this gaming experience is only illusory (the result is the same regardless of how many times it’s played), it provokes a sense of anticipation in the reader, making the gambling aspect more real. Therefore, the inclusion of game-like features through the UI enhances the overall reading experience.