A telephone is a familiar device. From past until present, a phone has been associated with home and the possibility to communicate from distance, allowing voices to travel, thoughts to be shared, and stories to be told. What happens, though, when on the other side of the line is not a person but a piece of software? What changes when a phone becomes an affective infrastructure which, based on accent recognition, can grant or deny asylum to someone? These are questions that Pedro J S Vieira Oliveira addresses in the following article, discussing how the trivial and the familiar can be weaponized in order to trigger emotions, evoke dialects, and ultimately decide upon the course of lives.
Let us begin by posing a question: what are the words, the scenes, the shapes that may elicit you to pick up the phone and call home?
A telephone might evoke a certain sense of familiarity. In fact, we are so familiar with telephones that they have become an intrinsic part of us, lightly touching skin through the fabrics of pockets, or suspended in bags, purses, fanny packs hanging from shoulders, backs, waists. Depending on how old you are and where you come from, you might also recall the clunky device of the landline as being one of the epicenters of home. Static, immobile. Connected to the wall, wired to the table. In a corner, above the fridge, on a desk. Surrounded by sparse annotations and scribbled pieces of paper smudged blue or black or red or green or pencil-grey with barely recognizable, abstract drawings, numbers, names, dates, family recipes, cheesy poems. Connected to the telephone, which is connected to the wall. This is the beauty of the telephone and its familiarityâit brings us home, but also, to some extent, used to (and perhaps continues to) shape it. Stories and histories become interlinked, woven in an affective network of voice patterns travelling in cables.
A telephone might be thought of as something to evoke a sense of familiarity. Let us imagine a telephone again, but this time sitting on a desk in an empty room. How large is this room? How well-lit is it? Does it feel like an abandoned office room, or does it have that aseptic quality of white, buzzing lights? Perhaps we may change it a littleâthere is so much we do not know that we can take some liberties with it. We can maybe think of this telephone in a narrow booth instead, sitting atop a small, taller-than-usual table, with enough room for a single chair that is perhaps too short for the table in front of it. Maybe the chair wiggles a bit, one leg slightly shorter than the others. We can be a little creative, and picture this specific telephone in a dark shade of red, but most likely it would be of that quirky color between an off-white and a light grey, though yellowed by age and maybe a good dose of cigarette smoke. Its dialing pad feels a bit greasy to the touch, for each number might be smudged with longing, hope, dread, love, disappointment, grief. Most likely a mixture of them all, combined as if in a bittersweet potion. But today, this specific telephone, we can guess, is smudged with anxiety. The cold sweat that runs through the cable to the dialing pad to the table to the chair, to the body sitting in front of it.
In this telephone, this specific device of a weird color and of greasy touch, we can dial whatever number we want. It will only respond, however, to this sequence:
7 2 0 9 9,
then #
If we look closely enough, we might even notice these numbers are fading out from the dialing pad. They feel a bit lighter to the touch, they might even give a tiny wobble when the fingertip rests on them, hesitating. Yet they work. They should, at least. This telephone, this specific device of a weird color and of a somewhat greasy touch, only exists insofar as this number can be dialed in. The room only exists as long as this telephone sits there. Connected to the wall, connected to the network. Seven, two, zero, nine, nine, hash. Silence. A short beep.
Now let us tell it a story. We have two minutes.
Wait, not any story. There are protocols to it, and most likely we see now something in front of us, next to the device. A picture, probably flipped over so as to entice some curiosity. How come we missed it before? Who placed that piece of paper there, lost amongst all the bureaucracy that subsumes a life onto a collection of papers showcasing incomplete stories about oneself? Forget about them, focus on the picture. We have two minutes to describe it.
Gloria AnzaldĂșa, Latina Chicanapoet and writer, extensively discussed the evoking power of objects and the abilities conjured by the storyteller engaging with ritualistic artifacts. The âpresentnessâ of a given object, when invoked through rite and story, she remarks, evinces that an object is "both a physical thing and the power that infuses it.ââ 1 Objects are not static, and AnzaldĂșaâs writings serve as a way to remind us that there is nothing "new" in ânew materialisms.ââ 2 In non-Western cosmologies, objects are imbued with the power relationships they contain, they help construct, and that are evoked in them by the stories told within and around it. The end result is not a fixed thing in time and space (as Western aesthetics would presume), but instead âan assemblage, a montage, a beaded work with several leitmotifs and with a central core [âŠ] appearing [and] disappearing in a crazy dance.ââ 3 The world changes whenever a story is told. The storyteller is a shapeshifter, and stories of and with objects are transformative.â 4 The nature of storytelling is repetition. The nature of repetition is unequal.
The ritualistic power of objects and their ability to transform both storyteller and listener is not exclusively confined to the evocative power of artworks. For AnzaldĂșa, that would be the essential distinction between the art of the colonizer and that of the colonized, because for the latter the art evoked into objects is not separated from everyday life. Power is embedded in the affective relationships between object and body, inasmuch as that we inhabit different versions of our bodies whenever objects touch us. Put differently, affective infrastructures inhabit us, but at the same time they change the world around us, and this change shapes us back. Affective infrastructures are haptic, timbral, malleable, textured, archipelagic even.â 5
I am thinking of the power of stories, but I am also thinking of the power structures that weave an entire world in which affect is supposed to be removed from the act of telling a story.
If we think of these two minutes in which a story must be told, we find out that they do provoke change in the life of the storyteller, but not because of the intrinsic power contained in that specific story. Rather, because the story depends on this telephone, this specific device of a weird color and uneasy, perhaps greasy touch, on the other side of which sits not a listener desiring to be moved by it, but instead, a piece of software. An algorithm that will process the story, break it down into tiny snippets of audio, convert it from the time to the frequency domain, measure the power coefficients distributed in thirteen selected vectors, and match that to an existing dataset.â 6 It will eventually spit back a list of probabilities, distributed over a specific set of languages the listener is x or y percent confident the storyteller speaks. 63 percent Turkish or 22 percent Hebrew.â 7
Log Likelihood Ratio.
That the processing of the story implies some form of listening, human or machinic, does not necessarily mean that the affective power yielded by the contents of the story matters. On the contrary, the power lies in the act of connecting the picture with the speaker with the telephone.
This is not any ordinary telephone, we now begin to realizeânot least because of its weird color and greasy touch. This is a device that is supposed not to connect the speaker with home, but instead evoke a sense thereof. This is a device that creates a sitting body longing for home. The telephone that connects this speaker home does not sit on a desk like this one, but, much like themselves, survives the journey that leads there. The speaker, we learn, is a very specific person, defined as such by the infrastructures of borders, geopolitics, and war. Connected to the wall, connected to the network connected to the system. The autonomy over the (sounding) self is temporarily hijacked by this bond. Speaker and telephone, speaker and infrastructure, they co-constitute one another, defined and bonded by the power relationships that inhabit body, voice, telephone, algorithm, policies, trade agreements, governments, colonialism, history.
Their name, a number. Their identity, a placeholder: âasylum seeker.â
In sociolinguistics, the analysis of a dialect imposes a series of ethical problems that impact how, why, and when speakers are elicited to speak more ânaturally,â i.e. as they would do in their everyday. For a piece of software specifically calibrated to attend to dialect elicitation, it is also expected that the speaker should provide the most ânaturalâ account of their prosody, pronunciation, rhythm, and vocabulary. Miriam Meyerhoff et al. argue that speakers tend to adapt their speech when they know they are being recorded, and the omission of such awareness exacerbates the power relationships at play between researcher and researched.â 8 When the software omits the figure of the âresearcherââreplacing it, say, with a telephoneâthe presence of a recording device might be, at least visually, obscured. The authors further discuss one technique employed in sociolinguistic research, which consists of recording conversations between two or more speakers that are familiar with one another, without the physical presence of the researcher in the same environment.â 9 Furthermore, whereas the sociolinguistic research implies consent (written or otherwise), in the German asylum system the accent recognition test, done so via interview or via software, is compulsory when no other âmaterial proofâ of the applicantâs origin can be presented.â 10 The power relationships, in this case, are not broken nor obscured. Rather, they become hypervisible.
The German Federal Office for Migration and Refugees (BAMF) began experimenting with accent recognition software by the end of 2017, allegedly after the disastrous case of Neo-nazi German soldier Franco A., who managed to trick the asylum seeking system and was granted temporary asylum as David Benjamin, a Jewish Syrian. His plan was to commit a series of terrorist attacks on German public figures and attach the violence to his temporary identity.â 11 The software was implemented in 61 of the reception centers (Ankunftszentrum) and external offices (AuĂenstellen) in Germany. The databases for speech and accent recognition (speech corpora) were bought from the University of Pennsylvania in the United States.â 12 Its capabilities were, for a couple of months initially, specially focused (or one may say, tuned) to speakers of Levantine, Egyptian, and âGulfâ variations of Arabic. By April 2018, this software had been deployed 9,883 times in asylum cases, and the BAMF, in response to an inquiry of the softwareâs effectiveness, reported the error margin to be of 20 percent, with promises of improvement.â 13 By browsing on the University of Pennsylvaniaâs long list of speech corpora we find that the most popular databases amongst the Arabic dialect variants are named CALL FRIEND and CALL HOME.â 14
Franco A. hat in seiner Anhörung nie ein Wort Arabisch gesprochen. Er beantwortete die Fragen auf Französisch und offenbar auch auf Deutsch.â 15
Nun wird das Bild vielleicht etwas klarer: Es geht hier um Form vor Inhalt. Macht ist hier in dem Ungleichgewicht zwischen diesen verwandten Aspekten verortet, prĂ€sent in der kontingenten VerknĂŒpfung, die zwischen der Wichtigkeit des Inhalts fĂŒr die sprechende Person und der Relevanz der Form fĂŒr die zuhörende Person gebildet wird. Die Geschichte handelt nun von der endlosen infrastrukturellen Reichweite, die durch die Lautbildung eines Phonems eröffnet wird. Von dieser Artikulation hĂ€ngen Leben ab, Schicksale beruhen auf dieser ungleichen Beziehung. Die Fehlerquote, so wissen wir, liegt bei 20 Prozent.
Die Liste der ethischen Probleme, die aus dem Versuch hervorgehen, Menschen dazu zu bringen, ânatĂŒrlich zu sprechenâ, ist endlos. Von dem Moment an, in dem diesem bereits sehr ungleichen MachtverhĂ€ltnis die menschliche Komponente entzogen wird, wird davon ausgegangen, dass der Verlass auf softwarebasierte Entscheidungen ein gewisses MaĂ an âNeutralitĂ€tâ oder âObjektivitĂ€tâ birgt und die ethischen Probleme zeitweilig zur Seite gelegt werden können. Anders gesagt: Die Fehlerquote liegt bei 20 Prozent, aber zumindest â so sagen sie â gibt es keine Gefahr, dass menschliche GefĂŒhle sich in die objektive Beschreibung seitens der zuhörenden Person einmischen â was vermeintlich den Weg dafĂŒr ebnen wĂŒrde, dass die sprechende Person GefĂŒhle hervorlockt.
Sagt es mir: Welche Worte, Szenen, Formen regen uns dazu an, nach dem Telefon zu greifen und zu Hause anzurufen?
Ein Telefon kann dafĂŒr benutzt werden, ein beunruhigendes GefĂŒhl der Vertrautheit hervorzurufen. Nach Meyerhoff et al. neigen âThemen, bei denen die Sprechenden emotional involviert sein könnenâ, dazu, enorm erfolgreich Dialekte hervorzuholen. Die Autor:innen heben die Nutzung von Techniken wie der âTodesgefahrâ hervor:
Es scheint, als wĂŒrde diese Methode in der soziolinguistischen Forschung nicht mehr genutzt.â 17 Die Frage nach der âTodesgefahrâ ist nicht nur aus der Perspektive der Forschungsethik höchst problematisch. Sie ist auch extrem rĂŒcksichtslos gegenĂŒber den GefĂŒhlen der Person und den psychologischen Folgen des Auslösens von Erinnerungen an Traumata. FĂŒr Ăberlebende von Gewalt, Missbrauch und Krieg können solche âEntlockungenâ langfristige Auswirkungen nach sich ziehen.
Wenn wir das Foto umdrehen, das auf dem Tisch vor uns liegt, und es genau betrachten, dann sehen wir, dass es eine Familie bei einer gemeinsamen Mahlzeit in ihrem Zuhause zeigt.
AnzaldĂșa erinnert uns, dass ein Bild eine âBrĂŒckeâ ist âzwischen hervorgerufenem GefĂŒhl und bewusstem Wissenâ.â 18 Können wir uns vorstellen, dass die trivialste Situation als Abkapselung des Unerreichbaren zu einer Waffe gemacht wird?
Ein Telefon kann dazu instrumentalisiert werden, eine asylsuchende Person daran zu erinnern, dass âZuhauseâ immer woanders ist. Zuhause ist scheinbar fĂŒr immer auĂer Reichweite.
Wir haben jetzt zwei Minuten, um die Beschreibung eines Bildes in dieses Telefon zu sprechen, das vor uns steht. Verbunden mit der Wand, die mit dem Netzwerk verbunden ist, das mit dem System verbunden ist. Mit der Grenze verbunden.
Zuhause.
- 1 Gloria AnzaldĂșa, Borderlands/La Frontera: The New Mestiza, Third Edition (San Francisco: Aunt Lute Books, 2007), 89.
- 2 Iâd like to thank Lou Cornum for pointing this out to me.
- 3 AnzaldĂșa, 88.
- 4 ibid.
- 5 See Marija Bozinovska Jones, Lou Cornum, Daphne Dragona, Maya Indira Ganesh, Tung-Hui Hu, Fernanda Monteiro, NadĂšge, Pedro J S Vieira de Oliveira, and Femke Snelting, âAffective Infrastructures: A Tableau, Altar, Scene, Diorama, or Archipelago | Transmediale.â in transmediale journal, 2019: https://transmediale.de/content/affective-infrastructures-a-tableau-alta ....
- 6 Zichen Ma and Ernest FokouĂ©, âA Comparison of Classifiers in Performing Speaker Accent Recognition Using MFCCsâ in Open Journal of Statistics 04 (June 20, 2014), 258: https://doi.org/10.4236/ojs.2014.44025 .
- 7 Anna Biselli, , Max Hoppenstedt, and Sara Schurmann, âEine Software des BAMF bringt Menschen in Gefahr.â Motherboard , August 20, 2018: https://motherboard.vice.com/de/article/a3q8wj/fluechtlinge-bamf-spracha ....
- 8 Miriam Meyerhoff, Chie Adachi, Golnaz Nanbakhsh, and Anna Strycharz, âSociolinguistic Fieldworkâ in The Oxford Handbook of Linguistic Fieldwork, November 24, 2011: https://doi.org/10.1093/oxfordhb/9780199571888.013.0006 , 123.
- 9 ibid., 133.
- 10 Bundesamt fĂŒr Migration und FlĂŒchtlinge, âDienstanweisung Vom 1. Dezember,â February 19, 2018: https://fragdenstaat.de/anfrage/dienstanweisung-vom-1-dezember/ .
- 11 âEx-Bundeswehrsoldat Franco A.: âFalscher Syrerâ Aus Untersuchungshaft Entlassen,â in Die Welt, November 29, 2017: https://www.welt.de/politik/deutschland/article171078726/Falscher-Syrer- ... Bundesamt fĂŒr Migration und FlĂŒchtlinge. âIdentitĂ€tssicherung Und -Feststellung Im Migrationsprozess,â September 27, 2017. http://www.bamf.de/SharedDocs/Meldungen/DE/2017/EMN/20170927-am-emn-stud ....
- 12 Alexander Ulrich. âSoftware fĂŒr Sprachbiometrie, Forensik und Handyauswertung beim BAMF.â Accessed February 24, 2019: https://www.andrej-hunko.de/start/download/dokumente/1186-software-fuer- ....
- 13 Biselli et al.
- 14
- 15 âBehördenversagen: Franco A. sprach Deutsch in Asylanhörungâ. Spiegel Online, 16. Juni 2017:http://www.spiegel.de/politik/deutschland/bundeswehr-franco-a-sprach-deu ....
- 16 Meyerhoff et al., 134.
- 17 Hierauf weist Rachael Tatman auf Twitter hin, durch die ich auch auf den Text von Meyerhoff et al. aufmerksam wurde;siehe https://twitter.com/rctatman/status/1090325168491192321 , letzter Zugriff am 12. MĂ€rz 2019.
- 18 AnzaldĂșa, 91.