How to problematize a border, or: some ongoing notes on transient methodologies
Article Sidebar
Google Scholar citations
Main Article Content
In this paper I rehearse a method for studying media that is engaged by what I am calling a transient methodology. This work with “transients“ emerges as much as an analytical tool as it does as a material engagement, in direct connection with my encounter with a GDR-era synthesizer prototype, the Subharchord I/II, and its use of a specific audio filter design which is found again only forty years later as a building block for most state-of-the-art speech recognition algorithms. I am particularly interested in one such algorithm, namely the so-called “Dialect Recognition Software”, a proprietary machine learning solution in use since 2017 by the German Office for Migration and Refugees in cases of undocumented asylum seekers in the country. By bringing these two stories closer and mobilizing them through the work of transients – a concept that works in sound as much as it does in movement – I seek to activate an experimental, speculative media archaeology that focuses on the haptics of listening. Transient methodologies, I argue, offer the potential to critically listen to these two technologies together while at the same time slowing them down for critical inquiry and analysis.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
(c) Pedro J S Vieira de Oliveira, 2024
Copyright
For all articles published in Artnodes that are subject to a Creative Commons Attribution 4.0 International licence, copyright is retained by the author(s). The complete text the license can be consulted at http://creativecommons.org/licenses/by/4.0/. You may copy, distribute, transmit and adapt the work, provided you attribute it (authorship, journal name, publisher) in the manner specified by the author(s) or licensor(s).
Authors are responsible for obtaining the necessary licences for the images that are subject to copyright.
Assignment of intellectual property rights
The author non exclusively transfers the rights to use (reproduce, distribute, publicly broadcast or transform) and market the work, in full or part, to the journal’s editors in all present and future formats and modalities, in all languages, for the lifetime of the work and worldwide.
I hereby declare that I am the original author of the work. The editors shall thus not be held responsible for any obligation or legal action that may derive from the work submitted in terms of violation of third parties’ rights, whether intellectual property, trade secret or any other right.
Pedro J S Vieira de Oliveira, Independent scholar and artist
Researcher and sound artist whose work is committed to an anticolonial study of listening and its material intersections with the violences of the European border. His ongoing research concerns specifically with the long histories of technical listening in Germany. In his academic practice, he has held Fellowships at the Leuphana Institute for Advanced Studies and the Helsinki Collegium for Advanced Studies, and taught at the Humboldt University Berlin, Linnaeus University Växjö (Sweden), and the Heinrich-Heine University Düsseldorf. Currently, he is part of the guest faculty in Sound Studies and Sonic Arts at the Universität der Künste Berlin. He holds a PhD, also from the Universität der Künste Berlin.
Ali, Ahmed, Najim Dehak, Patrick Cardinal, Sameer Khurana, Sree Harsha Yella, James Glass, Peter Bell and Steve Renals. “Automatic Dialect Detection in Arabic Broadcast Speech”. arXiv (2015, 23 September). DOI: https://doi.org/10.48550/arXiv.1509.06928
Amoore, Louise. Cloud Ethics: Algorithms and the Attributes of Ourselves and Others. Durham: Duke University Press, 2020. DOI: https://doi.org/10.1215/9781478009276
Bundesamt für Migration und Flüchtlinge. “Drucksache 20/3238: Einsatz von Dialekterkennungssoftware Im Bundesamt Für Migration Und Flüchtlinge”. Bundestag (2022, 31 August). https://dip.bundestag.de/vorgang/einsatz-von-dialekterkennungssoftware-im-bundesamt-f%C3%BCr-migration-und-fl%C3%BCchtlinge/290504
Dusan, Sorin and Li Deng. “Recovering Vocal Tract Shapes From Mfcc Parameters”. Proc. ICSLP, (2000): 3087-3090.
Ferreira da Silva, Denise. “On Difference Without Separability”. Incerteza Viva (Living Uncertainty): Catálogo Da 32a São Paulo Art Biennial. (São Paulo, SP, Brasil, 2016), 57–65.
Hanani, Abualsoud, Hanna Basha, Yasmeen Sharaf and Stephen Taylor. “Palestinian Arabic Regional Accent Recognition”. 2015 International Conference on Speech Technology and Human-Computer Dialogue (SpeD), (2015): 1-6. DOI: https://doi.org/10.1109/SPED.2015.7343088
Kanervisto, Anssi, Ville Vestman, Md Sahidullah, Ville Hautamaki and Tomi Kinnunen. “Effects of Gender Information in Text-Independent and Text-Dependent Speaker Verification”. 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). (New Orleans, LA: IEEE, 2017), 5360-5364. DOI: https://doi.org/10.1109/ICASSP.2017.7953180
Li, Xiaochang and Mara Mills. “Vocal Features: From Voice Identification to Speech Recognition by Machine”. Technology and Culture 60, no. 2 (2019, 18 June): S129–60. DOI: https://doi.org/10.1353/tech.2019.0066
Ma, Zichen and Ernest Fokoué. “A Comparison of Classifiers in Performing Speaker Accent Recognition Using MFCCs”. Open Journal of Statistics, no. 4 (2014, 20 June): 258. DOI: https://doi.org/10.4236/ojs.2014.44025
Miersch, Manfred. “Die Geschichte des Klangerzeugers ‘Subharchord’ (2)”. Keyboards, (2003).
Nuance Communications. “The Essential Guide to Voice Biometrics”. Nuance Communications, (2015, 11 December). DOI: https://doi.org/10.1016/S0969-4765(15)30042-4
Nuance Communications. “What We Do - Our Mission”. Nuance Communications, (nd.). https://www.nuance.com/company-overview/what-we-do.html
Steinke, Gerhard. Auf dem Wege zu einer neuen Klangkunst. Berlin: Akademie der Künste, 2015. DOI: https://opac.adk.de/00/bvnr/BV043446027
Steinke, Gerhard. “Die Wiedergeburt Des Klangerzeugers Subharchord”. In: Berno Odo Polzer and Thomas Schäfer (eds.). Katalog Wien Modern. (Saarbrücken: Pfau, 2007), 162-164.
Steinke, Gerhard. “Probleme der elektronischer Klangerzeugung (II)”.61 1958. ADK O-0486. Akademie der Künste. https://archiv.adk.de/objekt/2397817
Steinke, Gerhard. “Rückblick auf die Arbeit des ‘Studios für künstliche Klang - und Geräuscherzeugung’ im Rundfunk - und Fernsehtechnischen Zentralamt (Deutsche Post) 1960 - 1970, Berlin - Adlershof”. Deutsche Sektion der Internationalen Gesellschaft für Elektroakustische Musik, no. 10 (1993, 9 January): 15-26.
Stevens, S. S. and J. Volkmann. “The Relation of Pitch to Frequency: A Revised Scale”. The American Journal of Psychology, vol. 53, no. 3 (1940): 329-353. DOI: https://doi.org/10.2307/1417526
Vieira de Oliveira, Pedro J S. “‘...The Table Was Set, and We Were Never Dead’: On the Persistence of Colonial Listening in Germany”. The Journal of Media Art Study and Theory, vol. 2, no. 2 (2021): 89-101.
Similar Articles
- Wolfgang Ernst, Radical Media Archaeology (its epistemology, aesthetics and case studies) , Artnodes: No. 21: (June 2018). NODE 21. Media Archaeology (Editors: Pau Alsina, Ana Rodríguez, Vanina Hofman)
- Erkki Huhtamo, Beginning and Developement of Media Archaeology , Artnodes: No. 5: (September 2006). NODE 5. Interviews (Editors: Pau Alsina, Pau Waelder)
- Lev Manovich, Avant-garde as Software , Artnodes: No. 2 (2003): NODE 2. Art and New Media
- Raquel Caerols Mateo, Beatriz Escribano, Medialab Madrid 2002-2006. Participatory culture and social activism in Madrid , Artnodes: No. 24: (July 2019). NODE 24. After post-truth (Editor.: Jorge Luis Marzo)
- Domingo Sánchez-Mesa Martínez, Jordi Alberich, Nieves Rosendo, Introduction: Transmedia narratives , Artnodes: No. 18: (November 2016). NODE 18. Transmedia narratives (Editor: Pau Alsina)
- Erkki Huhtamo, Overhead modernity: airplanes, skywriting, and heterotopia in the sky , Artnodes: No. 34: (July 2024). NODE 34. Materiology and variantology: invitation to dialogue (guest editors: Siegfried Zielinski & Daniel Irrgang)
- David García, Geert Lovink, Andreas Broeckmann, The GHI of Tactical Media , Artnodes: No. 2 (2003): NODE 2. Art and New Media
- Rene G. Cepeda, Making a Manual: The Manual for the Curation and Display of Interactive New Media Art , Artnodes: No. 31: (January 2023). NODE 31. Possibles II (Editors: Pau Alsina & Andrés Burbano)
- Erkki Huhtamo, The Self-Driving Car: A Media Machine for Posthumans? , Artnodes: No. 26: (July 2021). NODE 26. AI, Arts & Design: Questioning Learning Machines (Guest Editors: A. Burbano & R. West)
- Rosa Núñez-Pacheco, Phillip Penix-Tadsen, Divergent theoretical trajectories in Game Studies: a bibliographical review , Artnodes: No. 28: (July 2021). NODE 28. In the limits of what is possible: art, science and technology (Guest Editors: Paloma Díaz, Andrea García)
You may also start an advanced similarity search for this article.