The Tyranny of Life Under Algorithms

Posted: November 24, 2019 by teresaheffernan1 in AI, Fiction, Homophobia, Racism
Tags: , ,

A Short Meditation on the Tyranny of Life Under Algorithms

by Teresa Heffernan

Alan Turing–the force behind theoretical computer science, artificial intelligence, and the Universal Turing Machine–was instrumental in cracking intercepted coded messages, which enabled the Allies to defeat the Nazis. He was charged with “gross indecency” in 1952 and punished for homosexuality. He submitted to chemical castration in lieu of prison. Just before his 42nd birthday, two years after the charge, he committed suicide though some speculate his death was an accident. In the final section of Will Eaves’s brilliant novel Murmur, about a character based on Alan Turing, Alec Pryor faces a dream-like trial where he appears before “The Council of Machines”:

“I was left to imagine what sort of extraordinary mental realm it was they inhabited in which pain and lies and deceptions were still said to offend, but offended as depressing inexactitudes rather than injustices, and I realized that I did not have to imagine very hard, because I had inhabited something very similar for most of my life, had treated a number of people as a series of unsatisfactory propositions, and had understood therefore—with a shudder—the propensity in German Fascism to treat whole nations and races in like manner, and had fought against it accordingly. And then, of course, I ended up being treated that way myself.”

Under the regime of machine logic “inexactitudes” displace injustice, pain, and lies. Humans, nations and races are reduced to “unsatisfactory propositions.” Too late, Alec comes to realize that although he fought against the Nazis, the council of machines, that he has helped install, shares the same logic. Just as he is marked as a homosexual for loving despite dominant heteronormative codes, under the tyranny of algorithms and statistical averages, there is similarly no room for figures that don’t fit.

There is no coming Singularity, no roadmap to Artificial General Intelligence—AI is math not magic. Don’t’ be distracted by the massive propaganda machine of Facebook, Google, YouTube, and Twitter and the billionaires that own them, who are selling this version of the future. It is snake oil. These Silicon Valley titans care far more about their stock prices and expanding their control than they do about justice, fairness, democracy, science or truth. Conspiracy theories of the most violent sort spread like wildfire on these platforms. Their algorithms automate and accelerate historical injustice. The data they steal from you is used to turn you into a statistic with no recourse to appeal. If you don’t fit the model, you are tossed out of the system. This is what Pryor portends as he stands before the Council of Machines in his “forward-thinking hallucination”: fascism on steroids.

rastus_smallIn a fascinating new article in Glass Bead Journal, Louis Chude-Sokei (2019) begins by challenging the parallels between humans and machines that David Levy (2007) mobilizes in his controversial book Love and Sex with Robots. The parallels Levy sets up, Chude-Sokei maintains, have been “less controversial than his book’s assumptions of and possible impact on gender relationships, and his nonchalant relationship to ethics.” Yet, it is precisely the “ease” of establishing these parallels and “how natural they are” that Chude-Sokei targets in his analysis, arguing that, “it is through these facets that we can make sense of how and why the very question of ethics has become central to public conversations about human relationships with machines.” Chude-Sokei is the author of The Sound of Culture: Diaspora and Black Technopoetics and was a participant in our Cyborg Futures workshop in 2017. You can find his article, “Machines and Miscegenation,” in Glass Bead Journal, Site 2. Dark Room: Somatic Reason and Synthetic Eros.

 

A talk by Teresa Heffernan at the “Ethics of AI in Context” interdisciplinary workshop, September 17, 2019. The workshop was hosted by the Ethics of AI Lab, a project initiated by the University of Toronto’s Centre for Ethics.

A talk by Teresa Heffernan

ETHICS OF AI IN CONTEXT. A series of talks presented by the Ethics of AI Lab, Centre for Ethics, University of Toronto

4 – 6 PM, Tuesday, Sept 17, 2019. Room 200, Larkin Bldg., 15 Devonshire Place, Toronto

The era of “disruptive” technologies has given way to an ethical quagmire. Biased algorithms, invasive facial recognition software, proprietary black boxes, the theft and monetization of personal data, and the proliferation of hate-spewing bots and deepfakes have undermined democracy. Killer robots and the automation of war have led to a new arms raise with Vladimir Putin declaring whoever leads in AI will rule the world. The concentration of wealth and power of corporations that own most of this resource-intensive technology and the environmental price tag of AI can only hasten climate change. In response to these ethical problems, a number of research centres are now investing in the intersection of humanities and AI in order to study its impact on society, notably the Schwarzman College for Computing at MIT, the Schwartz Reisman Institute for Technology and Society at the University of Toronto, and The Schwarzman Centre’s Institute for Ethics in AI at Oxford. An article about the MIT initiative noted: “The approach has the potential not just to diversify tech but to help ‘techify’ everything else” while Geoffrey Hinton said: “My hope is that the Schwartz Reisman Institute will be the place where deep learning disrupts the humanities.” What these statements disavow, however, are the very different epistemological approaches that structure these fields. If we are to begin to deal with the ethical issues of AI, the humanities should not be “disrupted” and made to bow to the logic of big data, algorithms, and machines. In this talk, I will argue that it is only by keeping alive the tensions between artificial intelligence and the humanities that we can hope to have an informed debate about the limits and possibilities of this technology.

For more information see Ethics of AI Lab, Centre for Ethics, University of Toronto

Repost of book review by Sue Smith (BMJ Medical Humanities 25/06/2019)

Enchanting“Enchanting Robots: Intimacy, Magic, and Technology is part of the book series, Social and Cultural Studies of Robots and AI, edited by Kathleen Richardson, Cathrine Hasse and Teresa Heffernan, and is written by Polish academic, Maciej Musiał. In Enchanting Robots Musiał discusses ‘magic’ and ‘magical thinking’ in order to critically assess humanity’s current and projected future relationship with newly emerging robot technology.  In brief, ‘magical thinking’ is the ability of humans to imaginatively confer human qualities onto ‘others,’ both animate and inanimate, creating meaningful and intimate connections with the non-human world.  It is through the theoretical lens of ‘magical thinking,’ which Musiał describes as an ongoing historical human process of enchantment, disenchantment and re-enchantment in pre-modern, modern and postmodern societies, that Enchanting Robots explores and examines humanity’s desire to re-enact personal moments of  ‘magic’ with the non-human ‘other’.  According to Musiał, understanding ‘magical thinking’ is of value because it helps explain how humans across differing cultures and time periods productively seek and create authentic moments of novelty and self worth that is of psychological benefit to both the individual and the wider community.  In particular, in the current climate of robot technology, which is creating a generation of love robots, sex robots and care robots in order to facilitate and promote new human relations with technology, Musiał argues that ‘magical thinking’ in today’s western world demands careful consideration for establishing important ethical foundations for the use and acceptance of non-human partners and carers in medicine and social care and across society in general.”

“Sequentially, Enchanting Robots consists of an ‘Introduction’ and four chapters starting with chapter 2, ‘Robots Enchanting Humans’; chapter 3, ‘Humans Enchanting Robots’; chapter 4, ‘Disenchanting and Re-Enchanting in Modernity’; and finally chapter 5, ‘In Lieu of a Conclusion: Where Will We Go from Here?’…”  Click here to continue reading.

Full book review posted at BMJ Medical Humanities Blog June 25, 2019

The Robotic Imaginary: The Human & the Price of Dehumanized Labor by Jennifer Rhee (University of Minnesota Press, 2018)

Book review by Teresa Heffernan (forthcoming in Novel)

Debates about whether robots will take over jobs or open up as yet unimagined career possibilities dominate the headlines. Silicon Valley and the techno optimists promise us that robots will automate boring jobs and create new ones, leaving humans free to pursue their interests in the arts and sciences and ushering in a great era of equality, creativity, and freedom. Others warn that robots will take over close to half of all human jobs dramatically increasing unemployment. Those owning the machines and platforms will throw workers into poverty, increasing the already unconscionable gap between rich and poor and further ripping apart the social fabric of democracy. These competing scenarios typically frame questions about the impact of robots on labour in world economic forums and in the media.

Robot Imaginary imageJennifer Rhee’s The Robotic Imaginary: The Human & the Price of Dehumanized Labor interrupts this debate to ask more basic questions about how robot labor is imagined by research labs, by the artificial intelligence industry, and in film, art and literature. Bringing this technology into conversation with cultural and literary studies and the humanities, Rhee considers the ways in which it envisions the historical and current understanding of what it means to be human. Organized around chapters on caring and care labor, thinking and domestic labor, feeling and emotional labor, and dying and drone labor; Rhee’s book is concerned with how the contested terrain of the human is constituted and reconstituted by these new anthropomorphic technologies. This labor imagined in robotic form renders the human knowable, calculable, and recognizable while exposing the dehumanized others that exist outside of the boundary of what is considered familiar and normal. Each chapter concludes with a short review of robotic art that offers an alternative imagining, a reconfiguring of the human as unknowable, particular, and irreducible.

The introduction offers an overview of the origins of robotics, which found its first expression in literature, was developed by scientists, and grew with military funding. The term artificial intelligence emerged out of the Dartmouth Project, which brought together a small group of men in 1956 to debate the hypothesis that machines could be made to simulate human intelligence. The collapse of the human and the machine, the anthropomorphic metaphor underpinning the field, expands and continues to expand the boundary of the human beyond this initial metaphoric union, Rhee argues, invoking Paul Ricoeur’s description of the workings of metaphor. The other critical factor shaping robotics has been DARPA (a branch of the American Department of Defence devoted to technological and military superiority), which has funded most of the research in the field since its creation in 1958.

Two of the founding texts in the field, Alan Turing’s test for machine intelligence and Masahiro Mori’s theory of the uncanny valley, illustrate Rhee’s central argument. In the first example, the imitation game begins with a man and a woman who are both trying to convince a judge via a teleprinter that they are female while the judge, who is in a separate room asking questions, tries to correctly identify the woman. Turing then suggests replacing one of the humans with a computer. The game is famously set up to police the boundaries between the human and the machine, but, as Rhee points out, the judge needs to conceptualize the human before s/he can possibly assess human likeness. Hence the game also opens up the possibility for the judge to misrecognize the human rendering the very category “human” unstable and open while exposing the biases and normative assumptions at the heart of this policing exercise. In contrast, Mori’s theory of the uncanny valley, which sets out to determine the robot design that people would best relate to, enforces narrow normative versions of the human, Rhee observes, that are measured against disability and illness. In several graphs, Mori charts the point at which human-like replicas evoke positive affinity as opposed to eeriness. The “healthy” human occupies the highest point on the graph, while the corpse falls at the bottom of the stillness scale and the zombie at the bottom of the movement scale and the ill person gets slotted below the healthy one. In another of his graphs a prosthetic hand occupies the point of negative affinity. As Mori’s theory is in wide circulation and impacts the development of humanoid technologies and social robots, it is important to expose the biases informing his design model Rhee insists.

Karel Čapek’s play R.U.R (1920) first uses the term robot, derived from Czech words for serfdom and forced labor, long before the development of the field. Driven by the capitalist goals of profit, productivity, and efficiency, designers of organic humanoid robots promise to liberate humans from labor and usher in a new era of freedom and leisure. The question of the robots’ “humanness” drives the play as Helena Glory hopes to liberate them from exploitation while their creators argue they are nothing but soulless machines. The play draws on the cultural memory of slavery and fears of slave rebellions to explore the dehumanization of workers under factory capitalism that promises freedom for some at the expense of others. Alienated from their labor, however, the humans in the play fail to thrive and stop reproducing while the robots, claiming their “humanity” by mimicking human’s capacity for domination and violence, revolt and kill all the humans.

Rhee returns to these founding literary and scientific texts in order to open up the entwined questions of anthropomorphization and dehumanization that frame the next four chapters of her book. Chapter one considers Turing’s model of AI as a child that needs to be educated and Weizenbaum’s early “therapist” ELIZA, demonstrating how care labor has been integral to AI. Gendered female, these often humanized AIs serve as emotional interlocutors, child educators, and romantic partners or spouses that perform both domestic and affective work. In contrast, “male” AIs, like Watson, are machines that are positioned as universal experts that disseminate knowledge in fields like medicine and law. Analyzing Richard Powers’ Galatea 2.2 and Spike Jonze’s Her, Rhee maintains that the gendering of AI thus replicates the historically devalued and underpaid reproductive labor of women that has sustained capitalism. Countering this devaluation, however, Rhee points to robotic art “that highlights affect’s constitutive role in cybernetics, transforming cybernetic circuits of communication and control into those of affect and care” (57). Nam June Paik’s Robot K-456, Norman White’s The Helpless Robot, Momoyo Torimitsu’s Miyata Jiro, and Simon Penny’s Stupid Robot and Petit Mal are presented as examples of robot artwork provoking affective responses from their audiences, demanding that cybernetics be grounded in an ethics of care and interdependence, and foregrounding these traits as critical components of being human.

The second chapter on “thinking” further builds on the marginalization of reproductive labor in the field of AI. Early closed-world versions of AI that relied on highly schematic and simplified models of reality were followed by the hope that the combining of multiple “micro-worlds” would lead to greater complexity in AI systems. Rhee argues that the micro-world approach of AI, which is built on stereotypes and familiar norms and erases the unruliness of the real world, finds it parallel in The Stepford Wives. Ira Levin’s 1972 novel, inspired by Betty Friedan’s The Feminine Mystique, famously recounts the murder of women and their replacement with docile immaculate generic robots that are programmed to do housework and serve their husbands. Like the closed-world AI models, the female robots remain sealed off from the public world of wages, politics, and intellectual work while real women with their complicated desires, politics, and aspirations must be killed off in order to sustain the unchanging ahistorical gendered hierarchy of Stepford.

Yet Rhee also argues that the fate of the real women in Stepford is sealed in part because of their refusal to acknowledge the working-class women, who as “outsiders” of the suburban enclave, are able to document the crimes committed in the area. Concerned with the fate of middle and upper class white housewives, Friedan’s work also ignores the many white working class women, single women and women of colour who were working outside the home in jobs that offered neither economic self-sufficiency nor independence from men, as bell hooks has noted. Moreover the presentation of domestic labor and child rearing, the task of raising another human being, as unskilled and “mindless” perpetuates the devaluation of “women’s” work. The Stepford Wives and its contemporary adaptation, Ex Machina (2015), highlight the exclusionary and at times exploitive narrative of white middle-class feminism that finds racialized and classed women aiding white women’s liberation even as they are excluded from it.

Rejecting the symbolic micro-world models, Rodney Brooks developed an embodied approach to robotics in the 1980s that encouraged robots to interact with messy dynamic environments to develop machine “intelligence” with the hope that they would “evolve” upward to humanoid AI. Yet while Brooks’ robots are physically situated in the world, they, as several critics have pointed out, are culturally and historically “dumb,” perpetuating the closed world approach to AI. In addition to military robots, Brooks’ company iRobot designs autonomous robots, like the Stepford robots, as mindless domestic laborers. In contrast to closed-world AI, Rhee concludes this chapter with several examples of robotic art—including Stelarc’s Fractal Flesh and Ping Body—that stress interdependence, open worlds and the vulnerability of the body.

In the third chapter, one of the most fascinating, Rhee explores social robots and emotional labor as another aspect of devalued reproductive labor and its ties to the military. In the 1990s, with new research on the importance of emotions in intelligence, robots, funded by DARPA, were developed based on the contested theory of “universal” emotions. Rhee argues that both the myth of universal emotions and the work of producing legible emotions are ways of policing the boundary of the human. Technologies developed from this theory that assume the external body reveals the truth of the individual, such as SPOT (screening of passengers by observation techniques) adopted by US Homeland Security, not only have had little success but expose the power relations embedded in them. Rhee explores the gendering and racializing of emotional labor and the dehumanization that is perpetuated by these technologies in her reading of Philip K Dick’s We Can Build You and his later novel Do Androids Dream of Electric Sheep. The Voigt-Kampff test, at the heart of this latter novel, imposed by those in control, measures emotional responses to scenarios or images to determine the “human” status of the responder. The test of course is never used on its android hunters and Deckard’s sense of shame in brutally eliminating the androids at the command of the state remains inside him in any case and is never visible on the surface. The chapter concludes with two feminist robotic works, Omo by Kelly Dobson and Swarming Emotional Pianos by Erin Gee, which challenge the theory of the universality of emotions and its use in developing dehumanizing policing technologies.

The final chapter on dying considers the entanglement of reproductive labor and drone warfare. Targeting victims and perpetrators outside of any judicial system and under a veil of secrecy, drone warfare perpetuates the colonial and racial legacy of determining who gets included and who gets excluded from the category of human, which has been part of both post Enlightenment subjectivity and US labor history. Rhee reviews American drone policy that identifies any military-aged man in certain areas as the enemy and that refuses to investigate those killed in the strikes or accurately document civilian deaths. She also reviews the history of cybernetics as a “war science” and Norbert Wiener’s early work on defense systems, which encouraged fighter pilots to identify with cybernetic German pilots to better understand the enemy other. The racialized Japanese enemy, however, were characterized as insects and vermin rather than as cyborgs, so no identification was encouraged. This dehumanizing racialization continues not only in drone policy but also in the asymmetry of drone targeting fueled by the massive gulf between operators and their targets, viewed as “ants.” From the high accident rate of the machines to the “ambiguous” information that ends with dead civilians, the technology also reveals itself as highly fallible exposing the misguided faith in technological omnipotence and quantifiable information that drives this form of warfare.

Reviewing drone art, Rhee provides a provocative analysis as she unpacks the differences between works that invite their western audiences to identify with racialized targets and those that challenge that identification in order to underscore the legacy of racial violence in America. She points to the limits of art works that promote identification with those “over there” by invoking Judith Butler and her questions about whose lives count as grievable. Positioning America as a place of safety and justice, works such as Home Drone and Drone Shadow fail to acknowledge the continuity between drone strikes overseas and the violence and injustices inflicted on marginalized communities at home, a point driven home by the adoption of militarized robots by some local US police forces. In contrast works such as Teju Cole’s Seven Short Stories about Drones refuse to ground ethics in familiarity and identification and instead insist on mourning lives that are unknowable. The artistic collective behind #NotaBugSplat, James Bridle’s Dronestagram, and Omer Fast’s film 5,000 Feet is the Best also suggest, Rhee argues, “an ethical relationship that foregrounds disorientation, uncertainty, and the unknown rather than the familiar, the known, the predictable ” that direct cybernetic technology and drone warfare (172).

The Robotic Imaginary exposes the ways in which robot technologies perpetuate existing racial and gender hierarchies by devaluing certain labour and certain humans and valuing others while exploring robotic art as way of opening imaginings that challenge the colonial, patriarchal, class and racial histories. As robots invade work spaces and as privatization erodes social responsibility, Rhee rightly insists we should ask of every robot figure “who is being dehumanized?” And what version of human is considered “sacrosanct and familiar”? While automation and the restructuring of the labor force by multinationals like Google and Facebook that are buying up AI and robotic technology lies outside the argument of Rhee’s book, I did wonder about the very limits of the metaphor of the human as machine and whether dehumanization doesn’t begin with industry leaders in Silicon Valley who have so successfully propagated the view that there is no difference between the two. Rhee’s otherwise excellent reading also falls a little short in its American-centric focus. What, for instance, would she have to say about Japan’s embrace of the “robot revolution,” in lieu of immigration, that is trumpeted in the face of a shrinking labor force? Or about the global fight for control of AI.

A vital contribution to the field, Rhee’s book does not argue fiction is “coming true” as is so often the case in scientific and media reports on robots, but instead it turns to literature and art as providing some insight into the always shifting ground of what it means to be human. Rhee’s book is essential reading for anyone negotiating the intersections of literary studies, anthropomorphized robotics and the impact of these technologies on society.

The Real Life ‘Ex Machina’ Is Here

Posted: April 23, 2019 by keasp1 in AI, Events, Film, Robots
Tags:

ss4_poster_finalTeresa Heffernan will present “The Real Life ‘Ex Machina’ Is Here: Restoring the Gap between Science and Fiction” at the Machine Agencies Speakers Series on Tuesday, April 23, 2019 from 3 to 5 pm. Milieux Institute for Arts, Culture and Technology, Concordia University, 1515 Rue Sainte-Catherine W. EV Building, 11.455. Montréal, Quebec. For more information: www.facebook.com/events/1001883676675274/