New APPS: Art, Politics, Philosophy, Science

Phenomenological Seams (part 3): Governance and the Home

By Gordon Hull

Over a couple of posts (first, second), I’ve used a recent paper by Brett Frischmann and Paul Ohm on “governance seams” – basically, inefficiencies (sometimes deliberate) in sociotechnical systems that are moments for governance – to think about what I called “phenomenological seams,” which are corresponding disruptions in our experience of the world.  I suggested that the combination of the two ideas could be usefully explored by way of Albert Borgmann’s criticism of the stereo as a way to listen to music, rather than direct instrumentation, against the background of Heidegger’s account of breakdowns in our phenomenological experience that occur when tools aren’t as expected.

Borgmann’s objections are notable because of how the stereo, as opposed to the instrument, recalibrates the seams that structure the boundaries of the home.  This is obvious enough in retrospect, in a world with Spotify and wireless earbuds, but the connection shows a couple of things.

First, as Heidegger’s examples also indicate, there is a strong connection between technological governance and phenomenology.   Frischmann and Ohm emphasize that governance seams can be there both to announce their own presence and to achieve transparency. This interruption makes transparent the phenomenological relations that govern a particular experience in the same way that a broken hammer does.  For all that’s wrong with them, the GDPR-mandated cookie notices on websites try to change the experience of websites and nudge users to think about the amount of data they are surrendering.  This example also shows the ways that phenomenological experience can limit the regulatory effect of seams: privacy is way too much work, and users are (as a result) cynical, confused, and disillusioned.  But the cookie requirement establishes a new relation to the websites, precisely because the regulatory seam has phenomenological import.

GOP wants to Deregulate AI completely

The House budget bill is deeply stupid.  No, I don’t mean the massive tax cut extensions for people who don’t need them, done on the backs of food and medical care for the poor, although it also does that and it’s stupid.  I mean the provision that bans states from regulating AI.  Tucked inside is a provision that says “no state or political subdivision may enforce any law or regulation regulating artificial intelligence models, artificial intelligence systems, or automated decision systems during the 10-year period beginning on the date of the enactment of this Act.”  This is making the news if you’re in the right circles, but like so much of the deluge coming out of Washington these days, it’s not getting the national attention it deserves.  Over on Lawfare, Katie Fry Hester and Gary Marcus have the details.  The key point is that the law attempts to pre-empt all state AI regulations.  It would probably also take out big chunks of state privacy laws, just as we’re starting to see some of them.

Hester and Marcus emphasize some of the problems: the bill likely violates the 10^th Amendment, it is absolutely a policy change of the sort that the Senate Parliamentarian should rule out-of-bounds for a reconciliation bill, and it’s deeply unpopular: the public is worried about AI and wants it regulated.  A standard debate about state vs. federal regulation cites the Brandeis “laboratories of democracy” vs. the need for uniform federal rules.  This is a reasonable debate, and it probably depends on the topic which you’d favor.  They are not necessarily exclusive choices either, as federal regulation can set floors and ceilings that states may go above/below, and sometimes federal regulations develop out of state rules.  Federal copyright law preempts state, and that system makes obvious sense.  State laws around gambling or alcohol make sense given the diversity of local cultures.

That debate from your civics class is however not what this is about.  The problem of course is not that we’d have federal policy instead of state.  The problem is that there is absolutely no chance that this Congress will pass meaningful AI regulation, so the choice is between a patchwork of state rules and nothing.  Congress hasn’t even passed meaningful privacy regulation yet, and right now they’re in thrall to an autocrat who issued an Executive Order in his first week in office directing agencies to “suspend, revise, or rescind such actions, or propose suspending, revising, or rescinding such actions” taken in compliance with the Biden Administration’s (bare minimum) efforts at AI regulation, in the name of “revok[ing] certain existing AI policies and directives that act as barriers to American AI innovation, clearing a path for the United States to act decisively to retain global leadership in artificial intelligence.”

Phenomenological seams (part 2): Borgmann, Heidegger and Derrida

Last time, I set up a topic by reading Brett Frischmann’s and Paul Ohm’s “Governance Seams.”  Governance seams are frictions and inefficiencies that can be designed into technological systems for policy ends.  In this regard, “Governance seams maintain separation and mediate interactions among components of sociotechnical systems and between different parties and contexts” (1117).  Here I want to suggest that governance seams have a very close relation to phenomenological ones.  To get there, let me take a detour into an older philosophy of technology paper, Albert Borgmann’s “Moral Significance of the Material Culture.”  Borgmann is concerned with what he takes to be the way that moral and ethical theory ignore material culture, whether they emphasize theory or practice.   Via a paper by Csikszentmihalyi and Rochberg-Halton, he arrives at a distinction between things that he calls “commanding” and “disposable.”  The moral complaint is about the “decline of commanding and the prominence of disposable reality” (294).  Following them, Borgmann distinguishes between a musical instrument and a stereo.

“A traditional musical instrument is surely a commanding thing,” he writes:

“It is such simply as a physical entity, finely crafted of wood or metal, embodying centuries of development and refinement, sometime showing the very traces of its service to many generations. An instrument particularly commands the attention of the student who, unless she is a prodigy, must through endless and painstaking practice adjust her body to the exacting requirements of this eminently sensitive thing.” (294)

After some more similar description, emphasizing the multisensory experience of witnessing someone play an instrument, he turns to the stereo.  Certainly a “stereo produces music as well or, in fact, much better” and some stereos are big.  Nonetheless, “as a thing to be operated, a stereo is certainly not demanding. Nor do we feel indebted to its presence the way we do when we listen to a musician.  We respect a musician, we own a stereo” (295).  The stereo is on the rise, perhaps because “the history of the technology of recorded music is the history of obliging ever more fully the complaint about the burden and confinement of live music,” or “more positively” it is a “promise to provide music freely and abundantly” which is tied to “the promise of general liberty and prosperity – the promise that inaugurated the modern era” (295).

Phenomenological Seams (part 1)

In a recent paper, Brett Frischmann and Paul Ohm introduce the idea of “governance seams,” which are frictions and inefficiencies that can be designed into technological systems for policy ends.  In this regard, “Governance seams maintain separation and mediate interactions among components of sociotechnical systems and between different parties and contexts” (1117).  Their first example is a university’s procedure for anonymous exams.  There, a number of different friction points are added to make sure that professors do not know whose exams they are grading: students receive unique identifiers from the registrar and use only these on the exams; they type but do not write answers; once the exams are scored, the registrar matches the numbers back with individual student names; and so forth.  The professor will likely not be in the room during the exam, so the university will have to provide a neutral proctor.  The exam might also take place in a specified location.  There will also be rules and penalties designed to ensure that none of the seams are crossed without permission.  Together, these governance seams design the system for fairness, or at least to eliminate one potential source of bias in grading.  They’re also pretty inefficient in that they require a bunch of resources be allocated to them, but places with that sort of anonymous grading figure it’s worth it for the fairness bump.

As the paper goes on to argue, such governance seams are ubiquitous and important, because they enable us to design sociotechnical systems to facilitate certain outcomes that might otherwise not happen.  That is, seams open a space for governance: