Abstract
Despite a general interest in exploring the possibilities of multimedia and web-based
research, the humanities profession has been slow to accept digital scholarship as a
valid form of intellectual endeavor. Questions about labor, peer-review, and
co-authorship often arise in academic departments’ attempts to evaluate digital
research in the tenure and promotion process. In this essay, we argue that these
tensions stem from a general misunderstanding of the kinds of
“work” that goes into producing scholarship in multimedia form.
Multimedia work, we suggest, places scholars in an extended network that combines
minds, bodies, machines, and institutional practices, and lays bare the fiction that
scholars are disembodied intellectuals who labor only with the mind. We argue that
while traditional ideas of what “counts” as scholarship continue
to privilege content over form, intellectual labor over physical labor, and print
over digital media, new media’s functional (and in some cases even biological)
difference from old media contributes to a double erasure, for scholars working in
multimedia, of both their intellectual contributions and their material labor.
I construct, and I am constructed, in a mutually recursive
process that continually engages my fluid, permeable boundaries and my
endlessly ramifying networks. I am a spatially extended cyborg.
[Mitchell 2003, 39]
Knowledge arises from the flesh — that intertwining of my body
and the world, and my interactions with others.
[Tuana 2001, 236]
Digital scholarship is not new. By the time the World Wide Web appeared on the
screens of professors and students at academic institutions in the mid-1990s, a
profound transformation was well under way. Digital preservation, spearheaded by the
Text Encoding Initiative and other similar efforts to apply computing power to
literary analysis and preservation, had become a well established, if somewhat
marginalized, field of study. For literary critics interested in computing, text had
morphed into hypertext. Still others recognized that multimedia, as a practice, was a
promising new frontier; as a result, media studies quickly became new media studies.
In many ways, the institution adapted: new journals, such as the Electronic Book Review, emerged as open-access e-journals. Print
journals, such as Genders, followed suit and were reborn
in cyberspace. Brave, forward-looking deans, provosts, and grant-giving agencies like
the National Endowment for the Humanities and the National Science Foundation threw
money at multimedia and web-based projects that promised to revolutionize the way
that scholarly knowledge is presented and circulated.
This institutional interest in exploring the possibilities for digital scholarship,
after an initial flurry of activity followed by something of a hiatus, seems to be
gaining impetus again. We have recently seen the establishment of new granting
initiatives (such as the NEH’s Digital Humanities Start-Up Grants and the ACLS
Digital Innovation Fellowship Program) as well as a general “buzz”
about digital scholarship epitomized by recent articles in the
Chronicle of Higher Education and elsewhere, culminating in a standing
room only panels on digital humanities at the MLA conferences of 2009 and 2010, and
the awarding of the MLA’s 2009 first book prize to
Mechanisms
[
Kirschenbaum 2008], a seminal book on new media forensics. Innovative
work, such as that sponsored by the Maryland Institute for Technology in the
Humanities (MITH), MediaCommons, and the journal
Vectors, is gaining ground among a growing cohort of digital scholars.
Despite these promising developments over the last decade, however, academia itself
has been slow to respond to the changing face of scholarly practice when it comes to
issues of promotion and tenure, peer-review, funding, and faculty development, and
more broadly in recognizing the emerging importance of scholarly multimedia. In this
respect, academia seems to suffer from its own version of technological obsolescence,
seeing the emergence of scholarly multimedia as challenging the primacy of
traditional humanities scholarship.
This article considers the historically important role that new media have played in
configuring not just articulations of humanist subjectivity in general (a now
well-trodden field in literary and cultural studies), but also the humanist
scholarly subject. By placing the institutional tensions between
traditional scholarly practice and new media within larger theoretical and
disciplinary contexts, we can demonstrate how new media challenges the ways in which
the traditional humanities scholar has been imagined as having a secure and stable
position within institutionalized hierarchies of knowledge production. Furthermore,
we can consider how scholarly multimedia threatens the very coherence of humanities
scholarship by insisting on the re-embodiment of scholarly activity. In this respect,
we hope to bring critiques of techno-scientific epistemologies coming out of new
media and science studies to bear on humanities scholarship in order to follow
through on Donna Haraway’s call for interventions into all forms of knowledge
production: “Knowledge-making technologies, including crafting subject
positions and ways of inhabiting such positions, must be made relentlessly
visible and open to critical intervention”
[
Haraway 2004, 236]. Our analysis will reveal the ways in which the production of scholarly
multimedia has been hampered by two key obstacles: traditionalist definitions of
humanities scholarship that still overwhelmingly determine the evaluation of digital
works, and a narrow understanding of what the “materiality” of new
media can actually come to mean. We hope to address both of these issues by
foregrounding some of the material and intellectual potentialities revealed by
scholarly multimedia.
Scholarly Multimedia: Defining an Emerging Genre
Scholarly multimedia in the humanities has, historically, gone by many names: digital
humanities, humanities computing, and more recently new media scholarship. Each of
these names points to the technological aspects of this new mode of scholarship, and
thus acknowledges the vital importance of medium to scholarly activity. In literary
studies, media scholarship has for the most part diverged into two basic fields of
study. On the one hand, we have traditional text-based readings of innovative
literary forms, usually referred to as
new media studies. N. Katherine
Halyes, among others, has pioneered this important field.
[1] On the other hand, we have digital reimaginings of or interventions into
preexisting text manuscripts, such as the William Blake Archive and Emily Dickinson
Electronic Archives. These works are usually gathered under the title of
digital humanities or
humanities computing. This
division between analysis of new media and digital archiving has been accompanied by
an equally notable split in tenure and promotion evaluation, wherein scholarship
about new media, in the form of single-author monographs,
“counts,” while multimedia projects themselves, no matter how
transformative, are viewed (if the scholar is lucky) as akin to producing a somewhat
gimmicky scholarly edition — i.e. the “work” is primarily viewed
as reformatting rather than as “original” scholarship. The
important work of digital preservation of existing texts, itself a crucial field, is
more likely to be considered the province of library science than that of Literature
and the Humanities.
Spearheaded by the Electronic Literature Organization, scholars in the digital
humanities are now starting to explore some of the technical and rhetorical problems
of approaching and preserving “born digital” creative works —
interactive Flash poems, hypertext novels, and the like — which never existed in
print. But what about “born digital”
scholarship — scholarship that never had a print analog? Very few
theorists have attended to this category, being mostly concerned with digital
creative works as their object of analysis, rather than digitally rendered scholarly
works. Thus the work of new media researchers in the humanities tends to get lumped
into a single category rather than, as Cheryl Ball distinguishes, into the very
distinct categories of scholarship rendered
in new media and scholarship
about new media [
Ball 2004, 404]. Institutionally,
this distinction is crucial for upcoming scholars, since much of the contention
centers around
originality of content: if the multimedia format of the
work is absolutely essential to (and constitutive of) the argument it presents, where
should it count — as a work of scholarship as fundamentally complex as a written
monograph, or as a reworking of an existing argument (a
porting, if you
like — a term we borrow from software development practices)? Thus it is important to
distinguish, as we do here, between the term
scholarly multimedia and
other terms frequently used in considerations of the role of new media in academic
contexts. By scholarly multimedia we specifically mean critical scholarly works —
interpretive and argumentative, as opposed to creative or archival — that are
produced, and in some cases performed, in multimedia form. These works represent a
new rhetorical genre of scholarship that is at once both discursive and embodied, and
that differs from multimedia art or hypertext fiction (as artistic and literary
genres) and from multimedia as interactive storage spaces for archival materials or
critical resources.
The messy contention over how to define scholarly multimedia is symptomatic of the
very old argument, played out continually in the academy, over a perceived split
between form and content. Content is the essence of analysis, while form is merely
the “matter” out of which it is made. But materiality matters —
has always mattered — in the meaning-constitution of analysis. Digital machines, in
all their undeniable physicality, confront us as a transformational tool in the same
way that the printing press does. In this way, we see, from the earliest writings
about the role of computers in humanities scholarship, an awareness of materiality.
In the fields commonly known as “history of the book” or
“print culture,” critics have devoted considerable
attention to the materiality and visual spatiality of the scholarly artifact – the
illuminated manuscript, the Concrete poem, the hypertext novel, etc. In the analysis
of the many forms new media take, [
Drucker 2002], [
Hockey 2000], and [
McGann 2004] serve as excellent
examples, as does N. Katherine Hayles in her call for “media-specific analysis” and later “New
Materialism,” a mode of literary criticism that takes seriously the
material instantiation of the text as integral to critical interpretation ([
Hayles 2002, 29]; [
Hayles 2005, 142]). Critics
have also attended to the body of the reader as an important locus of materiality,
arguing, as Mark Hansen does, that readers engaged with new media experience the
text/artifact in an embodied, post-representationalist way; that is to say, new media
produces in the user/reader “affects” that cannot be separated
from material embodiment [
Hansen 2006, 223]. But the importance of
the material conditions of multimedia
production, i.e. the embodied and
materially-mediated work of the digital author has remained drastically
under-theorized.
Our goal here is to extend the discourse of new media criticism by addressing
specifically the materiality of scholarly production, both in print and multimedia
form. That is, we hope to attend not only to the bodies of the text and the
user/reader, but also to the bodies of the authors/engineers and to the material
aspects of scholarly activity itself. Crucially, we want to focus on the material and
embodied aspects of multimedia production, rather than simply the rhetorical
arrangements or rearrangements of information that are so often considered the
primary labor of multimedia authoring. In this mode, it is important to distinguish
between material labor and embodied labor.
For us, material labor is a broad term encompassing both physical
movement and the kinds of “material” actions necessary to provide
an infrastructure for digital media. On an immediate level, these actions can be
thought of as a nodal network of bodies and machines in which machines combine
with humans to perform tasks: the manipulation of software packages, the
shooting and compression of video, the recording and recasting of audio. In addition,
we have the even wider infrastructural support necessary for producing such media
objects: the institutional search for grants, the subvention of copyright clearances,
the securing of financial support for and mentoring of graduate students, and
technical assistance provided by, variously, presses, contract programmers,
videographers, and animators.
By embodied labor, more narrowly, we mean the physical actions (often
disciplined by machinic interactions) that go into interacting with machines — the
focusing of the eye on the screen, the repetitive hand movement, the response of the
ear to input, and the performative bodily movements when interacting with machines as
physical objects. This distinction will be crucial when we come later in the article
to a discussion of the most radical forms of scholarly multimedia currently being
conducted in the academy — performative scholarship.
Purification and the Problem of Material Rhetorics
A host of binary oppositions emerges when we reflect on the unusual space scholarly
multimedia occupies within the academy, particularly within the humanities: content
versus form, information versus materiality, multimedia versus print, collaboration
versus single-authorship, nodal or networked “writing” versus
linear academic prose, word versus image, and so on. These binaries are often cited
as arguments for the line we draw between print and new media as well as between
intellectual labor (often seen as pure information) and bodily labor (often rendered
transparent) in the process of producing scholarly works. But such binaries are by no
means sustainable, and lead to a proliferation of hybrids, in the Latourian sense, as
the labor practices of academics who work in multimedia have become more and more
visible as embodied material practices.
In Bruno Latour’s articulation of the modern constitution, he offers
purification as a term to describe the institutional practice of
vigorously separating the domain of the social from the domain of nature. But this
practice of purification is met with resistance as there continue to arise objects
(and by extension practices) that refuse to be easily contained within one or the
other of these purified domains. Modernity attempts to subsume such unrulqy “quasi-objects” or hybrids by characterizing them as “a mixture of two pure forms,” so that rather than tearing at
the fabric of modernity’s stable ontology, they reinforce the purified domains of the
material and the social that constitute modernity [
Latour 1993, 78]. The consequence of this dual process of purification and mediation (Latour also
calls this mixing of domains “translation”) is a
frustration with modern philosophy’s incapacity to account for the proliferation of
hybrids other than by resorting to a pernicious relativism at the expense of more
nuanced accounts of the relationship between materiality and cultural productions.
Within the academy we see these processes of purification and mediation at work,
producing and maintaining the distinction between intellectual labor and material
labor, both of which are essential to multimedia production.
The distinction between intellectual and material labor is pervasive throughout
scholarly criticism and evaluation of media forms. But usually these oppositions
amount to a debate over genre in terms of
rhetorical construction,
rather than its material conditions. In addition, any discussion of scholarly
activities in multimedia format are usually elided in favor of literary texts, which
can be safely analyzed using traditional tools of critical analysis. Thus early
criticism of hypertext, for example, focuses on its rhetorical difference as a
reading and writing practice. However, critics of this early celebration of hypertext
generally point out the ways that print conventions have
always been
associative, non-linear, and intertextual, citing footnoting and indexing as examples
of the always already hypertextual nature of print. Richard Grusin, for one,
demonstrates how ascribing revolutionary qualities to electronic writing is
tantamount to a technological fallacy whereby we ascribe agency to technology itself
rather than attending to the ways in which writing is always produced in particular
historical, social, and technological contexts. In this way, he asserts, rather
paradoxically, that electronic authorship is the same as print authorship only
different: “To then imagine that current technologies of (and like)
writing are destabilized by pointing out that they have histories is only to
suggest that since things used to be different, they could be again”
[
Grusin 1996, 52].
Some attempts have been made to reintroduce the material world into new media texts.
In a reexamination of literary “cybertexts,” for example, [
Aarseth 1997] attempts to reconcile the “new/old” contradiction pervasive in media criticism. Aarseth’s project, he
claims, is to create a space within literary theory that can account for new media
technologies. At the same time, however, Aarseth dismisses new media technologies as
“not important in themselves” in order to favor a
reader/user-centered approach to cybertext that disregards media-specific rhetorics
and aesthetics, both of which, implies Aarseth, are superficial: “The ideological forces surrounding new technology produce a
rhetoric of novelty, differentiation, and freedom that works to obscure the
more profound structural kinships between superficially heterogeneous
media”
[
Aarseth 1997, 14]. By focusing on the role of the reader in the construction of meaning,
regardless of the medium in which meaning is delivered, and by redefining writing
itself as a “material machine” (and therefore only
superficially different from new media) Aarseth dismisses arguments for cybertexts’
newness as being premised on extraneous distinctions [
Aarseth 1997, 18–24]. In this way, Aarseth levels the field between digital and
non-digital literary objects and redefines
cybertext, not in material or
technological terms, but as “a
perspective on all forms of textuality”
[
Aarseth 1997, 18]. This view fails, however, to account for actual material and technical
differences between media, as well as the material-social differences (i.e. in the
skills and knowledges required to produce such works) that necessitate a more nuanced
account of new media as facilitating new rhetorical modes.
More recent criticism has begun to grapple with the idea of media writing as a
practice that is embedded in
both rhetorical and material networks of
machine and institution. Mary Hocks and Michelle Kendrick consider the “modern constitution” in terms of the purifying impulses that “dichotomize our experiences with visual and verbal
communication systems”
[
Hocks & Kendrick 2003, 3]. The binary that emerges within the humanities between word and image points
to a larger constitutional dichotomy between old modes of scholarly practice and new
modes. This dichotomy, often described in critical discourse as a contest among
media
[2],
produces two contradictory purification narratives, the first being overstated claims
of new media’s radical newness and the second being claims of its radical sameness.
Early enthusiasts of hypertext, Michelle Kendrick points out, have claimed that
electronic writing, by embedding technologically associative structures in a
non-linear way, function more like the natural human brain than the artificial medium
of print. In this way, hypertext enthusiasts have claimed that new media “truly reveals the subject, for it enacts the patterns of
cognition in the human mind[…]”
[
Kendrick 2001, 233]. Such claims, Kendrick writes, rely on the notion that the subject of writing
in print culture has been rendered obsolete by the emergence of new media [
Kendrick 2001, 233].
This ongoing debate about new media’s functional (and in some cases even biological)
difference from old media contributes to a double erasure, for scholars working in
multimedia, of both their intellectual contributions and their material labor. If
multimedia is regarded as no different from other scholarly forms, the complex labor
practices and new knowledges required to produce scholarly works of multimedia, such
as interface design, coding, video production, hardware support, institutional
interactions and so on, may be devalued to the extent that they are seen more as
service (akin to maintaining a department’s computer lab or website) or not seen as
meaningful scholarly activity at all. This leads to the reduction of scholarly
multimedia to the status of “unacademic,” suggesting that it is
somehow less intellectually significant than “equivalent” works
produced in print because the differences between media are
“superficial.” Here we find ourselves in a bind similar to the
“old/new” argument. On the one hand, if we claim that
digital scholarship is old scholarship translated to a new format, we elide the ways
in which multimedia fundamentally changes scholarly argument; on the other hand, if
we regard multimedia as radically other to scholarly production (i.e.
“new”), the intellectual and rhetorical expertise of multimedia
authors/engineers may also be discredited insofar as they are working in a medium not
recognized within the institution as scholarly enough. Furthermore, as a consequence
of casting academic labor practices in these ways, the material practices of
all scholarship are erased, as traditional scholarship is purified as
a solely intellectual act. Narratives of purification that dictate which scholarly
practices count as intellectually significant and which don’t foreclose the
possibility of accounting for multimedia as a viable scholarly activity and limit our
understanding of how scholarly activity more generally is socially and
technologically constructed.
Old Media and New Media: The Problem of (Scholarly) Humanism
The emergence within the academy of scholarly multimedia as a new rhetorical genre is
certainly not the first time that technological change has prompted anxious
reconsiderations of humanism. Rather, it exists as one localized example of an
ongoing concern about the status of the human in relation to technology. In
Gramophone, Film, Typewriter, Friedrich A. Kittler argues
that media threaten, indeed have always threatened, to render the liberal humanist
(and by extension, we would argue, the humanist scholar) obsolete [
Kittler 1999]. According to Kittler, prior to the invention of devices
such as the phonograph that could record sound waves, writing was imagined as the
only means to transmit the voice of the author. In this respect, the voice of the
author, as it was imagined by readers, functioned as a kind of “fictitious elevated phallus born from the alphabet”
[
Kittler 1999, 70]. With early recording devices, the modern engineer was able to capture the
waves of human vocalizations and could thus reproduce this “fictitious phallus” technologically, calling into question the purity of
the phallic voice. Kittler elaborates on this in his discussion of Rilke in which
Rilke describes phonographic emanations as “primal
sounds.” In other words, phonographic recordings, which seem to capture the
human voice “as it really is,” offered the illusion of
primacy (immediacy) and in this way appear to outperform the written word:
With the demise of writing’s storage monopoly comes to an end
a love that was not only one of literature’s many possible subjects but also
its very own media technology: since 1800 perfectly alphabetized female readers
have been able to endow letters with a beloved voice. But tracing primal sounds
has, as Rilke put it, nothing to do with “the presence of
mind and grace of love”.
[Kittler 1999, 70]
In this passage, we see a crucial split between mind and body take shape: “machines have taken over the function of the central nervous
system”
[
Kittler 1999, 51]. Machines are primal and embodied and therefore threaten the subject of
writing. Suddenly, with the emerging importance of the machine engineer, there is the
capacity for writing without a subject-author, and so the role of the subject-author
is no longer entirely stable. One important consequence of machines taking over the
function of the central nervous system is that, for the first time, memory
suqpersedes “spirit” as the imminent characteristic of
subjectivity, yet memory is no longer solely the domain of the mind or brain. It can
also be scratched on surfaces. Memory has now been externalized by media
technologies. The consequence of this externalization of memory, Kittler argues
rather dramatically, is that “Media render Man[…]superfluous[…]The fictional elevated
phallus shrivels up[…]the engineer has finally beaten the author”
[
Kittler 1999, 78]. As Kittler’s historical analysis reveals, this perceived contest between
media technologies (captured here through the figure of the engineer) and the liberal
humanist subject-as-author (presumed here to be male or at least to possess the
phallus) is ongoing. More interestingly, we see this contest structured around yet
another series of dichotomous relations: author versus engineer, soul versus memory,
writing versus recording, humanities (e.g. the poetry of Rilke) versus science and
technology (e.g. phonographic recordings), and ultimately, mind versus
body.
[3]
In “The Condition of Virtuality”
[
Hayles 1999a] and
How We Became Posthuman
[
Hayles 1999b], N. Katherine Hayles’ offers a similar narrative of the
emergence of the tension between mind and body, which she casts as a tension between
virtuality and materiality. As a result of post-World War II scientific discoveries
(namely, DNA and genetic code) we (meaning Westerners) have experienced a paradigm
shift in the ways we imaginCe the “self.” Whereas prior to these
discoveries we imagined the material body and the “self.” as a
unified, self-identical whole (this is what Hayles calls humanism), in the post-DNA
age the body is re-imagined as a container or husk for the self, which is itself
re-imagined as an informational pattern produced by and through genetic code. Hence,
writes Hayles, we see the emergence of a posthuman dialectic — information versus
materiality — where the former trumps the latter as the root cause of the (illusion
of the) liberal humanist subject. “A defining characteristic of
the present cultural moment,” Hayles writes, “is the belief that information can circulate unchanged among
different material substrates”
[
Hayles 1999b, 1]. The body, in such a posthuman arrangement, becomes the “original prosthesis”
[
Hayles 1999b, 1]. This ongoing tension between materiality and informatics contributes to our
understanding of how we in the academy think about multimedia in relation to other,
more “legitimized” modes of scholarly practice. For one, the
materiality of multimedia scholarship is constantly under erasure insofar as we
imagine that the heart of any scholarly work (the intellectual part) is purely
“informational,” as if, like Athena, it springs forth from the
scholar’s mind and takes up residency inside the book or article or machine. Hayles,
drawing on Richard Doyle, calls it an “impossible
inversion,” where the informational pattern or code is imagined as actually
producing the thing on which the pattern nonetheless depends [
Hayles 1999b, 293].
In the case of humanities scholarship and the methods by which we evaluate and
validate research practices, Hayles’ “impossible
inversion” surfaces as a practice of purification wherein the embodied or
material aspects of scholarly work are rendered secondary to (rather than
constitutive of) scholarly argument. We imagine that the intellectual content of
scholarship pre-exists its material enactment. Deborah Lines Andersen, in her
introduction to
Digital Scholarship in the Tenure, Promotion,
and Review Process, reiterates this view:
The critical issue in academe is what one does with what one
has. It is the act of creation that defines the digital scholar. Tools such as
computers and software programs are critical to this creation, but they are
only the means to this end.
[Andersen 2004, 3]
While
Digital Scholarship is a valuable and
ground-breaking discussion of the institutional problems faced by those working in
multimedia, Andersen’s attempt to define digital scholarship as independent from the
medium in which it is produced tends to undermine her argument for the value of
digital work. We should be mindful, then, of Hayles’ criticism of similar virtualist
accounts that disregard the material substrates upon which informational patterns
depend. Perhaps understandably, given its computational origins, Andersen sees
digital scholarship as better suited to natural or social sciences where research
tends to be presented graphically (for example, in the form of maps or charts) or
quantitatively. She does her best to argue for the application of these existing
strengths to a wider range of cultural materials.
Arts, languages, literature, philosophy, and religion have not
naturally embraced digital scholarship in the ways exhibited by scientists and
social scientists. There are a variety of very good reasons for this
resistance. Foremost among these reasons is the type of material humanists
study. Diaries, plays, music scores, novels, paintings, religious works, and
philosophical treatises, to name a few, do not lend themselves to
quantification.
[Andersen 2004, 9]
Along with arts, languages, literature, philosophy, and religion, we might add
film studies, visual culture, cultural studies, science studies, and new media, all
of which lend themselves quite well to scholarly analyses using multimedia precisely
because they are not constrained by the purely textual.
More to the point, this view fails to account for versions of scholarly multimedia,
particularly within the humanities, that do
more than facilitate textual
or rhetorical analyses of print literature or art objects through the use of a
computer. In part, Andersen’s restrictive view of digital scholarship within the
humanities stems from an historically narrow understanding of the diversity of
humanities research as fundamentally ancillary to the text, rather than
transformative. Certainly Andersen is not alone in her assumptions about the meaning
of digital scholarship within the humanities, nor is such an argument without value
for the crucial scholarship of digital annotation, translation and preservation.
Again, [
Hockey 2000], [
Drucker 2002], and [
McGann 2004] are among those who imagine media technologies as useful to
humanities scholars insofar as they facilitate the capturing, cataloging, and
indexing of “electronic texts,” and rightly so [
Hockey 2000, 1]. And while we recognize the crucial value in this
practical application of technology, we resist the argument that electronic archival
work offers a totalizing view of the possibilities offered by digital humanities.
Such a limiting perspective reveals precisely the sort of virtualism that, as Hayles
points out, relies on the unusual notion that information can exist independently of
its medium:
The illusion that information is separate from materiality
leads not only to a dangerous split between information and meaning but also to
a flattening of the space of theoretical inquiry. If we accept that the
materiality of the world is immaterial to our concerns, we are likely to miss
the very complexities that theory at its best tries to excavate and
understand.
[Hayles 1999a, 30]
This passage from Hayles bolsters her claim that literature
itself is undergoing a revolution as a result of digital technologies
and that, as literary critics, we must confront these changes by incorporating an
awareness of a text’s materiality into our analyses. We would extend this argument to
suggest that the very practices of literary and cultural analysis are undergoing a
parallel revolution and that we must also confront these changes and embrace the full
potential of multimedia as a rich, complex scholarly medium.
How Scholarly Media Restructure Intellectual Work
All of these discussions, from the early hypertextual emphasis on the newness of
multimedia, through critiques of this newness in favor of a continuation of existing
textual practices through to, finally, the important recognition of the material
embeddedness of media that must accompany any evaluation of what it means to be a
digital humanist, present a trajectory of media criticism that moves us closer and
closer to a recognition of the crucial materiality of digital rhetorics.
From this trajectory, we can begin to formulate a true manifesto for digital
scholarship. If we are to argue for the value of multimedia work in the academic
milieu, we must confront the physicality of rhetorical practices themselves. On the
most physical level: what can we make, given the material constraints of the machines
we work with? And on the rhetorical level: what can we argue (or not argue) given the
structures we're given to work with (software packages, database design) which are
themselves constrained by issues of memory storage, drive and processing speed? But
most importantly: why and how does the academy seek to constantly devalue the work we
do as multimedia scholars by casting it as instrumental practices of rhetorical and
material labor, rather than the intellectual practices of analysis and criticism –
and what can we do about this perception?
Addressing these important issues requires, first, that we break open our
understanding of what scholarly multimedia is and can become. Andersen’s primary
example of digital humanities scholarship consists of digitizing Jane Austen’s work
in its entirety in order to perform database queries of main characters. As Andersen
points out, this is hardly an appropriate or efficient scholarly use of computing
technology. But then again, computer assisted textual analysis, while valuable, is
not the only role computing plays within the humanities, and such a view ignores
recent (and not so recent) forays into argument-driven scholarly multimedia, notably
a number of academic presses who have experimented with publishing original works of
scholarship in laserdisc, CD-ROM, and DVD-Rom format.
[4] In terms of rhetorical strategies, the
significance of these works is their contribution to humanities knowledge where the
contribution itself exists as medium-dependent and cannot simply be reduced to acts
of digital archiving or remediations of a pre-existing scholarly book. On a more
basic level, the materiality of these works — both in terms of production and
delivery in tangible format — leads us to consider the immense technical labor
involved in producing scholarly multimedia.
It is important to note that one of the chief characteristics of the above titles is
that they are “published” in tangible form — CD-ROM, DVD-ROM or
laserdisc — and thus at least benefit from the fetishization so readily apparent in
the academy of the print document as a physical form. More recent works in multimedia
(mostly web-based works) confound even this basic understanding of what constitutes a
“text.” Roderick Coover’s
Voyage Into the
Unknown
[
Coover 2008], an “interactive documentary”
about John Wesley Powell’s journey down the Colorado River in 1869, consists of
tagged maps, first-and third-person narratives and analyses, and invites readers to
integrate all these modes into thesir own “journey.” Additionally,
we must account for the many non-“publishable” but infrastructural
multimedia projects proliferating in the community: the development of authoring
software such as if:Book’s SOPHIE and Juan B. Gutierrez’
Literatronic; the CommentPress project supported by MediaCommons; and the
open peer-review model pioneered by Noah Wardrip-Fruin for his book
Expressive Processing
[
Wardrip-Fruin 2009]. Evaluating these works as scholarly activity has proven
difficult in an academy so wedded to the physical artifact as indicative of
“real” scholarship.
Finally, digital scholarship can take on radical, literally physical forms. To take
as one case in point, consider Marcel O’Gorman’s
Dreadmill
[
O’Gorman 2005]. Described as “Critique,
Performance, Installation, Education,” this unruly hybrid of art
performance, argument and exposition is by far one of the most provocative examples
to date of a re-embodiment of humanities scholarship. While running on a treadmill
that generates a multimedia display, O’Gorman critiques our culture’s increasing
denial of the body and our increasingly sedentary lifestyles. He delivers a smart,
theoretically informed presentation about the relationships between technology,
death, violence, mobility, consumerism, corporeality, disability, and even
nationality and national borders. The entire performance lasts about one hour.
How might such a performance be classified as a work of scholarship? It isn’t
“publishable” in any traditional sense, though the ideas are
sophisticated enough in that respect. Most troubling, to the academy, is the fact
that it would be impossible to disentangle the content of Dreadmill from its delivery medium — its dynamic presentation. It is
certainly more than a conference presentation. And while O’Gorman is an artist among
other things, Dreadmill isn’t easily classified as an
art installation. For one, unlike other somewhat famous “body
artists” like Stelarc, Dreadmill is not
just about manipulating the body in visually provocative or sensual ways. While
running, O’Gorman delivers a thesis-driven academic argument. He cites Nietzsche,
Kittler, Virilio, Haraway, Ernest Becker, among other scholars. In all aspects,
Dreadmill represents a new frontier in reimagining
humanities scholarship. It also foregrounds the roles of both multimedia and physical
bodies in the practice of humanities scholarship where the stakes of that scholarship
are no less than (bodily) death and (intellectual) obsolescence.
Jay David Bolter has suggested that theoretically informed multimedia performances
such as O’Gorman’s
Dreadmill are often the products of
new media artists and thus are only tangentially related to the academy [
Bolter & Grusin 2000, 24]. He points this out in order to argue that a key
dichotomy that takes shape within the academy is that of theory versus practice
(which, of course, is another deployment of the mind/body dichotomy). While this
divide between theory and practice may have been clearly in place in the past,
performative scholarship such as O’Gorman’s threatens the integrity of precisely such
a divide. O’Gorman’s status as an academic as well as new media artist is well
established; he has been a tenured Associate Professor of English at the University
of Detroit Mercy; he is now in the Department of English at the University of
Waterloo, where he also directs the
Critical Media Lab. In other words, as both a multimedia performance artist
and scholar, O’Gorman embodies a new kind of academic professional — a cyborg scholar
— who answers Bolter’s call, that “media theory engage with the practice of digital
media”
[
Bolter & Grusin 2000, 25]. O’Gorman demonstrates the kind of hybrid scholarship possible in our current
digital age, in which the tools available to humanities scholars extend far beyond
the textual to include the material, the technical, and the rhetorical (not to be
confused with the textual). Gregory VanHoosier-Carey and Ellen Strain, practitioners
of scholarly multimedia themselves, frame these new potentialities offered by new
media in terms of interface design which they site as an often invisible locus of
rhetoric praxis. Interface design, they argue, creates “architected meaning, an arena within which the demonstration
of humanities methodologies can take on a dynamic form”
[
Strain & VanHoosier-Carey 2003, 259].
“Selling” New Media: the Problem of Genre and Tenure
Confusion within the institution over how to categorize and evaluate scholarly
multimedia often amounts to a tension between “the application of
digital scholarship”
to research, to quote Andersen, as opposed to doing digital scholarship
as research [
Andersen 2004, 11]. This tension seems symptomatic of
a larger problem within the institution to reckon with the emergence of new media,
particularly at the level of promotion and tenure where the traditional model of
humanities scholarship as intellectual labor dominates. According to this traditional
model, a scholarly publication in an online journal, even if the writing itself was
performed on a word processor, “counts” as digital scholarship
primarily because it can be easily be measured according to traditional print
standards: is the journal peer-reviewed? Does the journal have a reputation of being
intellectually rigorous? While such online publications, which have significant merit
in their own right, are in the practical sense digital, they don’t necessarily depart
significantly from print-based journals. Nonetheless, e-journal articles are often
devalued for the simple reason that they do not appear in print form.
[5] By relying on this
older and, frankly, obsolete model for defining and evaluating scholarship, we
continue to privilege content over form, intellectual labor over physical labor, and
print over digital media.
Scholars working in multimedia have been forced to reckon with this problem and must
continue to engage with fundamentally conservative analogies to argue for the
scholarly merit of the project. The first project in Penn Press’
Mariner10 series,
Red Planet
[
Markley et al. 2001], led by Robert Markley (at some professional risk) had
to be “pitched” to presses, granting agencies, and fellow
colleagues as a multimedia version of a scholarly book. The argument necessary to
secure publication and scholarly credibility even took the form of equating the
storage capacity of a DVD-ROM to the thickness of a book: “This storage capacity means that a DVD-ROM can hold several
hours of high-resolution video, the equivalent of a book ninety feet
thick…”
[
Burgess et al. 2003, 67–68]. While describing the project in terms of such an equivalence seemed a
necessary step at the time to gain entrance into the humanities scholarly canon in a
way that would “matter,” especially for collaborators who were
untenured or still in graduate school, such a decision would also force the project’s
authors to reconsider the implications of such a choice in terms of the politics of
remediation. Were the authors really challenging the conventions of humanities
scholarship by producing such a work of multimedia, or were they hampered by old
standards for what counts as legitimate scholarship? Were they, by claiming to
remediate the scholarly book, limiting the potential of what we were already
recognizing as a new and valuable rhetorical genre? The answer to this last question
is certainly yes, and points to
Red Planet as a
first-generation (and conservative, given what can be done with the form) work of
scholarly multimedia. Nonetheless, much was gained by working through the
institutional and rhetorical challenges that multimedia practitioners face in
articulating the significance of their scholarly activities.
As we have suggested, scholarly multimedia has often been situated outside of the
traditional model of scholarly activity insofar as its practitioners participate in a
host of activities rarely recognized as “intellectually
significant.” Coding, shooting and editing digital video, interface and
information design, data-basing, troubleshooting, debugging: these activities often
fall outside the purview of traditional notions of humanities scholarship. In a
supreme irony, it is only after the project has itself become the object of critical
inquiry, for instance in a scholarly print article reflecting on the visual rhetorics
of multimedia design, do these activities come into view. Two examples of such
post-production publications include, as we have previously mentioned, “The Dialogics of New Media: Video, Visualization, and Narrative in
Red Planet: Scientific and Cultural Encounters with
Mars
”
[
Burgess et al. 2003], as well as “Eloquent Interfaces:
Humanities-Based Analysis in the Age of Hypermedia”
[
Strain & VanHoosier-Carey 2003]. In both articles, which appear in
Eloquent Images: Writing Visually in New Media
[
Hocks & Kendrick 2003], authors reflect critically on their collaborative
multimedia projects; thus the articles bear two crucial markers. First, they offer a
kind of testimonial of the work accomplished in the multimedia project itself,
explaining some of the works’ features, and some of the authors’ technical choices;
Second, the articles argue for the importance of the combined intellectual and
material labor practices that went into the multimedia projects. These
characteristics of early articles about the practice of scholarly multimedia suggest
rather strongly that multimedia is a rich medium in which to work. However, these
articles also demonstrate that, at the time of their publication, it still seemed
necessary to argue aggressively for the merits of multimedia as a new scholarly
genre, suggesting that multimedia remained, and continues to remain, outside of
accepted definitions of what counts as legitimate scholarship. This perception of the
need to defend the significant and unique contributions of multimedia has been of
particular concern for scholars who have embraced multimedia production as their
primary research activity despite obvious professional challenges and risks. More
importantly, the emergence of scholarly multimedia points to a fundamental conflict
between traditional views of the humanities scholar and the new digital scholar who
threatens to reveal the former’s purchase on reality.
One way to trace the origins of the traditionalist view is to situate evaluations of
humanities research in terms of its perceived difference from natural or social
sciences research. Multimedia, because it relies overtly on digital technologies, has
been historically situated in an intermediary position between these two disciplines.
The definition of digital scholarship offered by the traditional model depends on
seeing scientific research as quantitative and graphical and humanities research as
textual and/or rhetorical. Even when humanities scholarship does make use of visual
or graphical content, for instance in art history, the graphical nature of the
scholarship is commonly viewed as the subject of the investigation (akin to
scientific data) rather than a rhetorical or research tool (akin to a graphical
representation of the data). Scholarly multimedia, on the other hand, relies heavily
on graphical interfaces, navigational schemas, and visual layout as well as text as
essential rhetorical tools for the construction of arguments and the production of
meaning. In this way, multimedia occupies a liminal space between or even beyond
science and humanities as a new mode of scholarship and is, as a consequence,
battered by traditional definitions of what constitutes research within
the humanities. Is research found in the production stage or embodied within the
final new media object? Is it the rhetorical analysis one produces as part of the
multimedia work, or the analysis one writes about the production process, or the
rhetorical analysis one writes about the new media object? Ironically, because new
media work has been so hampered by accepted models of humanities scholarship that
privilege content over form and intellectual labor over technical labor, the
temptation exists to see print-articles or books about multimedia as more valid than
the multimedia work itself. In fact, a host of well-known
“multimedia” scholars have themselves never actually practiced
multimedia. This is by no means to suggest that scholarship about
multimedia is not valid or important or that all critics of multimedia must,
themselves, become practitioners (in the same way that we would not expect literary
critics to also become poets or novelists). Rather, we should take care not to
confuse storage medium (book versus multimedia) with rhetorical genre (book versus
multimedia) lest we fall into the trap of technological determinism, or worse,
technophobia, when evaluating the merits of a scholarly work.
One way to draw ourselves out of this bind is to pay attention to the key overlap
between representationalism (what humanities scholars are assumed to do) and
performativity (what bodies and machines are assumed to do) in the context of the
technologies we work with in producing multimedia. In
Embodying
Technesis, and later in
Bodies in Code, Mark
Hansen calls for a deeper understanding of the role embodiment plays in producing
reality ([
Hansen 2000], [
Hansen 2006]). At the same time,
he argues, we must develop a more robust, materialist account of the ontological role
of technology. Technological change, he states, is so foundational to human
experience that it has taken on an “extracultural, extrasocial dimension”
[
Hansen 2000, 3]. This transformation invites us to reconsider technology in terms of its
resistance to “explicit cultural thematization” or “representational capture” so that we can come to understand
technology as an agent of “material complexification” that
does not rely solely on cognition or human intervention for its evolution ([
Hansen 2000, 56], [
Hansen 2006, 19]).
Hansen’s argument in both books, that we must move beyond a representationalist
understanding of humankind’s relationship to technology by focusing on embodiment,
suggests that we should also rethink our own identity as scholars and intellectuals,
in particular the ways in which our scholarly activities are bound up at a very deep
level with the technologies we use to practice our craft. We believe scholarly
multimedia offers a promising answer to Hansen’s call insofar as it can truly perform
at the nexus of what Hayles calls our posthuman “mindbodies”
[
Hayles 2005, 7]. Technology does not merely assist us as representationalist scholars. Rather,
it transforms us into embodied agents.
Performing Scholarship: A Radical (Technological) Act
In complicating the traditional academic model of disembodied intellectual activity,
scholarly multimedia tends toward what Andrew Pickering calls the “performative idiom,” a model that foregrounds the material
agencies (both human and nonhuman) that emerge as essential to the scholarly
production of knowledge [
Pickering 1995, 7]. Scholarly multimedia
stands as an unruly and undisciplined body of work that challenges humanities
scholars’ claims about what we “do” precisely because it changes
what we do at the material level, revealing that what has been overvalued all along
is the immaterial, intellectual act that has often been conceived of as existing
independently from social, institutional, and material contexts. In this respect,
scholarly multimedia makes visible what Marcel O’Gorman calls the
material
remainder, “the repressed technological element of humanities
scholarship”
[
O’Gorman 2006, 6]. This material remainder includes the material-technical labor practices of
multimedia scholars as well as the material contexts and constraints of the scholarly
production of knowledge in general.
By making these aspects of scholarly practice visible, multimedia reveals the
repressed other, the material monster if you will, of scholarly production and
invites scholars working in this genre to take seriously O’Gorman’s recommendation
that we engage with the materiality of our own knowledge-productions:
If the remainder is hidden or repressed, monstrous
“other” of the conventional academic discourse, then
those who seek to change that conventional discourse might engage in a science
of
anagnorisis
; that is, a science of invention and knowledge-production that depends
on a face-to-face encounter with the monster.
[O’Gorman 2006, 4]
In part, this engagement can be achieved by making visible the strategies that
scholars employ to construct arguments that are valued for their capacity to produce
closure and containment, and to construct a scholarly subject-of-writing as a
hyper-rational, often-disembodied subject, a subject described by Bruno Latour in
Pandora’s Hope as a “mind-in-a-vat”
[
Latour 1999, 12]. The denial of the material remainder of writing is too horrible to
contemplate for long: Latour’s formulation of a giant brain floating in a vat of
fluid attached by wires to a CPU, or worse, a typewriter, or, still worse, pen and
paper. A single pattern, a single brain, a single author alone in a small dark room,
immersed in the gray matter of others who came before. This is the image cultivated
by the notion of an “immaterial” disembodied humanities scholar
resistant to rediscovering the materiality of his or her own activities.
In “Interactive Technology and the Remediation of the Subject of
Writing,” Michelle Kendrick writes that early critical discourse about the
revolutionary nature of hypertext centered on its supposed ability to better reflect
the way we think — in nonlinear, networked associations. Such claims, she argues,
depend on a dubious double logic: that through its intensification of media
technologies, hypertext erases mediation. “This double
logic,” Kendrick continues, “promises metaphysical transcendence, while paradoxically
grounding such transcendence in technology’s materiality and
specificity”
[
Kendrick 2001, 233]. Kendrick’s crucial insight, that all subjects-of-writing are produced by and
through material-technological interventions, invites us to reconsider traditional
print-based scholarship in order to uncover this double-logic. Her critique reveals
the incoherence of the subject-of-writing that is covered over by media-specific
strategies such as dense, esoteric, often impersonal academic prose, complex citation
practices, as well as the conventions of single-authorship. Such strategies continue
to set the standards by which we define and judge ourselves as scholars, and this
evaluation is extended through the peer-review process as well as through the
promotion and tenure process. Multimedia threatens to undermine the establishment of
these standards, not because, as early hypertext enthusiasts claimed, it disperses
the writing subject over vast networks or because it liberates the reader from the
tyranny of the disembodied, single author. Rather, scholarly multimedia threatens to
re-embody the heretofore disembodied intellectual by embracing a more performative
mode or, to borrow from feminist philosopher of science Nancy Tuana, an
interactionist mode of scholarly practice that emphasizes the “emergent interplay” between “human
materiality and the materiality of the more than human”
[
Tuana 2001, 221–223]. The multimedia scholar, by taking seriously
the materiality of knowledge production, embodies an intellectual identity that is
dispersed over material, rhetorical, and technical networks — a crucial
transformation that must be acknowledged when assessing “what
counts” as scholarly activity in the academy.
Works Cited
Aarseth 1997 Aarseth, E. Cybertext: Perspectives on Ergodic Literature. Johns Hopkins
University Press, Baltimore (1997).
Andersen 2004 Andersen, D. L.
“Introduction,” in D. L. Andersen (ed), Digital Scholarship in the Tenure, Promotion, and Review
Process. ME Sharpe, London and New York (2004): 3-24.
Ball 2004 Ball, C. E. “Show, not tell: The value of new media scholarship.”
Computers and Composition, 21 (2004): 403-425.
Bolter & Grusin 2000 Bolter, J.
D., and Grusin, R. Remediation: Understanding New Media.
MIT Press, Cambridge MA (2000).
Burgess et al. 2003 Burgess, H. J.,
Hamming, J., and Markley, R. “The Dialogics of New Media: Video,
Visualization, and Narrative in Red Planet: Scientific and Cultural Encounters
with Mars,” in M. E. Hocks and M. R. Kendrick (eds), Eloquent Images: Word and Image in the Age of New Media. Cambridge,
Massachusetts: MIT Press, Cambridge MA (2003): 61-85.
Coover 2002 Coover, R. Cultures in Webs: Working in Hypermedia with the Documentary
Image. CD-ROM. Eastgate Systems Inc, Watertown (2002).
Drucker 2002 Drucker, J. “Theory as Praxis: The Poetics of Electronic Textuality
(review),”
Modernism/Modernity 9:4 (2002): 683-691.
Easterling & Prelinger 1992 Easterling, K. and Prelinger, R. Call It
Home: The House that Private Enterprise Built. Laserdisc. The Voyager
Company (1992).
Grusin 1996 Grusin, R. “What is an Electronic Author? Theory and the Technological
Fallacy,” in R. Markley (ed), Virtual Realities and
Its Discontents. Johns Hopkins University Press, Baltimore (1996):
39-53.
Hansen 2000 Hansen, M. B. N. Embodying Technesis: Technology Beyond Writing. University
of Michigan Press, Ann Arbor (2000).
Hansen 2006 Hansen, M. B. N.
Bodies in Code: Interfaces with Digital Media.
Routledge, New York (2006).
Haraway 2004 Haraway, D. J.
“Modest_Witness@Second_Millennium.”
The Haraway Reader. Routledge, New York (2004):
223-250.
Hayles 1999a Hayles, N. K. “The Condition of Virtuality,” in P. Lunenfeld (ed), The Digital Dialectic: New Essays on New Media. Cambridge,
Massachusetts: MIT Press, Cambridge MA (2000): 68-94.
Hayles 1999b Hayles, N. K. How We Became Posthuman: Virtual Bodies in Cybernetics, Literature,
and Informatics. Chicago: University of Chicago Press, Chicago
(1999).
Hayles 2002 Hayles, N. K. Writing Machines. Cambridge: MIT Press, 2002.
Hayles 2005 Hayles, N. K. My Mother Was a Computer: Digital Subjects and Literary
Texts. University of Chicago Press, Chicago (2005).
Hockey 2000 Hockey, S. Electronic Texts in the Humanities. Oxford University Press,
Oxford (2000).
Hocks & Kendrick 2003 Hocks, Mary
E., and Michelle R. Kendrick. “Introduction: Eloquent
Images.”
Eloquent Images: Word and Image in the Age of New Media.
Cambridge, Massachusetts: MIT Press, 2003. 1-16.
Kendrick 2001 Kendrick, M. R.
“Interactive Technology and the Remediation of the Subject of
Writing.”
Configurations 9.2 (2001): 231-251.
Kirschenbaum 2008 Kirschenbaum, Matthew G. Mechanisms: New Media and the Forensic
Imagination. The MIT Press, Cambridge MA (2008).
Kittler 1999 Kittler, F. A. Gramophone, Film, Typewriter. G. Winthrop-Young and M. Wutz
(trans). Stanford University Press, Stanford (1999).
Latour 1993 Latour, B. We Have Never Been Modern. C. Porter (trans). Harvard
University Press, Cambridge MA (1993).
Latour 1999 Latour, B. Pandora’s Hope: Essays on the Reality of Science Studies.
Harvard University Press, Cambridge MA (1999).
Markley et al. 2001 Markley, R.,
Higgs, H., Kendrick, M. and Burgess, H. J. Red Planet:
Scientific and Cultural Encounters with Mars. DVD-ROM. University of
Pennsylvania Press, Philadelphia (2001).
McCarty 2005 McCarty, W. Humanities Computing. Palgrave Macmillan, New York
(2005).
McGann 2004 McGann, J. Radiant Textuality: Literature After the World Wide Web.
Palgrave Macmillan (2004).
Mitchell 2003 Mitchell, W. J.
M++: The Cyborg Self and the Networked City. MIT
Press, Cambridge MA (2003).
Mitchell et al. 2008 Mitchell,
R., Burgess, H. J. and Thurtle. P. Biofutures: Owning Body Parts
and Information. DVD-ROM. University of Pennsylvania Press, Philadelphia
(2008).
O’Gorman 2006 O’Gorman, M. E-Crit: Digital Media, Critical Theory, and the Humanities.
University of Toronto Press, Toronto (2006).
Pickering 1995 Pickering, A.
The Mangle of Practice: Time, Agency, and Science.
University of Chicago Press, Chicago (1995).
Strain & VanHoosier-Carey 2003 Strain, E, and VanHoosier-Carey, G. “Eloquent Interfaces:
Humanities-Based Analysis in the Age of Hypermedia,” in M. Hocks and M.
Kendrick (eds), Eloquent Images: Word and Image in the Age of
New Media. MIT Press, Cambridge MA (2003): 257-281.
Strain & VanHoosier-Carey 2004 Strain, E, and VanHoosier-Carey, G. Griffith In Context: A
Multimedia Exploration of D. W. Griffith’s The Birth of a Nation. 2
CD-ROMs. W.W. Norton Company, New York (2004).
Tuana 2001 Tuana, N. “Material Locations : An Interactionist Alternative to Realism/Social
Constuctivism,” in N. Tuana and S. Morgen (eds), Engendering Rationalities. SUNY Press, Albany (2001): 221-243.
Vannatta et al. 2005 Vannatta,
J., Schleifer, R. and Crow, S. Medicine and Humanistic
Understanding: The Significance of Narrative in Medical Practices.
DVD-ROM. University of Pennsylvania Press, Philadelphia (2005).