Introduction: Demo or Die
How does one tell the story of a computer system? As Larry Owens observes in his
essay on U.S. engineer Vannevar Bush, “However the historian chooses to answer [this question],
utility must certainly play a role”
[
Owens 1991, 23]. In computer science and engineering, there is an emphasis on prototypes,
software, things that are concrete.
[1] This applies to engineering discourse as
well; one of the main criteria applied to engineered technological solutions is that
they work [
Childress 1998], or more precisely, that they are
seen to work. A good working prototype can send shockwaves throughout
a research community, and it can inspire a host of new machines in quick succession.
This “witnessing” is fundamental to the evolution of technical artefacts; when
people see a machine in use, they can visualise the future of the object, connect it
with what they are doing in their own work, and connect it with other machines or
families of machines. An inventor is always and also a “combinatory” genius,
selecting the best technical forms from a number of possibilities, and combining
these into a new artefact. What has been witnessed, evaluated and shown to work
constitutes the material for transfer.
This emphasis on prototypes and demonstrations is not just historically specific to
mid-twentieth century engineering discourse; it is also evident in contemporary new
media.
Demonstrations have had an important, perhaps even central,
place in new media innovation. In some centres of new media, the traditional
knowledge-work dictum of “publish or perish” is replaced by “demo or
die.”
[Wardrip-Fruin & Montfort 2003, 231]
To put it simply: there is a difference between technical vision and technical
artefact. As I have argued elsewhere [
Barnet 2008], we can dream of
time machines and of warp speed — but the reason an engineering prototype has a rapid
and often “brutal” productive effect on its milieu is that it displaces
technical and financial limits and demonstrates what is possible. Sometimes, it
creates new paradigms.
In this article I will be tracing the development of two important prototype systems
in the history of hypertext, and the new paradigms they created: the Hypertext
Editing System (HES) and the File Retrieval and Editing System (FRESS). HES was the
world's first word processor to run on commercial equipment. It was also the first
hypertext system that beginners could use, and pioneered many modern hypertext
concepts for personal use. FRESS was Van Dam’s second attempt at a hypertext system,
and incorporated some ideas from another pioneering hypertext system from the 1960s,
Douglas Engelbart’s oN-Line System or NLS. HES and FRESS were developed at Brown
University in the late 1960s under the leadership of Andries Van Dam, Professor of
Computing Science at Brown. They were built at a time when computers, in large part,
were still seen primarily as tools for mathematical calculations, and computer
engineers had no business talking about text editing or interactivity. In an
interview with the author, Van Dam recalls that in the 1960s “the whole idea of a user in an interactive computer loop was
still foreign to most people”
[
Van Dam 1999]. The story of HES and FRESS is a remarkable one as much for its audacity as
its historical influence, and the lack of detailed literature on its development is
surprising given this influence. As working prototype systems, they had technical
chutzpah.
The
idea of hypertext predates HES and FRESS. The term was coined in
1962 by computer visionary Theodor Holm (Ted) Nelson to describe “nonlinear”
text, although the concept of a technical system designed to facilitate nonlinear
text can be traced back as far as 1910.
[2] Nelson
was a co-designer of HES, but was most famous for imagining a hypertext system in the
mid-sixties called Xanadu. Xanadu, like its fictional namesake by Samuel Taylor
Coleridge, was a vision in a dream, a computer filing system which would store and
deliver the great body of human literature, in all its historical versions and with
all its messy interconnections, acknowledging authorship, ownership, quotation and
linkage. Nelson began writing about this idea in the sixties, and it has been
“under development” for fifty years hence; he has not produced a working
prototype or demo of Xanadu, although he did release some shells of code in 1999. To
Nelson’s dismay, and unfairly, it has consequently been hailed as “the longest-running vaporware project in the history of
computing”
[
Wolf 1995]. Due in part to this lack of a real-world prototype, Nelson has had difficulty
attracting funding or having his work taken seriously. This vision of hypertext did,
however, inspire Van Dam.
Although Nelson was a co-designer of HES, there was a falling-out with the team
during its design and implementation, and Nelson stated in an interview with the
author that he was unhappy with the result [
Nelson 1999]. As we will
explore in this article, Van Dam and his team were concerned less with grand visions
and more with getting the system built and funded in the real world. HES was
effectively the first hypertext system available on commercial equipment that novices
could use. It introduced interactive reading and authoring to the humanities and the
text link to lay users; it established a technical precedent for systems to
follow.
In this article I will argue that HES and FRESS, like Doug Engelbart’s landmark
system NLS, were influential on the history of hypertext and modern computing in
large part because they
demonstrated the concept of hypertext; they were
both working systems. Where Ted Nelson, with his prescient ideas and presentations,
had been campaigning for “nonlinear writing” housed on a computer for years
without commercial success
[3], Van Dam and his team of mostly undergraduate students actually
built it. It was a difficult project precisely because the HES team had first to
convince the world that manipulating text interactively on computers was not a crazy
idea; convincing them that hypertext was useful was an even harder sell.
The Design of HES and FRESS
Van Dam bumped into Nelson at the 1967 Spring Joint Computer Conference.
[6]
Passionate and eloquent, Nelson started telling him about hypertext. Nelson had been
thinking about hypertext for several years and had tried to design a system at Vassar
College in 1965 [
Nelson 1999], but unfortunately like most of Nelson’s
ideas, it had not eventuated in a product of any kind. When Van Dam met Nelson, “He had nothing to show for this idea, no prototypes or work
in the sense that computer scientists talk about work — i.e., software,
algorithms”
[
Van Dam 1999]. What Nelson did have was a vision of what hypertext might one day look like,
and an infectious enthusiasm for the idea. Nelson envisioned a computer-based
hypertext system where the user could take different trajectories through a network
of information, reading and writing “non-sequentially”
[
Nelson 1999].
Nelson's vision seduced me. I really loved his way of thinking
about writing, editing and annotating as a scholarly activity, and putting
tools together to support that. I hadn't heard of Engelbart. I hadn't heard of
Bush and Memex. So after meeting quite by accident at this computer conference,
and talking about what we each were doing, we somehow got onto the topic. I had
this wonderful graphics display...and I was working on various graphics
applications at the time. He talked me into working on the world’s first
hypertext system and that sounded cool.
[Van Dam 1999]
Van Dam didn't need much convincing. He had been thinking about computers and
writing for some time now. So he gathered a team together at Brown and began work
later that year, with the objective of trying out this hypertext concept.
Nelson went up there “at his own expense”
[
Van Dam 1988, 87] to consult in its development, but found the experience quite frustrating. Van
Dam and his team set out to design a dual-purpose system for authoring, editing and
printing text documents such as papers, proposals and course notes, which could also
be used to browse and query written materials nonsequentially. From Nelson’s
perspective, this sidelined the concept of hypertext in favour of print text editing.
In an interview with the author, Nelson claimed what the HES team built was
essentially a word processor with linking facilities; it was directed at the printed
page [
Nelson 1999]. Nelson was not happy with this
“trivialisation” of his hypertext vision
[7], and spent much time arguing for the
elaboration of HES’s hypertext facilities. For Nelson, paper was the enemy.
But the HES team was trying to convince the world that the whole concept of handling
text on computers was not a waste of time and processing power. And the world knew
text handling as a paper-based thing. “So not only were we
selling hypertext, but at the same time document processing, interaction. Many
people were still computing with cards,” recalls Van Dam [
Van Dam 1999]. As stated previously, even Doug Engelbart was having
trouble convincing the world that humans and machines might work together
interactively. There was not a funding body in the country that would support the
idea of a completely non-sequential, online “web.” Perhaps more importantly, Van
Dam already had a vision of what his writing system should do, a vision based on
improving an existing human activity: creating and editing text for printed
documents.
The HES team designed a system for the composition and manipulation of manuscripts,
which could also be used as a reading machine to browse and query complex written
materials online. They did not wish to inflict line numbers on the user, or to “make him program little changes in his data”
[
Carmody et al. 1967, 8] as line editors for computer programs did.
Reading, writing and editing documents should be simple, and the tools should be
suited to the task. Because they wished to emphasise the place of “ordinary”
text editing as well as the more radical concept of non-sequential, online reading
and writing, they called the project the Hypertext
Editing System — a
name meant to embrace this dual purpose.
It was a hard sell. Van Dam recalls his chairman at the time saying, “Why don't you stop with all this hypertext nonsense, and do
something serious?” to which Van Dam replied, “Walter, I am doing something serious”
[
Van Dam 1999]. At his own university, Van Dam “had multiple reactions, from ‘cute’ to ‘I don’t get it’ to my being in
a pissing contest to be allowed to use the university’s only mainframe computer
for this research with the then-VP for Finance”
[
Van Dam 1999]. After being shown a first version of the system, IBM, however, thought the
project serious enough to provide funding through a research contract. This, recalls
Van Dam, put the project on much more legitimate ground and ensured that the
undergraduates who had been programming HES as a bootleg graphics project were then
paid for their efforts [
Van Dam 1988, 889].
HES was set up on an IBM 360/50 with a 2250 display, and ran in a 128k partition of
the operating system that controlled the 512k of main memory available (there was a
complete timesharing system operating in another partition). The user sat facing a
12" by 12" screen, browsing through portions of arbitrarily sized texts. Original
text was entered directly via a keyboard, and the system itself was controlled by
pressing function keys, by pointing at the text with a light pen or via the keyboard
[
Carmody et al. 1967, 4]. The activities of the user were corresponded
directly to the operations normally performed upon text by writers and editors. The
user was able to manipulate pieces of text as though they were physical items:
correcting, moving, cutting, pasting, filing previous drafts and copying.
Our philosophical position [was] essentially that the writer
is engaged in very complicated pursuits, and that this work legitimately has a
freewheeling character... therefore it became our intent to provide the user
with unrestricted “spatial” options, and not to bother him with arbitrary
concerns that have no meaning in terms of the work being performed.
[Carmody et al. 1967, 8]
The HES team also did not wish to store text in numerical pages or divisions
known to the user, except as she might deliberately divide her text, create links or
number her headings. Rather than filing by page number or formal code name, HES
stored text as arbitrary-length fragments or “strings” and allowed for edits
with arbitrary-length scope (for example, insert, delete, move, copy). This is in
contrast to NLS, which imposed a hierarchical tree structure of fixed-length lines or
statements upon all content; Engelbart used 4,000 character limits on his statements
to create a tighter, more controlled environment. These limitations meant that
Engelbart could implement more efficiently [
Van Dam 1999]. HES was
deliberately made to embody a freewheeling character, as non-structured as
possible.
The system itself was composed of text “areas” which were of any length,
expanding and contracting automatically to accommodate material. These areas were
connected in two ways: by links and by branches. A link went from a point of
departure in one area (signified by an asterisk) to an entrance point in another, or
the same, area. Although the HES team used Ted Nelson's conception of a text link,
Doug Engelbart was incorporating the same idea into NLS independently, unbeknownst to
Van Dam, who wishes he had known about this work. “I hadn’t heard
of Engelbart. I hadn’t heard of Bush and Memex. That came quite a bit
later,” Van Dam recalls.
[8] Links were intended to be optional paths within a body of text —
from one place to another. A link was intended to express a relationship between two
ideas or points: an intuitive concept.
The HES team employed “human factors” techniques to design a system which guided
and explained the user's every move without loss of effectiveness [
Carmody et al. 1967, 14]. The system was much easier to use than NLS,
perhaps due to the fact that it was created as much for writers as it was for
engineers. Speaking from the year 2009, the editing features of HES seem quite
obvious, almost trivial. At the time, however, it was difficult to convince people in
a commercial environment that it was not an excessively complicated typewriter.
Nobody could conceive of writing or editing text on a screen. As Van Dam recalled in
an interview with the author,
Remember, we were doing hypertext at a time when there were no
word-processing systems either. The HES is one of the very first word
processors… I believe HES was the first document editor, specifically designed
for documents, to run on commercial equipment, and NLS was the first document
editor to run on a proprietary system, predating HES.
[Van Dam 1999]
One of Van Dam’s tasks was to convince humanities scholars and writers that this was
a more efficient way of writing than using a pen or a typewriter. HES used a standard
32-key IBM function keyboard, but when they gave demos to writers in the late 1960s
whose business was words, not engineering, they would “freak out” over all the
buttons [
Van Dam 1999]. So Van Dam learned to use progressive
disclosure, not frightening humanities people with too many buttons.
I made a plastic overlay which I essentially used to cover up
all but five of the editing buttons: insert, delete, move, copy and jump. Then
we would do an entire demo for half an hour or so with that … and then we would
play peek-a-boo, strip off the first overlay, and lo and behold, there was
another row of function keys.
[Van Dam 1988, 890]
In early 1968 HES did the rounds of a number of large customers for IBM equipment,
for example,
Time/Life and the
New
York Times. All these customers based their business on the printed word.
But HES was too far out for them. Writing was not something you did at a computer
screen. They had seen programs that set type, and maybe some programs for managing
advertisements, but the concept of sitting in front of a computer and writing or
navigating text was foreign to them.
The best I ever got was from people like Time and Time-Life
and the New York Times who said this is terrific technology, but we’re not
going to get journalists typing on computer keyboards for the foreseeable
future.
[Van Dam 1999]
As we now know, however, in less than a decade journalists (and executives)
would be typing on computer keyboards.
In late 1968, Van Dam finally met Doug Engelbart and attended a demonstration of NLS
at the Fall Joint Computer Conference. This was a landmark presentation in the
history of computing, and the audience, comprised of several thousand engineers and
scientists, witnessed such innovations as the use of hypertext, the computer
“mouse” and screen, and and telecollaboration on shared files via video
conferencing for the first time. The unveiling of NLS is now known affectionately and
with great respect as the Mother of All Demos, and was celebrated in December of 2008
at its 40th anniversary with almost all of the original team led by Doug Engelbart on
stage, and Andries Van Dam as the outsider commentator. For Van Dam, this system set
another, and entirely different, technical precedent. The line- or context-editor was
old technology — NLS was the prototype for creating, navigating and storing
information behind a tube and for having a multi-user, multi-terminal cost-effective
system. He went on to design the File Retrieval and Editing System (FRESS) at Brown
with his team of hotshot undergraduates and one masters student. As Van Dam observed
in the Hypertext 1987 conference keynote address,
...my design goal was to steal or improve on the best ideas
from Doug's NLS and put in some things we really liked from the Hypertext
Editing System - a more freeform editing style, no limits to statement size,
for example.
[Van Dam 1988]
The HES project was frozen as the team started work on the next-generation system.
Meanwhile, IBM sold HES to the Apollo Mission Team at the Houston Manned Spacecraft
Centre (unbeknownst to Nelson and Van Dam and others who had worked on it at the
time). Van Dam now proudly recalls that it was used in NASA's Houston Manned
Spacecraft Center for documentation on the Apollo space program [
Van Dam 1988]. As with most computing projects in the late 60s,
government (and the military) had a keener eye for innovation than business. For what
it was designed to achieve, HES performed perfectly.
HES, as a first prototype, naturally had its shortcomings. Part of the goal behind
FRESS was to improve on these shortcomings. Firstly, HES was programmed specifically
for the IBM /360 and the /2250 display; there was no device-independence. Van Dam had
seen the benefits of device-independence in Engelbart’s demonstration; in NLS “the command line…worked on basically any device. So they had
really engineered in good device independence from the beginning”
[
Van Dam 1999]. FRESS was the first hypertext system to run on readily-available commercial
hardware and OS: it was built for the IBM VM/370, an off-the-shelf time-sharing
system, and could even run on terminals incapable of multi-window views.
Secondly, HES wasn't multi-user; it was specifically targeted towards the 2250, a
machine for individual use [
Van Dam 1999]. The benefits of having a
multi-user system were also obvious from Engelbart's demonstration of NLS [
Ceruzzi 1998]. Primarily, a multi-user system allowed teams of people to
work together more easily. In NLS, the tendency towards knowledge-exchange and
collaborative work were more than just a system side-effect — they were a goal. Van
Dam decided to make FRESS multi-user. Although FRESS “didn't have
the kinds of chalk-passing protocols that NLS had”
[
Van Dam 1999] — in NLS, for instance, multiple users could work with a
shared view of a single document-in-progress — it was designed from the outset to run
on a timesharing system and to accommodate multiple displays of different types and
capabilities from teletypewriters to glass teletypes (simple CRT screens) to
multi-windowed powerful displays with pointing devices.
But the most popular new development for novice users in FRESS was not its capacity
to accommodate multiple displays and users; it was the “undo” feature. FRESS
pioneered undo for both word processing and hypertext, and arguably influenced the
future design of word processing systems. Every edit to a file was saved in a shadow
version of the data structure, and that allowed for both an “autosave” and an
undo. Brown staff and students understood immediately the importance and usefulness
of this feature [
Van Dam 1999]. As Van Dam saw it, the ultimate system
would have indefinite undo and redo.
[9]
Importantly, FRESS supported arbitrary-length strings; it had no size limitations.
According to Van Dam, an important philosophical distinction between NLS and FRESS
was that “Doug had these 4,000-character limits on his statements, and
that was an anathema to us. It was an anathema to Ted, when he started out, to
have limits on anything”
[
Van Dam 1999]. The FRESS team believed that the system should not force you into an
unnatural usage pattern, so software paging allowed for essentially unlimited
document sizes while maintaining performance. Working in the FRESS environment, the
user could not tell the difference between a two-page and a two-hundred page printed
file, and could actually specify how all this would be viewed in the first place.
FRESS borrowed many of the viewing specification ideas from NLS.
At the same time, hyperlinks in these files were addressable down to the character.
The granularity was as fine as sand. As Van Dam put it in our interview, “I don't want to go to a book, I don't want to go to a chapter, I
want to go to the actual quote!” One of the reasons why the web does not
have the same functionality as earlier hypertext systems such as FRESS or NLS is that
a URL points to a document: unless the author pre-specifies anchors in the target
page, there is no finer granularity than that. In NLS, a link took you to a
statement. In FRESS it could take you to a character. So in this sense, Van Dam
points out, “I think we had a ‘creamier’ hypertext than NLS
did,” and they certainly had a creamier hypertext than the modern web.
Another aspect of FRESS which the web has not implemented is bidirectional linking.
HES had unidirectional links, and the FRESS team decided that this needed to be
changed. FRESS was the first hypertext system to provide bidirectional linking. It
was also groundbreaking in that it provided different options to
visualise this field of links and references, to see the global
context for work: a map.
The outline functionality in FRESS was inspired by NLS (or as Van Dam puts it, “was a straight rip-off”
[
Van Dam 1999]). For readers who are not familiar with this terminology, an outline processor
is a specialised word processing program for handling and displaying outlines. One of
its most powerful features is the ability to suppress lower levels of detail and see
the global context for work [
Conklin 1987, 25]. The user can view
just the top
n levels of the structure — a map whose level of
detail is defined by the user. This facilitates rapid movement between sections and
makes editing and global navigation easier. But most importantly, this meant that in
FRESS
[We] had an ability to see the structure space, a
visualisation of all the structure in the text, the outline structure and the
cross-referencing structure. You could do structural rearrangements in that
structure space in a quick overview mode and you would thereby induce those
same edits in the text itself.
[Van Dam 1988, 891]
In sum, unlike in contemporary hypertext systems like the web, FRESS provided a
variety of coordinated views and conditional structure and view-specification
mechanisms. The user had final control over how and how much of the document was
being displayed — unlike with embedded markup like HTML. It also afforded separation
of structure from formatting and hypertext semantics — also unlike HTML. And all of
these features were designed to be easy to learn for novice users, based as they were
on a multi-window function key and lightpen interface in addition to a command-line
interface (in contrast to NLS, which had a more complex, and correspondingly more
powerful, command language). FRESS actually displayed and handled complex documents
better than non-hypertext “word processing” systems of the time. It was so
intuitive and efficient that it “was used as a publishing system as well as a collaborative
hypertext environment for teaching, research and development”
[
DeRose & Van Dam 1999, 7]. It was also used at Nijmegen University and Philips Eindhoven in the
Netherlands [
DeRose & Van Dam 1999, 19].
But this is not to say that FRESS was a run-away success at Brown, or that the
project received financial support. In fact, quite the reverse; “computer scientists didn’t think it was computer science, and
humanists weren’t paying for technologies”
[
Van Dam 1999]. The most difficult group to deal with were the staff in charge of computing.
In those days, computing time on the university mainframe was allocated via a virtual
accounting system. You got n-thousands of dollars in your account (this was called
virtual money or “funny money”), and when you ran out, your time was up. Van Dam
and the FRESS team, of course, were always arguing for more. One year the VP for
Finance told the FRESS team that there would be no more money for this FRESS
hypertext nonsense, as the computer was for serious physics and engineering work. Van
Dam had to use blackmail to keep the project alive.
Under the Brown system, the computer is just as much a public
utility as the library, and you can no more cut off people based on their field
from the computer than you can cut them off from the library... only by
threatening to go public and let the campus know that the engineers and
physicists were treating the computer as their private fiefdom [did I] get the
money.
[Van Dam 1999]
Luckily, the FRESS team kept going. Engelbart kept going. Ted Nelson kept
writing and publishing and inspiring audiences of young hackers and bright-eyed
alums. And slowly, very slowly, the computing community began to realise that text
and hyperlinks on a computer might just work.
In 1976, the National Endowment for the Humanities supported a FRESS application for
teaching English poetry. The FRESS team, and particularly Van Dam, had wanted to use
the system explicitly for teaching since its inception. In the NEH-sponsored course,
students did all of their critical course reading and writing in the online FRESS
docuverse. A poetry textbook was created in FRESS, to go along with a large
collection of poems by Spenser, Tennyson, Blake and others [
DeRose & Van Dam 1999, 19]. Students' and teachers' comments were integrated into the web as the
course proceeded, prompting further response and debate in the manner of contemporary
teaching webs. And, incidentally, the term
web was actually used in
accordance with Vannevar Bush's understanding of the term as a cluster of trails [
Bush 1945]. It was the first time hypertext had been used as a central
teaching tool in the humanities, and arguably the first online scholarly
community.
Intermedia, a distributed hypermedia system developed at Brown's Institute for
Research in Information and Scholarship (IRIS) from 1985-1990, grew directly out of
the work done by Van Dam's group. This was intended to be a networked, multiuser
teaching tool.