Kobe Bryant and the Digital Humanities

What does one of the most successful and polarizing basketball players in history have to do with the digital humanities?

For those that don’t follow the NBA, Kobe Bryant is famous for a host of accomplishments: winning five championships, league MVP honors, and an Olympic gold medal, leading the league in scoring twice, winning the All-Star dunk contest, and scoring the second most points in a single game in history. He has also been accused over the years of placing personal success ahead of the team, undermining teammates and coaches, and most notoriously, of sexual assault in 2003. From a basketball standpoint, however, one of the most enduring aspects of Bryant’s career has been an overwhelming consensus of his ability as a “clutch” player. There exists a widespread perception that no other basketball player on earth is better at the end of close games. Both NBA players and general managers have repeatedly and overwhelmingly voted Bryant as the player they would want taking a shot with the game on the line. Bryant’s name and legacy have become entwined with the word “clutch.”

Unfortunately, this is a flawed narrative. Henry Abbott recently wrote a blistering (and persuasive) analysis of Bryant’s abilities as a “clutch” player. Abbott concludes that, by nearly every statistical measure he examined, Bryant is not the best in the world at scoring points at the end of close games. Depending on the metric, Bryant is somewhere between decent and very good, but nowhere close to the best. Perhaps most damningly, the effectiveness of his team’s offense (the best in the league during Bryant’s tenure) plummets at the end of games.

So the question remains: what does Kobe Bryant have to do with the digital humanities?

The fault line in the basketball world over Kobe Bryant’s “clutchness” largely falls between those that evaluate Bryant’s ability by what they see and those that evaluate his ability by what they measure. For someone watching Bryant, no other player has as many breathtaking, memorable game-winning shots and no other player looks as graceful and impressive while doing it. I draw a parallel between this qualitative analysis with more traditional humanistic research: we read our sources and look for meaningful or interesting patterns that jump out at us. On the other side of the basketball fault-line stands a young but growing movement that advocates for more rigorous statistical analysis of basketball, in the same vein as the sabermetric “Moneyball“ movement in baseball. For these stat-heads, the seductive aesthetic appeal of Bryant’s game-winning shots hides the less glamorous reality: that Bryant misses those game-winning shot attempts at an extremely high rate. And this is the side of the debate that I would compare to the digital humanities.

The analogy isn’t perfect. Much of the work being done in the digital humanities field is not, in fact, quantitative (and making the comparison brings to mind the less-successful turn towards quantitative history in the 1960s and 1970s). But the analogy does have  some useful parallels. Like the stats movement in the basketball world, digital humanities has a lengthy history but has only recently begun to gain traction across the wider academy. Like the stats movement in the basketball world, digital humanities is occasionally seen as threatening or, at the very least, promising too much. Like the stats movement in the basketball world, there are those in digital humanities that revel in revisionism and using new techniques to challenge conventional narratives. And like the stats movement in the basketball world, there are divisions within the digital humanities over method, approach, and emphasis.

One of the most important parallels to be drawn is how the digital humanities are increasingly being used to strengthen (rather than replace) traditional humanistic study, just as advanced statistics are being used in the NBA to strengthen analysis. In the past, a basketball player would be evaluated by a handful of traditional statistics, perhaps most importantly: how many points do they score? Today, teams and scouts are looking at more advanced metrics: for instance, how efficiently do they score those points? In the same vein, traditional literary history might look at a handful of canonical works in order to draw broad conclusions about, say, early-19th century British fiction. Today, advocates of distant reading are measuring trends across hundreds or thousands of early-19th century British novels beyond the canonical authors. Most of these digital researchers would continue to acknowledge the literary importance of Charles Dickens over a barely-published contemporary novelist, just as most stat-heads would acknowledge the importance of a player that scores a moderately-efficient 30 points per game over a player that scores a hyper-efficient 5 points per game.

Comparing the two also highlights their limitations. Some aspects of basketball can’t be measured, such as whether or not a player is a good teammate or how likely they are to stay motivated after receiving a contract or whether they’re likely to end up injured. Similarly, human experience can be an elusive target to study with technology. Charting the prevalence of certain phrases across time using Google NGrams offers, at best, a largely superficial indicator that requires careful and more extensive investigation, while cataloging every slave ship voyage might serve to mute and depersonalize the particularities of individual slaves.

In both the statistical movement in basketball and the digital turn in the humanities, new approaches allow for new questions. Henry Abbott and others have not “proven” that Kobe Bryant shouldn’t take the last shot of a game, but they have raised important questions: would Bryant’s team be better served by using him as a decoy? More broadly, is the long-standing convention of putting the ball into the hands of your best player in an isolation situation at the end of the game even a good idea? Using digital methodologies in the humanities can also serve to pose new kinds of questions, but I think the field should model itself more explicitly after the statistical basketball community in having specific questions drive those methodologies. There is a tendency to build tools and ask research questions later. This is useful, but I’d also like to see more focused questions along the lines of “Is Kobe Bryant a clutch player?” Those of us who advocate for the use of digital tools and techniques in the humanities could benefit from taking a break from the library and turning towards the basketball court.

The Launch of Tooling Up

Today marks the public launch of a project called Humanities 3.0: Tooling Up for Digital Humanities. Over the past several months I’ve been working on Tooling Up at the Bill Lane Center for the American West. The project was originally conceived in conversation with Jon Christensen, director of the center, as an outreach initiative that would offer an accessible introduction to the realm of digital humanities. With generous funding from the University’s Presidential Fund for Innovation in the Humanities, Andrew Robichaud, Rio Akasaka, Jon, and myself began work last summer on a two-track project.

The first track is a series of online essays that explore different themes and issues within digital humanities, written in a journalistic style and aimed at a graduate student or faculty member with little to no exposure to digital scholarship or research. Each essay (there will eventually be a total of seven) deals with a particular topic within digital humanities – file and data management, digital archives, text analysis, etc. The essays are written primarily by Andy, a fellow history graduate student and DH-newcomer who did a phenomenal job of tackling topics that were outside of his comfort zone. Andy’s presence brought the added benefit of helping us all to better tailor the essays towards their intended audience: the humanities scholar who, for instance, doesn’t know what XML stands for, has only vaguely heard of Zotero, and is puzzled as to how Twitter would ever be useful for an historian. The second track of Tooling Up will take place in the spring quarter through a seminar/workshop series specifically for Stanford students and faculty. The workshops will mirror the essays by providing an in-person introduction to some of “the basics” of digital humanities.

Conceptualizing and then implementing Tooling Up forced us to grapple with a lot of issues. First, what was the project’s audience? We settled on not trying to be all things to all people. The content of Tooling Up is going to be painfully basic for the majority of people that identify themselves as digital humanists. Meanwhile, those in the #alt-ac world might be disappointed in its audience tilt towards traditional academics. And, of course, there are an inordinate number of references to Stanford examples and projects. But in the end we felt that focusing on the crowd that we knew best would allow us to deliver the most effective and coherent content.

The second issue that emerged was one of ephemerality. In a way that is markedly different from other fields, digital humanities are most commonly linked to tools, whether building them or using them, and this is reflected in the very name of our project. It is difficult to avoid ArcGIS when talking about spatial analysis or Zotero when talking about file management. But in the digital age, tools rapidly become obsolete. When Andy and I were discussing what to include in an essay section on building an online community, Delicious came to mind as an example of social bookmarking. As of the end of 2010, however, the site’s entire existence is up in the air. Ephemerality. Instead of emphasizing specific tools, therefore, we decided to use broader strokes: the basic concepts, themes, or issues surrounding different topics that will (hopefully) prove more enduring.

Finally, the issue of authority. None of us working on the project would consider ourselves experts in any one of the topics discussed in Tooling Up, much less all of them. We did our best to consult other people at Stanford who we did consider experts in those areas, but the nature of this kind of project is that it is going to always feel somewhat incomplete. In that vein, we have tried to make the project fluid and ongoing. Essays will be posted as they are finished and we encourage any and all readers to leave feedback on the site’s pages – commentary that we hope will become crucial components of the essays themselves.

On Lecturing

The life of a history graduate student is remarkably short on excitement. Nicholas Cage might break into the National Archives and steal the Declaration of Independence in order to find a hidden treasure buried by the founding fathers, but the rest of us spend most of our time reading piles of really long books. We also talk about those books. And write papers about them. I love what I do, but there are few moments of my work that I would classify as thrilling. Standing in front of a classroom of sixty undergraduates, about to deliver my own lecture for the very first time, however, was a moment that I would put in the “thrilling” category.

Over the past three months I was a teaching assistant for History 150A: Colonial and Revolutionary America, taught by Professor Caroline Winterer. The TAs were given the option of lecturing on a topic of our choosing for half of a class period. So on a Tuesday morning in November I found myself death-gripping the sides of a podium and trying to ignore the fact that I had about a hundred eyes staring at me. The next half hour was largely a blur, but fortunately Stanford’s Center for Teaching and Learning provides a wonderful service for professors, lecturers, and teaching assistants: they will come to your classroom and videotape a class period. So, in what seems appropriate for someone who studies the practice of history in a digital age, the very first lecture of my academic career was captured on video.

Lecturing, and public speaking more generally, is a curiously under-trained aspect of graduate school. I’ve received detailed and continuous feedback over the past year-and-a-half on my historical writing. Yet as graduate students we rarely receive feedback on another fundamental component of being an historian: verbal communication. Especially for the majority of us who will be teaching for the rest of our careers, effectively conveying concepts to a roomful of people is absolutely crucial. This is why I appreciate CTL’s videotaping service so much, and why I have been encouraging everyone I know to take advantage of it. Especially for those of us (like myself) without much experience delivering lectures, they provide a high-quality means of self-assessment.

Do I talk too fast? Too softly? Are my gestures distracting? Do I really say “you know” at the end of every sentence? These are the kinds of questions that often float beneath the radar of our own self-perceptions, but whose answers become immediately apparent when watching a video of yourself lecturing. Beyond noticing verbal patterns, re-watching a lecture allows you to gauge how well the written structure translated into a spoken one. This was one of the more illuminating parts of my own self-evaluation. Some of the examples that I had tried to emphasize in my lecture notes fell flat when I said them out loud. Other points that I had considered secondary came off sounding much more emphatic. An analytical thread that you can easily follow while reading a paragraph sometimes gets lost after two sentences in a lecture. Studying the delivery of a lecture with a knowledge of how it was written drives home the point that building a paper and building a lecture require two related, but fundamentally different, styles of writing.

While videotaped self-assessment can be quite valuable, I quickly realized its limitations in answering the most important questions in evaluating a lecture. How much of it did the students really “get”? Did they actually understand the themes I was trying to describe and the argument I was trying to make? How many remember any of its details a month later? These, of course, are the kinds of pedagogical questions that are notoriously difficult to answer and certainly outside the realm of a thirty-minute video. Regardless, I found delivering a lecture to a roomful of students to be incredibly valuable, and while it wasn’t quite as exciting as stealing the Declaration of Independence, it was a thrilling experience.


Digital Humanities Labs and Undergraduate Education

Over the past few months I was lucky enough to do research in Stanford’s Spatial History Lab. Founded three years ago through funding from the Andrew Mellon Foundation, the lab was grown into a multi-faceted space for conducting different projects and initiatives dealing with spatial history. Having worked in the lab as a graduate affiliate over the past nine months as well, I can attest to what a fantastic environment it provides: computers, a range of software, wonderful staff, and an overarching collaborative setting. There are currently 6-8 ongoing projects in various stages at the lab under the direction of faculty and advanced graduate students, which focus on areas ranging from Brazil to Chile to the American West. Over ten weeks this summer, eight undergraduate research assistants worked under these projects. I had the opportunity to work alongside them from start to finish, and came away fully convinced of the potential for this kind of lab setting in furthering undergraduate humanities education.

The eight students ranged from freshman to the recently-graduated, who majored in everything from history to environmental studies to computer science. Some entered the program with technical experience of ArcGIS software; others had none. Each of them worked under an existing project and were expected to both perform traditional RA duties for the project’s director and also develop their own research agenda for the summer. Under this second track, they worked towards the end goal of producing an online publication for the website based on their own original research. Led by a carefully-planned curriculum, they each selected a topic within the first few weeks, conducted research during the bulk of the summer, went through a draft phase followed by a peer-review process, and rolled out a final publication and accompanying visualizations by the end of the ten weeks. Although not all of them reached the final point of publication at the end of that time, by the final tenth week each of them had produced a coherent historical argument or theme (which is often more than I can say about my own work).

The results were quite impressive, especially given the short time frame. For instance, rising fourth-year Michael DeGroot documented and analyzed the shifting national borders in Europe during World War II. Part of his analysis included a dynamic visualization that allows the reader to see major territorial changes between 1938-1945. DeGroot concludes that one major consequence of all of these shifts was the creation of a broadly ethnically homogenous states. In “Wildlife, Neoliberalism, and the Pursuit of Happiness,” Julio Mojica, a rising junior majoring in Anthropology and Science, Technology, and Society, analyzed survey data from the late twentieth-century on the island of Chiloé in order to examine links between low civic participation and environmental degradation. Mojica concludes that reliance on the booming salmon industry resulted in greater tolerance for pollution, a pattern that manifested itself more strongly in urban areas. As a final example, senior history major Cameron Ormsby studied late-19th century land speculation in Fresno County and impressively waded into a historiographical debate over the issue. Instead of speculators serving as necessary “middle-men” between small farmers and the state, Ormsby convincingly argues that they in fact handicapped the development of rural communities.

The success of the summer program speaks not only to the enthusiasm and quality of Stanford undergraduates, but more centrally to the direction of the lab and it’s overall working environment. By fostering an attitude of exploration, creativity, and collaboration, the students were not only encouraged, but expected to participate in projects as intellectual peers. The dynamic in the lab was not a traditional one of a faculty member dictating the agenda for the RA’s. In many cases, the students had far greater technical skills and knew more about their specific subjects than the project instructor. The program was structured to give the student’s flexibility and freedom to develop their own ideas, which placed the onus on them to take a personal stake in the wider projects. In doing so, they were exposed to the joys, challenges, and nitty-gritty details of digital humanities research: false starts and dead-ends were just as important as the pivotal, rewarding “aha!” moments that come with any project. Thinking back on internships or research assistant positions, it’s difficult for me to imagine another undergraduate setting that would encourage this kind of wonderfully productive hand-dirtying process. And while I think digital humanities labs hold great potential for advancing humanities scholarship, I have grown more and more convinced that some of their greatest potential lies in the realm of pedagogy.

Getting Under the Hood of Graduate Coursework

As part of Stanford’s history graduate program, those of us studying the United States participate in a series of courses called “the core.” This consists of six courses taught by six different professors that cover the chronology of the United States – two each for (roughly) the eighteenth, nineteenth, and twentieth centuries. On Stanford’s quarter system, this works out to three “core” classes each year that comprise the backbone of the Americanist graduate training. Having completed half of the core, I thought it would be interesting to take a look at its content.

Each course follows a similar format: one book assigned each week, usually accompanied by additional excerpts or chapters of other books and related essays. The class posted short responses/questions which we then discussed in our once-weekly class. Even with a small class (around 8-12 students), the aggregate of our short responses produced a sizable body of text over the course of the year. The responses also offer a means of gleaning some of the overarching themes of US historiography. As Julie Meloni describes in a post at ProfHacker titled “Wordles, or the gateway drug to textual analysis” word clouds are an easy and playful way to visualize these themes:

Many of the words are not particularly surprising (American, history, and book, for example), but the word cloud does point towards the essence of Stanford’s “core” in training its graduate students to analyze texts from a largely historiographical standpoint. There are relatively few content words  - Vietnam doesn’t appear too often, for instance. Instead, words such as analysis, argument, and narrative crop up in our responses. We are being trained to read a book not for its factual information but in order to evaluate its interpretive arguments. This is a crucial difference that often gets overlooked by those outside the profession, and this characteristic displays itself quite clearly in our responses.

Examining the central books that were assigned in the core gives a glimpse into what our professors thought were the important works in United States historiography. What follows are the major weekly books, in order of publication date:

Patricia Limerick The Legacy of Conquest: The Unbroken Past of the American West
Gordon Wood Radicalism of the American Revolution
Charles Sellers The Market Revolution: Jacksonian America, 1815-1846
William Cronon Nature’s Metropolis: Chicago and the Great West
Richard Bushman The Refinement of America: Persons, Houses, Cities
Robin Kelley Race Rebels : Culture, Politics, and the Black Working Class
Christine Leigh Heyrman Southern Cross: The Beginnings of the Bible Belt
Amy Dru Stanley From Bondage to Contract: Wage Labor, Marriage, and the Market in the Age of Slave Emancipation
Kristin Hoganson Fighting for American Manhood: How Gender Politics Provoked the Spanish-American and Philippine-American Wars
Walter Johnson Soul by Soul: Life Inside the Antebellum Slave Market
Ann Fabian The Unvarnished Truth: Personal Narratives in Nineteenth-Century America
Mary Dudziak Cold War Civil Rights: Race and the Image of American Democracy
Elizabeth Anne Fenn Pox Americana: The Great Smallpox Epidemic of 1775-82
Sven Beckert The Monied Metropolis: New York City and the Consolidation of the American Bourgeoisie, 1850-1896
Caroline Winterer The Culture of Classicism: Ancient Greece and Rome in American Intellectual Life, 1780-1910
Paul E. Johnson Sam Patch, the Famous Jumper
Steven Hahn A Nation Under Our Feet: Black Political Struggles in the Rural South from Slavery to the Great Migration
Jeremi Suri Power and Protest: Global Revolution and the Rise of Detente
Mae Ngai Impossible Subjects: Illegal Aliens and the Making of Modern America
Louis S. Warren Buffalo Bill’s America: William Cody and the Wild West Show
Susan Scott Parish American Curiosity: Cultures of Natural History in the Colonial British Atlantic World
Charles Postel The Populist Vision
Annette Gordon-Reed The Hemingses of Monticello
Pekka Hamalainen Comanche Empire
Jackson Lears Rebirth of a Nation: The Making of Modern America, 1877-1920
Peggy Pascoe What Comes Naturally: Miscegenation Law and the Making of Race in America
Susan Carruthers Cold War Captives: Imprisonment, Escape, and Brainwashing

Taking a look at all twenty-seven books reveals some interesting characteristics. Unsurprisingly, the assigned readings are heavily weighted towards recent work:

Part of the purpose of Stanford’s core is to develop a strong working knowledge of the issues and debates of the field. For example, Charles Postel’s The Populist Vision, published in 2007, takes on interpretations advanced over the past half-century that characterize the 1890s People’s Party as quixotic and backwards-looking. Instead, Postel argues that the movement was deeply committed to ideals of modernity and progress. The Populist Vision serves as an exemplary book to assign in the graduate “core” in part because it provides a strong background for the ongoing issues, debates, and trends of how historians have interpreted late nineteenth-century American politics.

Looking at the authors themselves is also interesting. The gender breakdown is quite even, with fourteen male authors and thirteen female authors. What I decided to examine was not just who these people were, but where they received their historical training. The twenty-seven different authors received their PhD’s from only ten different schools:

Columbia University
Harvard University
Princeton University
Stanford University
University of California, Berkeley
University of California, Los Angeles
University of Helsinki
University of Leeds
University of Michigan
Yale University

In short, it’s a narrowly “elite” bunch. Eleven (over 40%) of the authors received their PhDs from Yale alone. Of the eight American schools represented, all of them currently reside in the top ten of US News and World Report’s list of history graduate programs. Of note, the authors had a more diverse background in both their undergraduate education (ranging from Montana State University to SUNY-Empire State) and the schools at which they currently taught. The prestige factor seemed to be most dominant at the graduate level.

The over-representation of elite schools highlights the stratified nature of graduate training in the American historical profession. I don’t mean to draw broad conclusions from an obviously limited and biased sample, which only reflects the decisions of three Stanford professors as to what they think are the most important recent books in the field. Yet the authors of these books were overwhelmingly trained at prestigious, “top-tier” programs. Does this mean that the products of Harvard and Yale’s programs are the only historians who received the quality training needed to write ground-breaking scholarship? Absolutely not. But the above reading list does imply that where a historian received their graduate education seems to have an outsized ripple effect on the reception and impact of their scholarship.

Topic Modeling Martha Ballard’s Diary

In A Midwife’s Tale, Laurel Ulrich describes the challenge of analyzing Martha Ballard’s exhaustive diary, which records daily entries over the course of 27 years: “The problem is not that the diary is trivial but that it introduces more stories than can be easily recovered and absorbed.” (25) This fundamental challenge is the one I’ve tried to tackle by analyzing Ballard’s diary using text mining. There are advantages and disadvantages to such an approach – computers are very good at counting the instances of the word “God,” for instance, but less effective at recognizing that “the Author of all my Mercies” should be counted as well. The question remains, how does a reader (computer or human) recognize and conceptualize the recurrent themes that run through nearly 10,000 entries?

One answer lies in topic modeling, a method of computational linguistics that attempts to find words that frequently appear together within a text and then group them into clusters. I was introduced to topic modeling through a separate collaborative project that I’ve been working on under the direction of Matthew Jockers (who also recently topic-modeled posts from Day in the Life of Digital Humanities 2010). Matt, ever-generous and enthusiastic, helped me to install MALLET (Machine Learning for LanguagE ToolkiT), developed by Andrew McCallum at UMass as “a Java-based package for statistical natural language processing, document classification, clustering, topic modeling, information extraction, and other machine learning applications to text.” MALLET allows you to feed in a series of text files, which the machine will then process and generate a user-specified number of word clusters it thinks are related topics. I don’t pretend to have a firm grasp on the inner statistical/computational plumbing of how MALLET produces these topics, but in the case of Martha Ballard’s diary, it worked. Beautifully.

With some tinkering, MALLET generated a list of thirty topics comprised of twenty words each, which I then labeled with a descriptive title. Below is a quick sample of what the program “thinks” are some of the topics in the diary:

  • MIDWIFERY: birth deld safe morn receivd calld left cleverly pm labour fine reward arivd infant expected recd shee born patient
  • CHURCH: meeting attended afternoon reverend worship foren mr famely performd vers attend public supper st service lecture discoarst administred supt
  • DEATH: day yesterday informd morn years death ye hear expired expird weak dead las past heard days drowned departed evinn
  • GARDENING: gardin sett worked clear beens corn warm planted matters cucumbers gatherd potatoes plants ou sowd door squash wed seeds
  • SHOPPING: lb made brot bot tea butter sugar carried oz chees pork candles wheat store pr beef spirit churnd flower
  • ILLNESS: unwell mr sick gave dr rainy easier care head neighbor feet relief made throat poorly takeing medisin ts stomach

When I first ran the topic modeler, I was floored. A human being would intuitively lump words like attended, reverend, and worship together based on their meanings. But MALLET is completely unconcerned with the meaning of a word (which is fortunate, given the difficulty of teaching a computer that, in this text, discoarst actually means discoursed). Instead, the program is only concerned with how the words are used in the text, and specifically what words tend to be used similarly.

Besides a remarkably impressive ability to recognize cohesive topics, MALLET also allows us to track those topics across the text. With help from Matt and using the statistical package R, I generated a matrix with each row as a separate diary entry, each column as a separate topic, and each cell as a “score” signaling the relative presence of that topic. For instance, on November 28, 1795, Ballard attended the delivery of Timothy Page’s wife. Consequently, MALLET’s score for the MIDWIFERY topic jumps up significantly on that day. In essence, topic modeling accurately recognized, in a mere 55 words (many abbreviated into a jumbled shorthand), the dominant theme of that entry:

“Clear and pleasant. I am at mr Pages, had another fitt of ye Cramp, not So Severe as that ye night past. mrss Pages illness Came on at Evng and Shee was Deliverd at 11h of a Son which waid 12 lb. I tarried all night She was Some faint a little while after Delivery.”

The power of topic modeling really emerges when we examine thematic trends across the entire diary. As a simple barometer of its effectiveness, I used one of the generated topics that I labeled COLD WEATHER, which included words such as cold, windy, chilly, snowy, and air. When its entry scores are aggregated into months of the year, it shows exactly what one would expect over the course of a typical year:

Cold Weather

As a barometer, this made me a lot more confident in MALLET’s accuracy. From there, I looked at other topics. Two topics seemed to deal largely with HOUSEWORK:

1. house work clear knit wk home wool removd washing kinds pickt helping banking chips taxes picking cleaning pikt pails

2. home clear washt baked cloaths helped washing wash girls pies cleand things room bak kitchen ironed apple seller scolt

When charted over the course of the diary, these two topics trace how frequently Ballard mentions these kinds of daily tasks:

Housework

Both topics moved in tandem, with a high correlation coefficient of 0.83, and both steadily increased as she grew older (excepting a curious divergence in the last several years of the diary). This is somewhat counter-intuitive, as one would think the household responsibilities for an aging grandmother with a large family would decrease over time. Yet this pattern bolsters the argument made by Ulrich in A Midwife’s Tale, in which she points out that the first half of the diary was “written when her family’s productive power was at its height.” (285) As her children married and moved into different households, and her own husband experienced mounting legal and financial troubles, her daily burdens around the house increased. Topic modeling allows us to quantify and visualize this pattern, a pattern not immediately visible to a human reader.

Even more significantly, topic modeling allows us a glimpse not only into Martha’s tangible world (such as weather or housework topics), but also into her abstract world. One topic in particular leaped out at me:

feel husband unwel warm feeble felt god great fatagud fatagued thro life time year dear rose famely bu good

The most descriptive label I could assign this topic would be EMOTION – a tricky and elusive concept for humans to analyze, much less computers. Yet MALLET did a largely impressive job in identifying when Ballard was discussing her emotional state. How does this topic appear over the course of the diary?

Emotion

Like the housework topic, there is a broad increase over time. In this chart, the sharp changes are quite revealing. In particular, we see Martha more than double her use of EMOTION words between 1803 and 1804. What exactly was going on in her life at this time? Quite a bit. Her husband was imprisoned for debt and her son was indicted by a grand jury for fraud, causing a cascade effect on Martha’s own life – all of which Ulrich describes as “the family tumults of 1804-1805.” (285) Little wonder that Ballard increasingly invoked “God” or felt “fatagued” during this period.

I am absolutely intrigued by the potential for topic modeling in historic source material. In many ways, it seems that Martha Ballard’s diary is ideally suited for this kind of analysis. Short, content-driven entries that usually touch upon a limited number of topics appear to produce remarkably cohesive and accurate topics. In some cases (especially in the case of the EMOTION topic), MALLET did a better job of grouping words than a human reader. But the biggest advantage lies in its ability to extract unseen patterns in word usage. For instance, I would not have thought that the words “informed” or “hear” would cluster so strongly into the DEATH topic. But they do, and not only that, they do so more strongly within that topic than the words dead, expired, or departed. This speaks volumes about the spread of information – in Martha Ballard’s diary, death is largely written about in the context of news being disseminated through face-to-face interactions. When used in conjunction with traditional close reading of the diary and other forms of text mining (for instance, charting Ballard’s social network), topic modeling offers a new and valuable way of interpreting the source material.

I’ll end my post with a topic near and dear to Martha Ballard’s heart: her garden. To a greater degree than any other topic, GARDENING words boast incredible thematic cohesion (gardin sett worked clear beens corn warm planted matters cucumbers gatherd potatoes plants ou sowd door squash wed seeds) and over the course of the diary’s average year they also beautifully depict the fingerprint of Maine’s seasonal cycles:

Gardening


Note: this post is part of an ongoing series detailing my work on text mining Martha Ballard’s diary.

Review: White Flight: Atlanta and The Making of Modern Conservatism

By 1970, the north Atlanta suburban counties of Gwinnett, Cobb, and north Fulton had experienced massive explosions in both population and median income. Their racial profiles were also 95, 96, and 99 percent white, respectively (245). In White Flight: Atlanta and the Making of Modern Conservatism, Kevin Kruse explores the processes leading up to this shift. Kruse sets his study within Atlanta’s urban landscape during the 1950s and 1960s and traces the gradual abandonment of spaces by white citizens and its political impact on the development of the conservative movement. By charting three distinct stages of the movement, Kruse reveals a gradual reorientation in political patterns of white resistance, as white Atlantans moved towards a coded ideological emphasis on individual rights, privatization, and small government. Kruse argues that this combination of physical relocation and political consolidation proved to be the most successful strategy employed by those resisting the civil rights movement.

By the late 1940s and early 1950s, working-class whites felt themselves under siege from what they saw as a black invasion of their neighborhoods and public spaces such as parks and swimming pools. Working-class whites at first turned to organized violence and intimidation, but soon realized the importance of winning the battle for public image. In Kruse’s words, “In time, they would learn to put aside the brown shirts of the [white supremacist] Columbians and the white sheets of the Klan and instead present themselves as simple homeowners and concerned citizens.” (44) On an ideological level, they moved from trying to protect the integrity of their communities (a cohesion that Kruse convincingly undermines), and instead began to emphasize their individual rights and liberties to live amongst whomever they chose. In many neighborhoods, their struggle was not enough, as the first wave of black homeowners caused a stampede of white individuals rushing to sell their homes before property values decreased.

Meanwhile, a similar battle over the desegregation of public schools led middle-class whites into the fray during the 1950s. Segregationist leaders quickly picked up on a central theme that ran through their movement (and one that runs through White Flight as well): “freedom of association.” For a middle-class white father, barring blacks from attending the same school as his daughter was purportedly less about denying black people rights as it was preserving his own right to determine who his daughter could and should interact with. Even as this line of reasoning proved ineffectual at halting desegregation, white families fled from public schools into private ones, creating a second-wave of de facto segregation in Atlanta’s school system.

The third stage of white flight came in the early 1960s. As working and middle-class whites faced the integration of their neighborhoods, parks, and schools, many upper-class whites observed the conflict form a distance, safely ensconced in their wealthy neighborhoods, country clubs, and private schools. But with the passage of the Civil Rights Act, suddenly their businesses came under direct assault. Elite businessman, hitherto allied in a moderate coalition with white politicians and black leaders, bitterly struggled against organized sit-in protests and later government injunctions that aimed to desegregate their restaurants and department stores. It was during their struggle that the earlier shifts towards individual rights and privatization crystallized into an organized and increasingly powerful conservative ideology.

The strength of Kruse’s argument lies in tracing this conservative political crystallization, sometimes at the expense of a more rigorous analysis of white flight as a spatial phenomenon. While maps are scattered throughout White Flight, most of them serve as modest visual signposts, when they have the potential to more deeply enrich the project. Nevertheless, Kruse persuasively argues that this tandem of political and spatial movements had profound historical implications. As white Americans increasingly coalesced into white suburban (and later exurban) enclaves, they eventually became the backbone of the Republican party. This “politics of suburban secession,” maintained the traditional tenets of white flight: retreating from any and all interaction with the black community (now synonymous the city itself) and championing minimal government, headlong privatization, and the primacy of the individual.

Kruse is an adept narrator, weaving together a host of characters and events into a compelling storyline of the racial landscape of Atlanta during the mid-20th century. He paints a convincing portrait of a coalescing conservative movement based on withdrawal and charts the distinctive class divisions within this movement. The reader is sometimes left wishing for the kind of broader analysis that mainly occupies the final chapter and epilogue of his book. Atlanta’s patterns of white flight were simultaneously taking place in spaces across the country, yet Kruse offers only passing glimpses of how the city fit within a national framework. Despite this, White Flight remains a compelling case study on the origins of the modern conservative movement within the social and political backlash against the civil rights movement.


Kevin M. Kruse, White Flight: Atlanta and the Making of Modern Conservatism (Princeton University Press, 2005).