Comments for Matthew L. Jockers

Comment on Executing R in Php by Ranjan

Ranjan — Mon, 20 May 2013 06:37:20 +0000

I tested running Rscript from a PHP script using the poorman.php example code from the R-bloggers site.
one needs to ensure the directory has write access to the php user. I did a
chmod to the directory where the my_rscript.R file is located. Then I was able to run the Rscript from the PHP code.
See http://www.r-bloggers.com/integrating-php-and-r/ for the R-blogger example for poorman.php that uses a Rscript to launch R program from PHP

Comment on Unfolding the Novel by How I Came to Text-Mine Software | Reverse Engineering

How I Came to Text-Mine Software | Reverse Engineering — Mon, 13 May 2013 22:00:40 +0000

[...] EDIT: Matthew Jockers gave me some interesting links to things worth reading for others interested in the current status of copyright. The first is the amicus curae brief that he contributed to in the Authors Guild v. HathiTrust case. The second is some exciting news about a project that will allow for some 20th century datamining. [...]

Comment on Macroanalysis by How I Came to Text-Mine Software | Reverse Engineering

How I Came to Text-Mine Software | Reverse Engineering — Mon, 13 May 2013 21:11:18 +0000

[...] I began reading through Matthew Jockers’ Macroanalysis. As a scholar already sold on the promise of the digital tools in the study of cultural history, [...]

Comment on DHWI: R Code Day One by Presentation Thoughts

Presentation Thoughts — Mon, 22 Apr 2013 06:21:37 +0000

[...] Much of the R code I’ve been experimenting with that is specifically relevent to those interested in playing with literature data, I found here: http://www.matthewjockers.net/materials/dhwi-2013/dhwi-code/ [...]

Comment on Pronouns in 19th Century Fiction by Sapping Attention: Genders and Genres: tracking pronouns

Sapping Attention: Genders and Genres: tracking pronouns — Mon, 15 Apr 2013 17:35:12 +0000

[...] the representation of male and female subjects in late-19th century texts. Further spurs were Matt Jockers recently posted the pronoun usage in his corpus of novels; Jeana Jorgensen pointed to recent research by Kathleen Ragan that suggests that editorial and [...]

Comment on On Distant Reading and Macroanalysis by Liveblogging Macroanalysis by Matthew L. Jockers, Part 1 ← the scottbot irregular

Sun, 14 Apr 2013 18:09:56 +0000

[...] book, Jockers distances himself slightly from Moretti’s notion of distant reading, and it is not the first time he has done so. His choice of “analysis” over “reading” is an attempt to show that what [...]

Comment on “Secret” Recipe for Topic Modeling Themes by Matthew Jockers

Matthew Jockers — Fri, 12 Apr 2013 20:52:11 +0000

Yes, I think we’d lose too many non-character words, but who knows. It’s all worth some more experimentation. One way to avoid the big stop list is to trust the POS tagger’s tagging of proper nouns, e.g.: “NNP and NNPS.” When I’m stopping out the non-nouns, I usually use this “/NN$” regex so that I keep only the regular nouns and not the proper nouns which get tagged as “NNP” and “NNPS.” Since the taggers are not perfect (some character names are not properly tagged as such, e.g. “Hope”) I still keep my big character name list as a double check. . . That said, I’m sure there are more elegant approaches.

Comment on “Secret” Recipe for Topic Modeling Themes by Ben Schmidt

Ben Schmidt — Fri, 12 Apr 2013 20:30:42 +0000

Given that proper names cause a lot of trouble, do you think that ‘first stab’ topic modelings should use a token regex that excludes all capitalized words entirely? Or would the loss of subject words at the beginning of sentences counterbalance any gains from that? I’d guess exclusion lists present more problems in the sorts of texts that have lots of last names than first names, although maybe that’s wrong.

Comment on The LDA Buffet: A Topic Modeling Fable by What can DHers learn from improvisation and Tina Fey? | Lisa Marie Rhody

What can DHers learn from improvisation and Tina Fey? | Lisa Marie Rhody — Fri, 12 Apr 2013 18:08:30 +0000

[...] modeling and my approach to topic modeling are different. However, Matt’s blog post on the LDA Buffet helped kick off my own work. We take similar tools and use them for divergent purposes to answer [...]

Comment on “Secret” Recipe for Topic Modeling Themes by What can DHers learn from improvisation and Tina Fey? | Lisa Marie Rhody

What can DHers learn from improvisation and Tina Fey? | Lisa Marie Rhody — Fri, 12 Apr 2013 18:06:04 +0000

[...] “Inspired by new #JDHTopics, I’ve posted some lessons learned from topic modeling literature + my “secret” recipe;) matthewjockers.net/2013/04/12/sec…” Successful scholarship, like improvisation, depends on generosity. The “and” part is [...]