{"id":457,"date":"2017-04-03T14:53:33","date_gmt":"2017-04-03T18:53:33","guid":{"rendered":"http:\/\/wwp.northeastern.edu\/blog\/?p=457"},"modified":"2017-06-12T14:26:54","modified_gmt":"2017-06-12T18:26:54","slug":"making_wwosdi","status":"publish","type":"post","link":"https:\/\/wwp.northeastern.edu\/blog\/making_wwosdi\/","title":{"rendered":"Making (and using!) WWO:SDI"},"content":{"rendered":"<p>Recently, we published an announcement about the release of the <a href=\"http:\/\/www.wwp.northeastern.edu\/research\/projects\/april1\/2017\/index.xhtml\">Women Writers Online: Scrabble Discovery Interface<\/a> (WWO:SDI), which was (we hope) fairly obviously an April Fools\u2019 Day joke. For all its silliness, however, WWO:SDI demonstrates some of the much more practical tools we have for interacting with WWO. More than that, the WWO:SDI interface itself has proved to be a remarkably effective proofing tool.<\/p>\n<p>This second point may be less surprising when you note that WWO:SDI is similar to some of our existing proofing routines, which use XSLT to create HTML documents that enable us to review our dat<img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-458 alignright\" src=\"http:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM-300x192.png\" alt=\"\" width=\"300\" height=\"192\" srcset=\"https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM-300x192.png 300w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM-768x491.png 768w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM-1024x655.png 1024w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM-422x270.png 422w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.21.01-AM.png 1154w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/>a. For example, we have a proofing routine that creates a chart displaying encoded data on the page numbers and signature marks that appear in our texts, along with our idealizations of page numbers and milestones. This chart makes it much easier to see where there are mismatches between our idealized numbering and the actual contents of each page and to catch errors such as when pages might be numbered: 1, 2, <a href=\"https:\/\/en.wikipedia.org\/wiki\/Rabbit_of_Caerbannog#Holy_Hand_Grenade_of_Antioch\">5<\/a>.<\/p>\n<p>Creating WWO:SDI was an interesting thought experiment for us, particularly as we considered how our markup could be used to extract words that would not be allowed in a standard Scrabble\u00ae game (we thought of the various namelike elements right away, but hadn\u2019t considered &lt;speaker&gt; until we remembered that most of the contents of &lt;speaker&gt; labels are proper nouns\u2014we did have to reconcile ourselves to falsely excluding some words, such as \u201cservant,\u201d \u201cduke,\u201d or \u201cattendants\u201d). We also had to figure out a mechanism for excluding roman numerals, which proved tricker than we first expected, precisely because they <em>aren\u2019t <\/em>always\u00a0set aside in the encoding as names and such are. And we were able to draw on some of our existing routines for regularizing original orthographies, dealing with <a href=\"https:\/\/twitter.com\/NUwwp\/status\/831555760886800384\">end-of-line<\/a> (\u201csoft\u201d) hyphens, and preferring corrections over errors.<\/p>\n<p>Because WWO:SDI makes it easy to sort by word length, it also has helped us to catch some encoding errors in the texts we are preparing for publication. For example, the interface will join up the halves of words that are split by end-of-line hyphens, which we encode with a \u201c<a href=\"https:\/\/www.balisage.net\/Proceedings\/vol17\/html\/Bauman01\/BalisageVol17-Bauman01.html\">soft hyphen<\/a>\u201d\u00a0character that appears identical in most programs to the standard keyboard hyphen character we use for compound words (\u201chard hyphens,\u201d as we often call them). Thus, WWO:SDI makes it very easy to spot incorrectly-encoded soft hyphens because these typically appear as extremely\u00a0long words at the top of the lists when sorted by length.<\/p>\n<figure id=\"attachment_459\" aria-describedby=\"caption-attachment-459\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-459 size-large\" src=\"http:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM-1024x251.png\" alt=\"\" width=\"640\" height=\"157\" srcset=\"https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM-1024x251.png 1024w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM-300x74.png 300w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM-768x189.png 768w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM-604x148.png 604w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-02-at-11.24.24-AM.png 1548w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-459\" class=\"wp-caption-text\">Soft and hard hyphens: spot the difference<\/figcaption><\/figure>\n<p>Similarly, WWO:SDI is good at uncovering the kinds of missing spaces that are much less visible in the XML files themselves, usually where words are marked with phrase-level elements, such as in:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-467\" src=\"http:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-03-at-2.37.28-PM-1024x67.png\" alt=\"\" width=\"640\" height=\"42\" srcset=\"https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-03-at-2.37.28-PM-1024x67.png 1024w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-03-at-2.37.28-PM-300x20.png 300w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-03-at-2.37.28-PM-768x50.png 768w, https:\/\/wwp.northeastern.edu\/blog\/wp-content\/uploads\/2017\/04\/Screen-Shot-2017-04-03-at-2.37.28-PM-604x39.png 604w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><br \/>\nThere\u2019s a missing space between \u201cbest\u201d and \u201cHistory\u201d but the (in this case, artificially constructed) layers of markup make that hard to see. On the other hand, \u201cbesthistory\u201d is much easier to spot in WWO:SDI and we may just end up developing a version that we could use in our actual proofing processes.<\/p>\n<p>So, hopefully you enjoyed playing with WWO:SDI\u2014and perhaps it even sparked your interest in using tools like XSLT to work with XML-encoded documents (possibly by joining the <a href=\"http:\/\/wwp.northeastern.edu\/about\/events.html#seminar_2017-06-12\">XSLT workshop<\/a> at DHSI). We certainly have a lot of fun using XSLT to explore and proof our documents, even when it isn\u2019t April 1st!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently, we published an announcement about the release of the Women Writers Online: Scrabble Discovery Interface (WWO:SDI), which was (we hope) fairly obviously an April Fools\u2019 Day joke. For all its silliness, however, WWO:SDI demonstrates some of the much more practical tools we have for interacting with WWO. More than that, the WWO:SDI interface itself has proved to be a remarkably effective proofing tool. This second point may be less surprising when you note that WWO:SDI is similar to some&#8230;<\/p>\n<p class=\"read-more\"><a class=\"btn btn-default\" href=\"https:\/\/wwp.northeastern.edu\/blog\/making_wwosdi\/\"> Read More<span class=\"screen-reader-text\">  Read More<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"class_list":["post-457","post","type-post","status-publish","format-standard","hentry","category-announcements"],"_links":{"self":[{"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/posts\/457","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/comments?post=457"}],"version-history":[{"count":12,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/posts\/457\/revisions"}],"predecessor-version":[{"id":473,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/posts\/457\/revisions\/473"}],"wp:attachment":[{"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/media?parent=457"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/categories?post=457"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wwp.northeastern.edu\/blog\/wp-json\/wp\/v2\/tags?post=457"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}