Update to Perseus 6 texts

[whoopsedesy]

We currently source texts from Perseus Hopper a.k.a. Perseus 4.0. The Perseus project is transitioning towards Perseus 5.0, which sources Greek texts from:

• https://github.com/PerseusDL/canonical-greekLit (docs)

The newer texts have advantages:

• Currently maintained
• They accept corrections via pull request (see Catalog of Perseus fixes #53)
• Unicode rather than Beta Code

[whoopsedesy]

Here's the correspondence between what we're using now and the new texts (table scrolls right). The hymns have been divided into several files, which breaks our assumption that a "work" is a single file.

SEDES label	Hopper	canonical-greekLit	Scaife
aratus	Perseus:text:2008.01.0483	tlg0653.tlg001.perseus‑grc1
argonautica	Perseus:text:1999.01.0227	tlg0001.tlg001.perseus‑grc2	urn:cts:greekLit:tlg0001.tlg001.perseus‑grc2
callimachushymns	Perseus:text:2008.01.0481	tlg0533.tlg015.perseus‑grc1 (Zeus) tlg0533.tlg016.perseus‑grc1 (Apollo) tlg0533.tlg017.perseus‑grc1 (Artemis) tlg0533.tlg018.perseus‑grc1 (Delos) tlg0533.tlg019.perseus‑grc1 (Athena) tlg0533.tlg020.perseus‑grc1 (Demeter)
homerichymns	Perseus:text:1999.01.0137	tlg0013.tlg001.perseus‑grc2 tlg0013.tlg002.perseus‑grc2 tlg0013.tlg003.perseus‑grc2 tlg0013.tlg004.perseus‑grc2 tlg0013.tlg005.perseus‑grc2 tlg0013.tlg006.perseus‑grc2 tlg0013.tlg007.perseus‑grc2 tlg0013.tlg008.perseus‑grc2 tlg0013.tlg009.perseus‑grc2 tlg0013.tlg010.perseus‑grc2 tlg0013.tlg011.perseus‑grc2 tlg0013.tlg012.perseus‑grc2 tlg0013.tlg013.perseus‑grc2 tlg0013.tlg014.perseus‑grc2 tlg0013.tlg015.perseus‑grc2 tlg0013.tlg016.perseus‑grc2 tlg0013.tlg017.perseus‑grc2 tlg0013.tlg018.perseus‑grc2 tlg0013.tlg019.perseus‑grc2 tlg0013.tlg020.perseus‑grc2 tlg0013.tlg021.perseus‑grc2 tlg0013.tlg022.perseus‑grc2 tlg0013.tlg023.perseus‑grc2 tlg0013.tlg024.perseus‑grc2 tlg0013.tlg025.perseus‑grc2 tlg0013.tlg026.perseus‑grc2 tlg0013.tlg027.perseus‑grc2 tlg0013.tlg028.perseus‑grc2 tlg0013.tlg029.perseus‑grc2 tlg0013.tlg030.perseus‑grc2 tlg0013.tlg031.perseus‑grc2 tlg0013.tlg032.perseus‑grc2 tlg0013.tlg033.perseus‑grc2	urn:cts:greekLit:tlg0013.tlg001.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg002.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg003.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg004.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg005.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg006.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg007.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg008.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg009.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg010.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg011.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg012.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg013.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg014.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg015.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg016.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg017.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg018.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg019.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg020.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg021.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg022.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg023.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg024.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg025.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg026.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg027.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg028.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg029.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg030.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg031.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg032.perseus‑grc2 urn:cts:greekLit:tlg0013.tlg033.perseus‑grc2
iliad	Perseus:text:1999.01.0133	tlg0012.tlg001.perseus‑grc2	urn:cts:greekLit:tlg0012.tlg001.perseus‑grc2
nonnusdionysiaca	Perseus:text:2008.01.0485	tlg2045.tlg001.perseus‑grc1
odyssey	Perseus:text:1999.01.0135	tlg0012.tlg002.perseus‑grc2	urn:cts:greekLit:tlg0012.tlg002.perseus‑grc2
quintussmyrnaeus	Perseus:text:2008.01.0490	tlg2046.tlg001.perseus‑grc1
shield	Perseus:text:1999.01.0127	tlg0020.tlg003.perseus‑grc2	urn:cts:greekLit:tlg0020.tlg003.perseus‑grc2
theocritus	Perseus:text:1999.01.0228	tlg0005.tlg001.perseus‑grc2
theogony	Perseus:text:1999.01.0129	tlg0020.tlg001.perseus‑grc2	urn:cts:greekLit:tlg0020.tlg001.perseus‑grc2
worksanddays	Perseus:text:1999.01.0131	tlg0020.tlg002.perseus‑grc2	urn:cts:greekLit:tlg0020.tlg002.perseus‑grc2

[whoopsedesy]

The 5.0 texts use the q element less, preferring to mark quotations using in-text quotation marks. Oddly, they sometimes use

• ‘ U+2018 LEFT SINGLE QUOTATION MARK
• ’ U+2019 RIGHT SINGLE QUOTATION MARK

and sometimes

• ʽ U+02BD MODIFIER LETTER REVERSED COMMA
• ʼ U+02BC MODIFIER LETTER APOSTROPHE

The former pair is standard and expected, but potentially troublesome because U+2019 also stands for an apostrophe, which for us is a word character rather than punctuation. The latter is a strange choice but not actually a problem: we can distinguish U+02BC from apostrophe, and map to U+2018/U+2019 on output. See some discussion at https://github.com/PerseusDL/tei-conversion-tools/wiki/Greek-Betacode-to-Unicode-Transformations#problems ("the decision to use 02BC for apostrophe was an explicit one...") and PerseusDL/canonical-greekLit#1049 (comment).

[whoopsedesy]

Of the texts we use, there is only one that looks to be unsuitable in its current form in 5.0, which is theocritus, tlg0005.tlg001.perseus-grc1.xml. The file is full of ? characters, signifying Beta Code decoding errors. It seems that whatever Beta Code parser was used to make the conversion to Unicode was not able to handle the unusual prepositioning of Beta Code diacritics used in this file. (A matter which we, too encountered, and dealt with locally in c2c4150 and #9 (comment).) It might be possible to repair the Unicode using some heroic heuristics, but it would almost certainly be easier just to re-do the conversion from whatever source was used before.

[whoopsedesy]

Of the texts we use, there is only one that looks to be unsuitable in its current form in 5.0, which is theocritus, tlg0005.tlg001.perseus-grc1.xml.

As of 46cc274f, it looks like the errors in theocritus have been corrected—at least the ? are gone. The commits that changed it are:

• (typos-errors) bad encoding issues with parentheses and combining accents on capital Greek letters - part 1
• (typos-errors) bad encoding issues with split accents and letters after tags - part 2

[whoopsedesy]

Of the texts we use, there is only one that looks to be unsuitable in its current form in 5.0, which is theocritus, tlg0005.tlg001.perseus-grc1.xml. The file is full of ? characters, signifying Beta Code decoding errors. It seems that whatever Beta Code parser was used to make the conversion to Unicode was not able to handle the unusual prepositioning of Beta Code diacritics used in this file. (A matter which we, too encountered, and dealt with locally in c2c4150 and #9 (comment).) It might be possible to repair the Unicode using some heroic heuristics, but it would almost certainly be easier just to re-do the conversion from whatever source was used before.

Looks like since PerseusDL/canonical-greekLit#1377 (2023-02-07), there's now a good version of Theocritus, tlg0005.tlg001.perseus-grc2.xml.

[whoopsedesy]

The version numbering system of Perseus is fuzzy, but the in-progress version is now known as Perseus 6.

2024-01-19 Building Perseus 6: a new production version of the Perseus Digital Library

In numbering versions of Perseus, readers will notice that we are jumping from Perseus 4 directly to Perseus 6. We did not formally designate a Perseus 5 because we have not yet created a system that would replace Perseus 4 but we informally view Perseus 5 as the combined capability of two earlier projects, the Scaife Viewer and the Beyond Translation Reading environment. Together, these two projects can replace Perseus 4 and we thus view them, collectively, as Perseus 5. We use Perseus 6, however, to designate the system that we are now building, which combines the features of the Scaife Viewer and Beyond Translation, allowing us not only to replace Perseus 4 but also to include new services and new categories of data that have become available over the subsequent 20 years.

2024-11-15 Progress towards Perseus6

We are still not in the final stage of implementation but we are finishing up a major, and probably the biggest, task: creating a sustainable backend to manage a growing range of machine actionable textual data from a widening set of open data projects in multiple countries. As we refine the backend data, we can begin to move to the final stage of work: implementing within the Scaife Viewer the frontend services that support treebanks, grammatical annotations, aligned translations, metrical analyses, automatic mapping, links from edition to manuscripts and that were developed in Beyond Translation.

2025-06-10 The Sixth Generation of the Perseus Digital Library and a Workflow for Open Philology

While this is the sixth version of the Perseus Digital Library, Perseus 6 represents a major step beyond its predecessors. Whereas Perseus 5 (described below) can represent and integrate digital versions of print editions (e.g. critical editions with interactive textual notes, links to lexicon and commentary entries), Perseus 6 was designed to bring together an expandable range of born-digital classes of annotation.

The Scaife Viewer about page still says "the next version of the Perseus Digital Library, Perseus 5.0."

[whoopsedesy]

The Perseus 6 text for the Argonautica uses a new choice, which "groups a number of alternative encodings for the same point in a text". It appears only once, at 4.1241. In this case, it is apparently used to indicate a correction in the text, from πλυμμυρίς to πλημμυρίς. πλυμμυρίς is marked with sic ("text reproduced although apparently incorrect or inaccurate") and πλημμυρίς is marked with corr ("the correct form of a passage apparently erroneous in the copy text").

sedes/corpus/argonautica.xml

Line 5961 in 9d92738

<l xml:base="urn:cts:greekLit:tlg0001.tlg001.perseus-grc2:4" n="1241"><choice><sic>πλυμμυρίς</sic><corr>πλημμυρίς</corr></choice>—καὶ γάρ τʼ ἀναχάζεται ἠπείροιο</l>

<l n="1241"><choice><sic>πλυμμυρίς</sic><corr>πλημμυρίς</corr></choice>—καὶ γάρ τʼ ἀναχάζεται ἠπείροιο</l>

My plan is to ignore the sic and keep the corr, but advise if I should do otherwise.

The commit that added the choice comments only: "(typos-errors) tlg0001.tlg001.perseus-grc2 Apollon. 2.1241". Note that the book number in the commit message is wrong: it is 4.1241, not 2.1241 (book Δ). A book scan has πλυμμυρίς at 4.1241, which corresponds to the sic of the choice. I'm not sure why this corrections got a choice marker, when many others just replaced the original text.

[sasansom]

In this case, it is apparently used to indicate a correction in the text, from πλυμμυρίς to πλημμυρίς.

And even in this case, the corrected text could be incorrect. For Ap. Rhod. 4.1241, the OCT (Fraenkel 1961, repr. 1970) in the TLG cannon prints πλημυρίς, not πλημμυρίς: πλημυρίς (καὶ γάρ τ' ἀναχάζεται ἠπείροιο.

[whoopsedesy]

And even in this case, the corrected text could be incorrect. For Ap. Rhod. 4.1241, the OCT (Fraenkel 1961, repr. 1970) in the TLG cannon prints πλημυρίς, not πλημμυρίς

Ok made that correction in sasansom/canonical-greekLit@f5aff29.