Knowledge Organisation III: Indexing Systems and Techniques, Assigned and Derived, Pre-Coordinate and Post-Coordinate; Vocabulary Control; Abstracting, its Types and Guidelines; and Information Retrieval Systems, their Features, Components, Models and Evaluation
2. Derived, title-based indexing
Derived indexing takes significant words from the document, originally from titles, which is cheap enough for a computer to do. H. P. Luhn of IBM introduced the keyword-in-context (KWIC) index around 1958-60: each significant title word, after stop words such as "a", "of" and "the" are removed, becomes an entry point, printed aligned in a central column with the rest of the title wrapped around it, so the context is visible. Keyword-out-of-context (KWOC) prints the keyword as a heading in the margin with the full title beneath; keyword-and-context (KWAC) keeps the title intact and appends the displaced words. Title-based indexes are fast and current (Chemical Titles, 1960, was an early KWIC index) but depend on how informative titles are, cannot bring synonyms together and scatter related concepts; enrichment with added keywords partly remedies this. Citation indexing, proposed by Eugene Garfield in 1955, is another derived method: the "terms" are the references a document cites.
3. Vocabulary control
Natural language has synonyms (several words for one concept: cars, automobiles), homonyms (one word for several concepts: mercury the metal, the planet and the god) and variant spellings, and it does not show hierarchies. Vocabulary control fixes one preferred term for each concept, refers users from non-preferred terms, distinguishes homonyms with qualifiers, and records broader, narrower and related concepts, so that indexer and searcher use the same term. The tools are subject heading lists, such as the Library of Congress Subject Headings (first published 1909-14) and the Sears List of Subject Headings (1923) for smaller libraries, and thesauri, which list terms and their relationships for a particular field: MeSH (Medical Subject Headings, National Library of Medicine, 1960), the ERIC Thesaurus, the UNESCO Thesaurus, AGROVOC (FAO) and the INSPEC Thesaurus. Thesaurus construction is standardised in ISO 25964 (2011-13), which replaced ISO 2788 and ISO 5964.
| Relationship | Abbreviations | Example |
|---|---|---|
| Equivalence | USE / UF (used for) | Automobiles USE Cars; Cars UF Automobiles |
| Hierarchical | BT (broader term) / NT (narrower term) | Libraries NT Academic libraries; Academic libraries BT Libraries |
| Associative | RT (related term) | Libraries RT Librarians |
| Scope | SN (scope note) | Defines how a term is used in the vocabulary |
4. Abstracting: types and guidelines
An abstract is an abbreviated, accurate representation of the contents of a document, without added interpretation or criticism, according to the ANSI/NISO definition. It helps readers decide whether to read the full document, saves time, overcomes language barriers when written in another language, and supports retrieval when abstracts are indexed. Abstracts may be written by the author (author abstracts), by subject specialists or professional abstractors for abstracting services, or increasingly generated automatically.
| Type | What it does |
|---|---|
| Indicative (descriptive) | Says what the document is about and what it covers, without giving results; suits reviews, long reports and discursive works |
| Informative | Gives the purpose, methods, results and conclusions, with key data, so it can partly stand in for the document; suits experimental and research papers |
| Indicative-informative | Informative on the main points and indicative on the rest |
| Critical | Adds the abstractor's evaluation of the work's quality; close to a short review |
| Structured | Uses fixed headings such as background, objectives, methods, results and conclusions; standard in medical journals |
| Slanted (mission-oriented) | Written for a particular group, emphasising what matters to them |
| Statistical or tabular, and telegraphic | Data presented in tables; or notes in abbreviated, telegraphic style |
- Standards: ISO 214 (Documentation, abstracts for publications and documentation; first 1976) and ANSI/NISO Z39.14 (Guidelines for Abstracts, 1997).
- Good practice: state the purpose, method, results and conclusions in that order; be concise, usually a single paragraph; use complete sentences, the active voice where possible and the past tense for what was done and found; include no information absent from the document; avoid undefined abbreviations and references to figures.
5. Information retrieval systems: features, components, models and evaluation
An information retrieval (IR) system selects, from a store of documents or records, those relevant to a user's query. Its components are a document subsystem (acquisition, indexing or representation, storage), a query subsystem (the user's need expressed as a search statement), a matching subsystem that compares the two and ranks or selects results, and an interface with feedback. Search features include Boolean operators, truncation and wildcards, phrase and proximity searching, field searching, limits, relevance ranking and relevance feedback.
| Model | How documents are matched |
|---|---|
| Boolean | Exact match with AND (both terms), OR (either) and NOT (exclude); a document is retrieved or not, with no ranking |
| Vector space | Gerard Salton (the SMART system): documents and queries are vectors of weighted terms (tf-idf); ranked by similarity, usually the cosine of the angle between vectors |
| Probabilistic | Stephen Robertson and Karen Spärck Jones (1976): ranks by the estimated probability of relevance; BM25 is its best-known weighting |
| Fuzzy set and extended Boolean | Partial membership and graded Boolean matching, giving ranked output |
| Latent semantic indexing | Reduces the term-document matrix to underlying concepts, so documents can match without sharing exact words |
Evaluation began with Cyril Cleverdon's Cranfield experiments (Cranfield I, 1957-62; Cranfield II, 1963-66), which compared indexing languages on a test collection with relevance judgements and established recall and precision as the standard measures; F. W. Lancaster's evaluation of MEDLARS (1968) applied them to an operational system, and the Text REtrieval Conference (TREC), run by NIST since 1992, continues the tradition. Recall is the proportion of all relevant documents in the collection that the search retrieves; precision is the proportion of retrieved documents that are relevant. Worked example: a collection holds 40 documents relevant to a query; a search retrieves 50 documents, of which 30 are relevant. Precision = 30 / 50 = 60 per cent. Recall = 30 / 40 = 75 per cent. The F-measure, the harmonic mean of the two, is 2 × 0.60 × 0.75 / (0.60 + 0.75) = 0.90 / 1.35 = 0.67. Cleverdon observed that recall and precision tend to vary inversely: broadening a search raises recall and lowers precision.
Key takeaways
- Assigned indexing uses terms chosen by an indexer; derived indexing takes words from the document; pre-coordinate systems combine terms at indexing, post-coordinate systems at searching.
- Pre-coordinate systems: Kaiser (1911), chain indexing (Ranganathan, 1938), relational indexing (Farradane), PRECIS (Austin, 1974), POPSI (Bhattacharyya); post-coordinate: Uniterm (Taube, 1953) and peek-a-boo cards; chain indexing turns 330.954 into entries under India, economic conditions, economics and social sciences.
- Derived indexing: KWIC (Luhn), KWOC, KWAC and citation indexing (Garfield, 1955); vocabulary control uses LCSH, Sears and thesauri such as MeSH (1960), with USE/UF, BT/NT, RT and SN, under ISO 25964.
- Abstracts are indicative, informative, indicative-informative, critical, structured or slanted; ISO 214 and ANSI/NISO Z39.14 give guidelines.
- IR models are Boolean, vector space (Salton), probabilistic (Robertson and Spärck Jones) and others; evaluation from Cranfield (Cleverdon) to TREC (1992) uses precision (relevant retrieved over retrieved) and recall (relevant retrieved over all relevant): 30 of 50 retrieved with 40 relevant gives 60 and 75 per cent.
Practice questions (10)
Attempt each one before opening the answer. Every explanation names the tempting wrong option as well as the right one, because that is where marks are lost.
A collection contains 80 documents relevant to a query. A search retrieves 40 documents, of which 32 are relevant. What is the recall, in per cent? Type the number.
Numerical answer — type the value.
Show answer
Answer: 40
Recall = relevant retrieved / all relevant in the collection = 32 / 80 = 0.40, that is 40 per cent. Precision for the same search is 32 / 40 = 80 per cent, showing a precise but low-recall search.A search retrieves 50 documents, of which 30 are relevant; the collection holds 40 relevant documents. What is the precision, in per cent? Type the number.
Numerical answer — type the value.
Show answer
Answer: 60
Precision = relevant retrieved / total retrieved = 30 / 50 = 0.60, that is 60 per cent. The total of 40 relevant documents is needed only for recall, which here is 30 / 40 = 75 per cent.PRECIS was developed by Derek Austin for:
Show answer
Answer: D — The British National Bibliography
PRECIS was devised for subject indexing in the British National Bibliography and used there from the early 1970s until COMPASS replaced it in 1991. POPSI was developed at DRTC, and the National Library of Medicine uses MeSH.In a thesaurus, the relationship between "Libraries" and "Academic libraries" is shown by:
Show answer
Answer: B — BT and NT
Academic libraries is a narrower term of Libraries, so Libraries NT Academic libraries and Academic libraries BT Libraries. USE and UF show equivalence, RT an associative relation, and SN a scope note.Which of the following are pre-coordinate indexing systems? Select all that apply.
Show answer
Answer: C — Chain indexing; D — POPSI
Chain indexing and POPSI combine terms into strings at the indexing stage. Uniterm and optical coincidence (peek-a-boo) cards index each term separately and leave the searcher to combine them, so they are post-coordinate.An abstract that states the purpose, methods, results and conclusions of a research paper, with key figures, so that it can partly substitute for reading the paper, is:
Show answer
Answer: A — Informative
An informative abstract carries the substance, including results. An indicative abstract only says what the document covers, a critical abstract adds evaluation, and a slanted abstract is written for a particular audience.Assertion (A): KWIC indexes cannot bring together documents that use different words for the same concept. Reason (R): KWIC is derived indexing that uses the words of titles without vocabulary control. Choose the correct option.
Show answer
Answer: A — Both A and R are true, and R is the correct explanation of A
Both are true and R explains A. Because KWIC takes words straight from titles with no controlled vocabulary, titles using "cars" and "automobiles" are filed in different places; only vocabulary control can collocate synonyms.Which information retrieval model represents documents and queries as weighted term vectors and ranks documents by the cosine of the angle between them?
Show answer
Answer: D — The vector space model
Salton's vector space model, developed with the SMART system, measures similarity between term vectors. The Boolean model gives exact, unranked matches, the probabilistic model ranks by estimated probability of relevance, and chain indexing is a pre-coordinate indexing method.Which statements about the evaluation of information retrieval are correct? Select all that apply.
Show answer
Answer: A — TREC has been run by NIST since 1992; B — The Cranfield experiments were led by Cyril Cleverdon; C — Recall and precision tend to vary inversely
Cleverdon led Cranfield, recall and precision usually trade off, and NIST has run TREC since 1992. The last statement defines recall, not precision; precision divides by the number of documents retrieved.Using chain indexing on the DDC number 330.954 (300 Social sciences, 330 Economics, 330.9 Economic conditions, 330.954 India), which is the first and most specific index entry?
Show answer
Answer: B — India, Economic conditions, Economics 330.954
Chain procedure starts with the last link, India, qualified by the higher links in reverse order, and gives it the full class number 330.954. Entries for higher links (Economics 330) follow; citing the links from the top down or attaching India to 330.9 is not the chain procedure.