Digital Libraries II: National and International Digital Library Initiatives; Institutional Repositories, ROAR, OpenDOAR and Sherpa Romeo; Content Management Systems; AI, Expert Systems, Robotics, SMAC and Cloud Computing; and Ontology, the Semantic Web, Linked Data, Big Data, Data Mining and Data Harvesting
2. Institutional repositories: need, purpose, types and tools; India; ROAR, OpenDOAR and Sherpa Romeo
Clifford Lynch (2003) defined a university-based institutional repository as a set of services that a university offers to the members of its community for the management and dissemination of digital materials created by the institution and its members. Repositories collect, preserve and give open access to theses, articles (as preprints or accepted manuscripts, the "green" route to open access), reports, data, learning materials and archives. They are needed to increase the visibility and impact of research, to preserve the institution's intellectual output, to comply with funder and institutional open access mandates, and to support research assessment. Types are institutional repositories; subject or disciplinary repositories, such as arXiv (1991), PubMed Central (2000), RePEc and E-LIS for library and information science; data repositories such as Zenodo (CERN) and Dryad; and national repositories such as Shodhganga. Tools include DSpace (MIT and Hewlett-Packard, 2002), EPrints (University of Southampton, 2000), Fedora, Greenstone and Invenio. In India, ePrints@IISc was among the first institutional repositories, and many IITs, IISERs, universities and CSIR laboratories now run repositories, most on DSpace or EPrints.
| Service | What it is |
|---|---|
| ROAR (Registry of Open Access Repositories) | A registry of repositories hosted at the University of Southampton, from 2003, recording repository growth |
| OpenDOAR (Directory of Open Access Repositories) | A quality-checked directory of repositories, begun at the University of Nottingham in 2005 and now run by Jisc; the syllabus's "DOAR" |
| Sherpa Romeo | A Jisc service summarising publishers' and journals' copyright and open access self-archiving policies: which version (submitted, accepted or published) may be deposited, where, and after what embargo; it formerly grouped publishers by colour and now lists permitted versions and conditions; the syllabus's "SHARPA-ROMIO" |
3. Content management systems
A content management system (CMS) lets people create, edit, organise and publish digital content, typically a website, without writing code. Its architecture separates a content repository (a database of content items and metadata), a content management application (authoring, editing, workflow and approval, version control, user roles and permissions) and a content delivery application (templates and themes that present the content); a "headless" CMS delivers content through APIs to any front end. Data integration connects the CMS with other systems: catalogue search boxes and new-arrival feeds from the ILS, repository content through APIs or OAI-PMH, discovery-service widgets, RSS and social media, and single sign-on. Widely used open source CMS software includes WordPress (2003), Drupal (2001) and Joomla (2005); libraries also use hosted platforms for subject guides. Selection weighs functionality, ease of use for non-technical staff, accessibility, security and update record, extensibility through modules and plugins, community and vendor support, hosting and cost. Implementation covers content audit and migration, design, training and launch; evaluation uses web analytics, usability testing and user feedback.
4. Artificial intelligence, expert systems and robotics; SMAC; cloud computing
Artificial intelligence (AI) is the capacity of machines to perform tasks that require intelligence, such as understanding language, recognising patterns, learning and reasoning. An expert system captures the knowledge of human experts in a narrow field: it has a knowledge base of facts and rules, an inference engine that reasons with them, a user interface and an explanation facility; early examples were DENDRAL and MYCIN, and library applications have included cataloguing and reference advisers. Current AI in libraries includes chatbots for routine queries, recommendation systems, automatic subject indexing and metadata generation, OCR and handwriting recognition, speech-to-text for accessibility, and generative AI built on large language models, which librarians must also teach users to evaluate, since such tools can fabricate references, reproduce bias and raise copyright and integrity questions. Robotics in libraries covers automated storage and retrieval systems that fetch items from high-density stores, automated materials handling that sorts returned books, shelf-scanning inventory robots, and telepresence or guide robots. SMAC is the convergence of social media, mobile technology, analytics and cloud computing, each reinforcing the others: services reach users on phones and social platforms, generate data that analytics turns into insight, and run on cloud infrastructure.
| Cloud computing (NIST definition, 2011) | Content |
|---|---|
| Five essential characteristics | On-demand self-service, broad network access, resource pooling, rapid elasticity and measured service |
| Three service models | Software as a Service (SaaS: a hosted library system or e-mail), Platform as a Service (PaaS: a development platform) and Infrastructure as a Service (IaaS: rented servers and storage) |
| Four deployment models | Public, private, community and hybrid clouds |
| In libraries | Cloud-hosted library services platforms and hosted Koha, repository and backup storage, shared office suites; gains in cost and scalability are weighed against data location, privacy, vendor lock-in and dependence on connectivity |
5. Ontology and its tools; the semantic web, linked data, big data, data mining and data harvesting
In computing, an ontology is, in Tom Gruber's phrase (1993), "an explicit specification of a conceptualization": a formal model of the classes in a domain, their properties and relations, the individuals that belong to them, and rules (axioms) that allow reasoning. RDF (Resource Description Framework, a W3C Recommendation from 1999, revised as RDF 1.1 in 2014) expresses data as triples of subject, predicate and object, each named by a URI, which together form a graph. RDFS (RDF Schema) adds a basic vocabulary for describing classes and properties, such as rdfs:Class, rdfs:subClassOf, rdfs:domain and rdfs:range; OWL (the Web Ontology Language, 2004; OWL 2, 2009) adds richer logic; SPARQL (2008) queries RDF. Protégé, the free, open source ontology editor from Stanford University's biomedical informatics research centre, is the tool the syllabus prints as "Potege". The semantic web, set out by Tim Berners-Lee, James Hendler and Ora Lassila in Scientific American (2001), is a web of data that machines can interpret, built in layers from URIs and Unicode through XML, RDF, RDFS and OWL to logic, proof and trust.
- Linked data: Berners-Lee's four principles (2006) are to use URIs as names for things; use HTTP URIs so that people can look them up; provide useful information in standard formats (RDF, SPARQL) when a URI is looked up; and include links to other URIs so more things can be discovered. His five-star scheme (2010) grades open data from one star (available on the web under an open licence) to five (linked to other data). Library examples are the Library of Congress's id.loc.gov (LCSH and other vocabularies as linked data), VIAF (the Virtual International Authority File, hosted by OCLC), Wikidata and BIBFRAME.
- Big data: data sets too large or fast for ordinary tools, described by Doug Laney's three Vs (2001), volume, velocity and variety, often extended with veracity and value; libraries meet it in usage logs, research data and digitised text corpora.
- Data mining: discovering patterns in large data sets as part of knowledge discovery in databases (selection, pre-processing, transformation, mining, interpretation), using classification, clustering, association rules ("users who borrowed this also borrowed that") and text mining.
- Data harvesting: automated collection of data or metadata from many sources, such as OAI-PMH harvesting by aggregators (CORE, BASE, NDLI), web crawling for web archives, and API-based collection; it must respect licences, privacy and robots rules.
Key takeaways
- Indian initiatives: NDLI (IIT Kharagpur), NVLI (National Mission on Libraries), Shodhganga, ePG-Pathshala and SWAYAM, the National Mission for Manuscripts (2003) and the Gyan Bharatam Mission (Budget 2025-26); international: Project Gutenberg (1971), American Memory, Internet Archive (1996), Gallica (1997), Google Books (2004), Europeana and HathiTrust (2008), World Digital Library (2009), DPLA (2013).
- Institutional repositories (Lynch, 2003) give green open access and preservation; types are institutional, subject (arXiv, PubMed Central, E-LIS), data (Zenodo) and national (Shodhganga); tools DSpace (2002), EPrints (2000), Fedora; registries ROAR (2003) and OpenDOAR (2005), and the policy service Sherpa Romeo (the syllabus's "SHARPA-ROMIO").
- A CMS separates repository, management and delivery applications; WordPress, Drupal and Joomla are common; selection weighs usability, security, extensibility, support and cost.
- Expert systems have a knowledge base, inference engine, interface and explanation facility; AI and robotics support chatbots, indexing, recommendation, ASRS and sorting; SMAC is social, mobile, analytics and cloud; NIST (2011) gives five characteristics, three service models (SaaS, PaaS, IaaS) and four deployment models.
- An ontology is an explicit specification of a conceptualisation (Gruber, 1993); RDF triples, RDFS, OWL and SPARQL, edited in Protégé (the syllabus's "Potege"); the semantic web (2001), linked data's four principles (2006), big data's three Vs, data mining and OAI-PMH harvesting.
Practice questions (10)
Attempt each one before opening the answer. Every explanation names the tempting wrong option as well as the right one, because that is where marks are lost.
Which service summarises publishers' copyright and self-archiving policies for authors depositing in repositories?
Show answer
Answer: D — Sherpa Romeo
Sherpa Romeo, run by Jisc, records which version of an article may be deposited and on what conditions. OpenDOAR and ROAR list repositories, and Europeana aggregates European cultural heritage.In RDF, each statement is expressed as a triple of:
Show answer
Answer: B — Subject, predicate and object
RDF describes resources with subject-predicate-object triples, each part named by a URI, forming a graph. The other options are FRBR entities, the ISO 2709 record structure and Dublin Core elements.How many service models of cloud computing does the NIST definition recognise? Type the number.
Numerical answer — type the value.
Show answer
Answer: 3
NIST's definition (2011) names three service models, Software, Platform and Infrastructure as a Service, alongside five essential characteristics and four deployment models.Which of the following are components of an expert system? Select all that apply.
Show answer
Answer: A — Inference engine; B — Knowledge base; D — Explanation facility
An expert system combines a knowledge base of facts and rules, an inference engine that reasons with them, a user interface and an explanation facility that shows how a conclusion was reached. A link resolver is an OpenURL tool for e-resources.Assertion (A): Depositing an accepted manuscript in an institutional repository is a form of green open access. Reason (R): Green open access means that the journal itself publishes the article free to read on its own website. Choose the correct option.
Show answer
Answer: C — A is true, but R is false
A is true and R is false. Green open access is self-archiving by the author in a repository; publication free to read by the journal itself is gold open access.DSpace, the widely used repository software, was developed by:
Show answer
Answer: C — MIT and Hewlett-Packard
DSpace was released in 2002 by MIT Libraries and Hewlett-Packard. Southampton developed EPrints, CERN developed Invenio and runs Zenodo, and Waikato developed Greenstone.Which of the following are among Tim Berners-Lee's principles of linked data? Select all that apply.
Show answer
Answer: A — Use URIs as names for things; B — Include links to other URIs
The four principles are to use URIs as names, use HTTP URIs, provide useful information in standard formats such as RDF when a URI is looked up, and link to other URIs. Linked data is distributed, not centralised, and does not require MARC.Doug Laney's original description of big data named how many Vs? Type the number.
Numerical answer — type the value.
Show answer
Answer: 3
Laney (2001) described volume, velocity and variety. Later writers added veracity and value, making four or five Vs, but the original model has three.A library analyses its circulation records and finds that students who borrow a statistics textbook often also borrow an SPSS manual. Which data mining technique does this illustrate?
Show answer
Answer: A — Association rule mining
Finding items that occur together is association rule mining, the basis of "readers who borrowed this also borrowed" recommendations. Harvesting collects data, emulation is a preservation method, and encryption protects data.The syllabus lists "Potege" among ontology tools. The tool meant is:
Show answer
Answer: B — Protégé, the ontology editor from Stanford University
"Potege" is a misprint for Protégé, the free, open source ontology editor from Stanford's biomedical informatics research centre. PREMIS is preservation metadata, Portico a dark archive, and PRECIS Austin's indexing system.