2018-10-05 - System Operations and Management SIG Agenda and Notes

Date

Attendees

Goals

Discussion items

TimeItemWhoNotes
2WelcomeIngolf
  • Note taker: Ingolf
10 FOLIO Quality Dashboard for Q3 Release

 Please watch Anton's presentation to the Product Council on the FOLIO Quality Dashboard for Q3 Release .

Room for questions from the group.

Notes

Anton: We can change or add some sections. We now focus on the UI-testing; the backend code tests are decent, with a high code coverage.

UI-testing will be built on tools, taking advantage of automated unit tests.

Acceptance testing has to be done before integration into the solution.

Testing should not have to wait for a stable environment. We need to get an environment for testing quicker.

20OAI-PMH

Harry's slide deck on OAI-PMH.

Open Archives Initiative Protocol for Metadata Harvesting.

A service for querying bibliographic type records over HTTP. Used for harvesting. In fairly heavy use. Use cases: harvesting of a catalog;

Will be implemented in FOLIO as interface to the discovery service. FOLIO team will implement the service, not the harvester. A FOLIO OAI harvester is not a target of the project. (harvester will live on the side of the discovery system).

Will be a ramp-up project for one of the development teams.

Q: What is the difference to Z39.50 ? A: z39.50 can be used in a similar manner, but is an older standard. OAI-PMH delivers XML documents.

The FOLIO OAI-PMH service will serve discovery systems EDS, Primo, Blacklight, VuFind et.al.

First goal: retrieval from mod-marc-storage. Configuration of interface:

  • repository name
  • collections
  • conversion of MARC to DC.

OAI-PMH always delivers at least oai_dc format (minimal dublin core), and can be configured to deliver many other formats.

Product Owner of the FOLIO OAI-PMH project will be Harry. Other POs: Dennis Bridges (Stacks), Ann-Marie Breaux

Technical Lead: Craig McNally.

The project will be an Edge Model, needs an Edge API to support it (needs confirmation).

Team Thunderjet - draft plan: Sprint 48 (onboarding) ... Sprint 53 (Acquisition features)

Questions by Harry to the group: see below


IK: Refer to http://www.openarchives.org/OAI/openarchivesprotocol.html#harvester for concepts and protocol features of OAI-PMH.

30Deployment of FOLIO Q3-2018 ReleaseAll

Let's discuss our first experiences with the Q3-2018 release.

Ingolf installed Q3 on a single-server. Did a re-install instead of a complete new setup. Had no problems with it. Running on an 8 GB RAM virtual machine on SLES 12 SP3.

Problem of time-out during login occured "Error verifying user existence: The timeout period of 1000ms has been exceeded while executing GET /users?query=username==diku_admin for host ...". This has been reported in JIRA MODAT-33 - Getting issue details... STATUS and has been fixed in folio-snapshot-stable. A backport for Q3 is on the agenda.

Jason: Installed on Rancher OS.

Minimum RAM for building (stripes) is 10 GB, but the system can run with 8 GB.

Q: What docker modules use how much RAM ?

Wayne: Want to use -Xmx - limits (e.g. 256 MB) for the various Java-based backend modules; a task for Q4.

mod-inventory-storage and mod-users take a bit more RAM than the other modules.

Jason: running on 3 nodes, each with 16 GB RAM. 8,2 GB on the control pane (server).

Chris Creswell: 8 GB in single mode, 3 x 4 GB on 3 distributed nodes.

See discussion on Slack-Stripes channel https://folio-project.slack.com/messages/C210UCHQ9 (this week).

Clustering postgres - who took a look at that ? - Jason: using "crunchy postgres", which is not quite (question) clustering, but clustering is on Jason's agenda.


Topic(s) for next session

Filip Jakobsen will be our guest to discuss the UX Prototype for FOLIO installation with us and how to add more details to it.

Action items

  • Questions by Harry to all of the group (please try to answer for your institution): Does your institution host an OAI-PMH service ? Do you know of any set up or configuration problems with it; any other known troubles with it ?