2023-05-18 Reporting SIG Meeting notes

Date

18 May 2023

Attendees

Present?	Name	Organization	Present?	Name	Organization
x	Arthur Aguilera	University of Colorado, Boulder		Eliana Lima	Fenway Library Organization
	Sharon Beltaine	Cornell University		Eric Luhrs	Lehigh University
	Erin Block	University of Colorado, Boulder	x	Linda Miller	Cornell University
	Nancy Bolduc	Cornell University		Nassib Nassar	Index Data
	Shannon Burke	Texas A&M	x	Elena O'Malley	Emerson
	Suzette Caneda	Stanford University		Tod Olson	University of Chicago
x	Dung-Lan Chen	Skidmore College	x	Jean Pajerek	Cornell University
	Lloyd Chittenden	Marmot	x	Kimberly Pamplin	Texas A&M University
	Tim Dannay	Mount Holyoke College	x	Scott Perry	University of Chicago
	Axel Doerrer	University Mainz	x	Natalya Pikulik	Cornell University
	Shelley Doljack	Stanford University	x	Bob Scheier	Holy Cross
	Stefan Dombek	Leipzig University		Vandana Shah	Cornell University
	Jennifer Eustis	U. Massachusetts Amherst / Five College	x	Linnea Shieh	Stanford University
	Lynne Fors	Wellesley College		Kimberly Smith	Middle Tennessee State University
	Lisa Furubotten	Texas A&M		Clare Spitzer	Stanford University
	Alissa Hafele	Stanford University		Amelia Sutton	U. Massachusetts
	Kara Hart	Wellesley College		Simona Tabacaru	Texas A&M
	Corrie Hutchinson	Index Data		Huey-Ning Tan	Stanford University
x	Jamie Jesanis	Wellesley College		Vitus Tang	Stanford University
x	Jeanette Kalchik	Stanford University		Irina Trapido	Stanford University
	Kevin Kishimoto	Stanford University		Catherine Tuohy	Emmanuel College
	Ingolf Kuss	hbz		Kevin Walker	The University of Alabama
	Alexander Lao	Stanford University	x	Angela Zoss	Duke University
	Joanne Leary	Cornell University

Discussion Items

Item

Who

Notes

Attendance & Notes

Angela

Attendance & Notes

Today's attendance-taker: Linda (or substitute)
Today's note-takers: Team Leads for project updates

Announcements /
Reminders

Sharon

Upcoming meeting topics

Monday, May 22: WOLFcon brainstorm (CFP for WOLFcon)
Thursday, June 1: Brainstorm outreach activities for the SIG, set up quarterly schedule
Monday, June 12: Onboarding, Part 2 (tentative)
Thursday, June 15: TBD

Combining MM and RA/UM subgroups

Current plan is to meet monthly on 2nd Tuesdays at 1pm Eastern
- Zoom: https://duke.zoom.us/j/92324148267?pwd=V3lCSGJBSm5mYm4xamVFNFJqOGhzZz09
Looking for people excited to build new query writing skills; contact Angela Zoss (Old) for more information

Any new members?

Welcome/introductions

How to find our latest recordings

Recording details available on our Reporting SIG Meetings and Notes page and Query Development Meetings page

(Always) Recruiting New Query Developers

The Reporting SIG is always on the look-out for new query developers. Please let us know if you are interested in doing query development or if there are others at your institution who might be a good fit.

Updates from development

Angela

Rolling releases for FOLIO Analytics

Over the last year or so, we have had formal releases of FOLIO Analytics about every four months, aligned with the FOLIO flower releases
As we have more institutions relying on LDP1 and Metadb instances, a delay of four months to receive new queries is often too long
Additionally, having many pull requests waiting to be merged causes potential file conflicts (the same file gets edited differently by different people, and then the different edits have to be resolved manually)
Nassib has been making changes to have pull requests merge automatically when it has three approvals
Instead of waiting for a flower release, Nassib will then generate releases on a much smaller scale, very soon after a change or a small group of changes are merged
Even with these rolling releases, the query development teams will still organize work around FOLIO flower releases
- We will recruit review board members for each flower release
- We will schedule a specific release to coincide with the flower release
- We will summarize all changes merged during a single flower release cycle in a release notes document, likely on a wiki page attached to the repository
For institutions that are running derived table queries from FOLIO Analytics, they can choose whatever update schedule makes sense to them; they can update frequently, wait for a flower release, selectively pick releases based on desired changes, etc.

Cleaning up JIRA Issues

The Reporting SIG used JIRA for early report request tracking, but we've left it behind recently
There are over 200 report requests and another few dozen "cluster" issues we created but don't really maintain
Now that our development work is so reliant on GitHub and we aren't in much active conversation with the FOLIO community about reports, it's time to clean up the old JIRA issues and transition them to GitHub
In our development subteams, we'll be going through these issues and making decisions about closing them and whether they will be addressed with any new query development
Hope to have much of this cleaned up over the summer

Recurring Items (Updated weekly, but not always discussed in meeting)

Item

Who

Notes

Review of In-Progress Projects (Recurring)

Build a directory of extracted and derived tables
Build Metadb query cookbook-style documentation
- has been opened and sent to the development teams for planning/prioritization
- haven't settled on a style exactly, but have some examples
Build Training Program for FOLIO Data Model
- ACQ/ERM drafts have been presented and will be updated
Port LDP1 derived tables to Metadb
- possibly done??
Recruit from new institutions not represented
- recommend that the development teams reach out to SIGs for an update, invite new members

Review the release notes for FOLIO Analytics, LDP1, LDLite, LDP Reporting App, ldpmarc, Metadb Projects (Recurring)

LDP1 release notes
Metadb release notes (via tags)
LDLite release notes (via tags)
ldpmarc release notes
LDP Reporting App release notes (mod-ldp, ui-ldp) and JIRA issues (mod-ldp, ui-ldp)
FOLIO Analytics release notes

Updates and Query Demonstrations from Various Reporting Related Groups and Efforts Projects (Recurring)

Community & Coordination, Reporting Subgroup Leads

Project updates

Reporting development is using small subgroups to address priorities and complete work on report queries. Each week, these groups will share reports/queries with the Reporting SIG. Reporting development team leads are encouraged to enter a summary of their work group activities below.

RA/UM Working Group

Meetings have become more of a lab session, working through specific problems
Contact Angela if you would like to join these meetings; second Tuesdays at 1pm Eastern
Context
- Meeting notes: https://docs.google.com/document/d/1UnzG64tl917LOH2FtWhCEPlSOsnJWKL-0eu88Ouo1DU/edit
- Current status of RA/UM issues: https://github.com/folio-org/folio-analytics/issues?q=is%3Aissue+is%3Aopen+RA%2FUM
- Status of LDP1 → Metadb querying porting: https://docs.google.com/spreadsheets/d/1efLc6QMJyGuXyQM26pZbti-B6wFhJuZt7s7FJbhdXYo/edit#gid=0

MM Working Group

We are now holdings joint meetings with RA/UM. Our recurring meeting time has changed to the 2nd Tuesday from 1-2pm ET.
Zoom URL: https://duke.zoom.us/j/92324148267?pwd=V3lCSGJBSm5mYm4xamVFNFJqOGhzZz09
Meeting ID: 923 2414 8267
Passcode: 358968

ERM Working Group

Current topics
- Reporting for FOLIO Apps
  - Open Access
  - eUsage
  - eHoldings
Meetings are bi-weekly on tuesdays 11am ET alternating with ACQ Working Group
- Next meeting will be at 9th, May
- Contact Stefan Dombek if you would like to get a calendar invitation

ACQ Working Group

group is working with ERM group on ACQ-ERM FOLIO Data Model Training
group is working on ACQ-related (Acquisitions) derived tables for the next Folio-Analytics release
- see ACQ Derived Tables to Convert from LDP1 to Metadb
for latest query development updates, see RM Prototype and Query Development Status
Meetings are biweekly on Tuesdays 11am-noon ET; contact Sharon Beltaine if you would like a calendar invitation
Meeting Recordings are here: FOLIO ERM-RM Report Dev Teams

Reporting SIG Documentation Subgroup

Morning Glory documentation is live on https://docs.folio.org/docs/
Nolana documentation is in review
Orchid documentation will be in progress soon, and plans are underway to include beta-level documentation for Metadb
Additional Context
- The Reporting SIG has representation on the Documentation Working Group, which is building end-user documentation for https://docs.folio.org/docs/ (mostly linking to existing documentation over on GitHub)

External Statistics Working Group

no updates currently
new organizational/tracking scheme for JIRA, with pointers to queries in folio-analytics repository
New organizational structure for External Statistics reports
- external statistics reports (e.g., ACRL) typically require running queries from different functional reporting areas
- these reports will be captured in JIRA under one UXPROD-XXXX report cluster issue, then the descriptions will point to each of the queries required to run them on the folio-analytics repository
- institutions will need to rank each of these 8 new UXPROD-XXXX report cluster issues
- each reporting development team will take responsibility for the queries in their area for the external statistics clusters

D-A-CH Working Group (D-Reporting)

Discussion on draft statement: "Hosting and Support"
- The members of D-Reporting need more time to review the document and provide feedback
Ongoing topics
- Onboarding training
- DBS statistics
  - JIRA-Issues, Rpt-Clusters
  - Gap analysis to statistic codes, user counts etc.
  - Identifying functions that we need for statistics in Germany but are not yet implemented in FOLIO
Meetings are currently held by appointment
- Last meeting: 8th, May
- Next meeting will be at 15th, May (1 pm, CEST)
- Contact Stefan Dombek if you would like to get a calendar invitation

Product Council

(December 8 meeting) PC shared a report of the SIG check-ins
would love for PC to check-in yearly

For all recent work on FOLIO Reporting SQL development:

https://github.com/folio-org/folio-analytics/commits/main