Metadata Optimization - Weekly Update

Feb. 17, 2017

Estimated number of Aleph records corrected:

TypeCount% by Batch
Bibliographic

30,595

97.29
Holding

  9,343

99.71
Item  1,439  67.60
Orders   1033

 96

Estimated number of unique tags corrected across all records to date: 20

 

Feb. 14, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs

21,471

95.69
Holdings

  9,339

99.75
Items  1,439  67.60
Orders   1033

 96

Estimated number of unique tags corrected across all records to date: 20

In the works:

Scoping:

  • LDR/06-07 Invalid combinations by format
  • 008/21 (MU) contains non-standard codes 
  • 008/23 (BK, MX) contains non-standard codes
  • 008/23 coded incorrectly given the presence of a print holding

Planning:

  • Invalid/discontinued Language codes
  • Obsolete tags, subfields, indicators, codes; carets & pipes
  • Arranging outsourced remediation: 16,400 CJK bibs with paired field errors; 914 bibs with 008 <> 40 characters; 788 bibs with 245 miscoded or missing

Feb. 10, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs

16,316

95.69
Holdings

  9,339

99.75
Items  1,439  67.60
Orders   1033

 96

Estimated number of unique tags corrected across all records to date: 17

In the works:

Scoping:

  • LDR/06-07 Invalid combinations by format
  • 008/21 (MU) contains non-standard codes 
  • 008/23 (BK, MX) contains non-standard codes
  • 008/23 coded incorrectly given the presence of a print holding

Planning:

  • Invalid/discontinued Language codes
  • Obsolete tags, subfields, indicators, codes; carets & pipes
  • Arranging outsourced remediation: 16,400 CJK bibs with paired field errors; 914 bibs with 008 <> 40 characters; 788 bibs with 245 miscoded or missing

Feb. 3, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs

16,316

95.69
Holdings

  9,339

99.75
Items/orders  1,439  67.60

Estimated number of unique tags corrected across all records to date: 15

In the works:

Scoping:

  • LDR/06-07 Invalid combinations by format
  • 008/21 (MU) contains non-standard codes 
  • 008/23 (BK, MX) contains non-standard codes
  • 008/23 coded incorrectly given the presence of a print holding

Planning:

  • Invalid/discontinued Language codes
  • Obsolete tags, subfields, indicators, codes; carets & pipes

 

Jan. 26, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs

16,054

95.62
Holdings

  9,251

99.91
Items/orders  1,398  68.81

 

Estimated number of unique tags corrected across all records to date: 14

In the works:

Corrections pending: LDR/06 with obsolete b - Middle Eastern Div. Deleted/suppressed bibs with active holdings - SCH

Scoping:

  • LDR/06-07 Invalid combinations by format
  • 008/21 (MU) contains non-standard codes 
  • 008/23 (BK, MX) contains non-standard codes
  • 008/23 coded incorrectly given the presence of a print holding

Planning:

  • Obsolete tags, subfields, indicators, codes; carets & pipes

 

Jan. 17, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs13,80495.88
Holdings

  9,631

100
Items  1,578  72

Estimated number of unique tags corrected across all records to date: 12

 

Jan. 10, 2017

Estimated number of records corrected:

TypeCount% by Batch
Bibs721592
Holdings9042100
Items1578  72

 

Estimated number of unique tags corrected across all records to date: 9

Dec. 15, 2016

Estimated number of records corrected:

TypeCount% by Batch
Bibs390990
Holdings2088100
Items1578  72

Estimated number of tags corrected: 7

Dec. 9, 2016

We’ve been busy refining reports based on feedback from the units. We expect to start correcting records next week starting with two batches of bibs with an obsolete code in LDR/06. Our thanks to Judaica and Schlesinger. 

As the units report back, we’ll queue up batch corrections to records with an obsolete code in LDR/07.

We have an extensive collection of over 21,000 sparse records to tackle. We’ll be reaching out to the libraries for advice very soon.

Dec. 1, 2016

We’ve begun reaching out to the library about Phase 1 projects. Several people have weighed in on clean up strategies for bibs with problematic titles, bibs lacking a fixed field, active holdings on deleted or suppressed bibs, bibs with invalid values in LDR/06-07, and more. Feedback is coming in and we’re planning to execute corrections.

In addition, we reviewed Item Status and Item Processing Status codes and discovered they are in good shape - no invalid values exist in the database. We discovered a few that are infrequently used and reached out for advice on possibly consolidating them.

Special thanks to the Metadata Standards Working Group for their extensive work on changes to obsolete tags.  

Our sincere thanks to our advisors and collaborators!

Nov. 15, 2016

Last week, we dug deeper into active holdings on deleted/suppressed bibs. 58% are fully cataloged and 70% of holdings lack associated item records. 41% entered the database in 2002 when records were converted from NOTIS to Aleph.  None entered the database in 2003. Between 2004 and 2015, an average of 548 records per year were added. So far this year, 1,179 were added, accounting for 7.57% overall. Why? We don’t know the reason for the increase  but we can explain how to prevent the problem. When deleting or suppressing a bib, don’t forget to delete or suppress associated holdings and items.

Soon, we’ll reach out to the libraries to help us formulate a cleanup and prevention strategy.

Oct. 28, 2016

Last week, the MOP and OCLC Data Sync teams held three public meetings to present updates on both projects. The Data Sync WG also presented its preliminary recommendations. Our thanks to everyone who attended and contributed to the lively Q&A. Please continue to contribute your ideas!

The MOP team has scoped several aspects of Phase 1 projects. Summary findings for each project can be found on the Project Status page. From there, you can access individual pages for each project presenting detailed findings, including raw data. We will continue to update the new wiki pages as we progress.

Oct. 21, 2016

We have compiled a punch list of 230+ items covering a wide range of potential clean up projects including pre- and post- OCLC reclamation and pre-migration issues. The list is intended to be comprehensive but is by no means exhaustive. It continues to grow based on feedback from the HL community, OCLC, and peer institutions. We thank you for the feedback received to date and encourage you to contribute more ideas.  We welcome your input!  All ideas are valuable! Many issues will require additional analysis by LTS before they can be prioritized, but please keep them coming.