Metadata Optimization Project - Weekly Update
Feb. 17, 2017
Estimated number of Aleph records corrected:
Type | Count | % by Batch |
Bibliographic | 30,595 | 97.29 |
Holding | 9,343 | 99.71 |
Item | 1,439 | 67.60 |
Orders | 1033 | 96 |
Estimated number of unique tags corrected across all records to date: 20
Feb. 14, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 21,471 | 95.69 |
Holdings | 9,339 | 99.75 |
Items | 1,439 | 67.60 |
Orders | 1033 | 96 |
Estimated number of unique tags corrected across all records to date: 20
In the works:
Scoping:
- LDR/06-07 Invalid combinations by format
- 008/21 (MU) contains non-standard codes
- 008/23 (BK, MX) contains non-standard codes
- 008/23 coded incorrectly given the presence of a print holding
Planning:
- Invalid/discontinued Language codes
- Obsolete tags, subfields, indicators, codes; carets & pipes
- Arranging outsourced remediation: 16,400 CJK bibs with paired field errors; 914 bibs with 008 <> 40 characters; 788 bibs with 245 miscoded or missing
Feb. 10, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 16,316 | 95.69 |
Holdings | 9,339 | 99.75 |
Items | 1,439 | 67.60 |
Orders | 1033 | 96 |
Estimated number of unique tags corrected across all records to date: 17
In the works:
Scoping:
- LDR/06-07 Invalid combinations by format
- 008/21 (MU) contains non-standard codes
- 008/23 (BK, MX) contains non-standard codes
- 008/23 coded incorrectly given the presence of a print holding
Planning:
- Invalid/discontinued Language codes
- Obsolete tags, subfields, indicators, codes; carets & pipes
- Arranging outsourced remediation: 16,400 CJK bibs with paired field errors; 914 bibs with 008 <> 40 characters; 788 bibs with 245 miscoded or missing
Feb. 3, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 16,316 | 95.69 |
Holdings | 9,339 | 99.75 |
Items/orders | 1,439 | 67.60 |
Estimated number of unique tags corrected across all records to date: 15
In the works:
Scoping:
- LDR/06-07 Invalid combinations by format
- 008/21 (MU) contains non-standard codes
- 008/23 (BK, MX) contains non-standard codes
- 008/23 coded incorrectly given the presence of a print holding
Planning:
- Invalid/discontinued Language codes
- Obsolete tags, subfields, indicators, codes; carets & pipes
Jan. 26, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 16,054 | 95.62 |
Holdings | 9,251 | 99.91 |
Items/orders | 1,398 | 68.81 |
Estimated number of unique tags corrected across all records to date: 14
In the works:
Corrections pending: LDR/06 with obsolete b - Middle Eastern Div. Deleted/suppressed bibs with active holdings - SCH
Scoping:
- LDR/06-07 Invalid combinations by format
- 008/21 (MU) contains non-standard codes
- 008/23 (BK, MX) contains non-standard codes
- 008/23 coded incorrectly given the presence of a print holding
Planning:
- Obsolete tags, subfields, indicators, codes; carets & pipes
Jan. 17, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 13,804 | 95.88 |
Holdings | 9,631 | 100 |
Items | 1,578 | 72 |
Estimated number of unique tags corrected across all records to date: 12
Jan. 10, 2017
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 7215 | 92 |
Holdings | 9042 | 100 |
Items | 1578 | 72 |
Estimated number of unique tags corrected across all records to date: 9
Dec. 15, 2016
Estimated number of records corrected:
Type | Count | % by Batch |
Bibs | 3909 | 90 |
Holdings | 2088 | 100 |
Items | 1578 | 72 |
Estimated number of tags corrected: 7
Dec. 9, 2016
We’ve been busy refining reports based on feedback from the units. We expect to start correcting records next week starting with two batches of bibs with an obsolete code in LDR/06. Our thanks to Judaica and Schlesinger.
As the units report back, we’ll queue up batch corrections to records with an obsolete code in LDR/07.
We have an extensive collection of over 21,000 sparse records to tackle. We’ll be reaching out to the libraries for advice very soon.
Dec. 1, 2016
We’ve begun reaching out to the library about Phase 1 projects. Several people have weighed in on clean up strategies for bibs with problematic titles, bibs lacking a fixed field, active holdings on deleted or suppressed bibs, bibs with invalid values in LDR/06-07, and more. Feedback is coming in and we’re planning to execute corrections.
In addition, we reviewed Item Status and Item Processing Status codes and discovered they are in good shape - no invalid values exist in the database. We discovered a few that are infrequently used and reached out for advice on possibly consolidating them.
Special thanks to the Metadata Standards Working Group for their extensive work on changes to obsolete tags.
Our sincere thanks to our advisors and collaborators!
Nov. 15, 2016
Last week, we dug deeper into active holdings on deleted/suppressed bibs. 58% are fully cataloged and 70% of holdings lack associated item records. 41% entered the database in 2002 when records were converted from NOTIS to Aleph. None entered the database in 2003. Between 2004 and 2015, an average of 548 records per year were added. So far this year, 1,179 were added, accounting for 7.57% overall. Why? We don’t know the reason for the increase but we can explain how to prevent the problem. When deleting or suppressing a bib, don’t forget to delete or suppress associated holdings and items.
Soon, we’ll reach out to the libraries to help us formulate a cleanup and prevention strategy.
Oct. 28, 2016
Last week, the MOP and OCLC Data Sync teams held three public meetings to present updates on both projects. The Data Sync WG also presented its preliminary recommendations. Our thanks to everyone who attended and contributed to the lively Q&A. Please continue to contribute your ideas!
The MOP team has scoped several aspects of Phase 1 projects. Summary findings for each project can be found on the Project Status page. From there, you can access individual pages for each project presenting detailed findings, including raw data. We will continue to update the new wiki pages as we progress.
Oct. 21, 2016
We have compiled a punch list of 230+ items covering a wide range of potential clean up projects including pre- and post- OCLC reclamation and pre-migration issues. The list is intended to be comprehensive but is by no means exhaustive. It continues to grow based on feedback from the HL community, OCLC, and peer institutions. We thank you for the feedback received to date and encourage you to contribute more ideas. We welcome your input! All ideas are valuable! Many issues will require additional analysis by LTS before they can be prioritized, but please keep them coming.