OCLC Bibliographic Data Sync processing - collection configuration, test files and report output
Overview - Data Sync collectionsÂ
For each symbol files will be exported for four Data Sync collections: Manuscript, Reproduction, No trusted OCN, Trusted OCN.Â
Data Sync Collection | Alma criteria (suppressed and provisional holdings excluded) | Data Sync Matching | Notes |
---|---|---|---|
Manuscript | (LDR/06 = d or f or t ) OR (LDR/08 = a) OR (040 $e = amim or appm or dacs or dcrmg or dcrmm or dcrmmss) | Trusted partner matching. Bibs in this file are eligible to replace matching master record in WorldCat. | Manuscript collection excludes reproductions. Holdings may or may not have 079, or vernacular |
Reproduction (matching OCN loaded to holding only) | 843 $a contains Microfilm or Microfiche | All matching but limited to English language of cataloging only. Bibs in this file are eligible to enhance existing master records in WorldCat. | Reproduction collection excludes manuscripts. Holdings may or may not have 079, or vernacular. |
843 $a contains Electronic reproduction OR 856 is present | |||
No trusted OCN | (no 079 field) AND (no 880 field) | All matching but English language of cataloging only. Bibs in this file are eligible to enhance existing master records in WorldCat. | No Trusted OCN means holdings have not been sent to OCLC previously. Collection excludes manuscripts and reproductions. |
(no 079 field) | |||
Trusted OCN | 079 field | OCN match only. No validation, no enhancement of master records. | Holding has been sent to OCLC before. Sent to Data Sync with OCN from 079 only. Excludes manuscripts and reproductions. |
Bibliographic Data Sync Processing Log - Reclamation
Symbol | Data Sync Collection | Sent / Processed / Staging | Match / Add |
---|---|---|---|
3/12/20 | Reproduction - microform | 12104 / 12083 / 20 | 9138 / 2945 |
Reproduction - electronic | 179 / 178 / 1 | 13 / 165 | |
No trusted OCN | 9170 / 8940 / 229 | 7890 / 1050 | |
No trusted OCN - vernacular | 32 / 31 / 1 | 31 / 0 | |
Trusted OCN | 99997 / 99996 / None 39893 / Â 39892 / None | All matched | |
Manuscript | 66 / 62 / 4 | 49 / 13 | |
Collected Bib Detail Error reports HTV (Excel) Scan / Delete report (Excel) | |||
Fine Arts (HFL) 4/23/20 | Trusted OCN | 429547 / 429533 / 3 | All matched |
No trusted OCN | 37659 / 35838 / 1819 | 31316 / 4522 | |
No trusted OCN - vernacular | 3933 / 3854 / 77 | 3269 / 585 | |
Reproduction - microform | 5022 / 5017 / 5 | 4854 / 163 | |
Manuscript | 256 / | ||
Collected Bib Detail Error reports HFL (Excel) Scan / Delete report (Excel) | |||
5/27/20 | Trusted OCN | 195290 / 195260 | All matched |
No trusted OCN | 4794 / 4667 / 127 | 3920 / 747 | |
No trusted OCN - vernacular | 22 / 22 / 0 | 20 / 2 | |
Reproduction - microform | 222 / 222 / 0 | 174 / 48 | |
Reproduction - electronic | 519 / 519 / 0 | 501 / 18 | |
Collected Bib Detail Error reports (Excel) Scan / Delete report (Excel) | |||
6/2/20 | Trusted OCN | 44235 / 44231 | All matched |
No trusted OCN | 1797 / 1796 / 1 | 1653 / 153 | |
No trusted OCN - vernacular | 31 / 31 / 0 | 30 / 1 | |
Reproduction - microform | 54 / 54 / 0 | 38 / 16 | |
Collected Bib Detail Error reports HCH (Excel) Scan / Delete report (Excel) | |||
6/15/20 | Trusted OCN | 163919 / 163864 / 18 | All matched |
No trusted OCN | 14584 / 14526 / 58 | 12556 / 1970 | |
No trusted OCN - vernacular | 933 / 932 / 1 | 852 / 80 | |
Reproduction - microform | 383 / 382 / 1 | 258 / 124 | |
Reproduction - electronic | 17 / 17 / 0 | 3 / 14 | |
Manuscript | 129 / | ||
6/19/20 | Trusted OCN | 389569 / 389524 / 37 | All matched |
No trusted OCN | 17864 / 17822 / 41 | 15551 / 2271 | |
No trusted OCN - vernacular | 56 / 56 / 0 | 51 / 5 | |
Reproduction - microform | 45142 / 45054 / 88 | 29789 / 15265 | |
Manuscript | 316 / | ||
Collected Bib Detail Error reports (Excel) | |||
Scan / Delete report (Excel) | |||
7/5/20 | Trusted OCN | 182094 / 182068 / 1 | All matched |
No trusted OCN | 6996 / 6632 / 364 | 5274 / 1358 | |
No trusted OCN - vernacular | 26 / 26 / 0 | 26 / 0 | |
Reproduction - microform | 11954 / 11925 / 29 | 6330 / 5595 | |
Collected Bib Detail Error reports (Excel) Scan / Delete report (Excel) | |||
7/23/20 | Trusted OCN | 47254 / 47254 / 0 | All matched |
No trusted OCN | 3175 / 3163 / 12 | 2062 / 101 | |
No trusted OCN - vernacular | 26 / 26 / 0 | 26 / 0 | |
Reproduction - microform | 1 / 1 / 0 | 1 / 0 | |
Collected Bib Detail Error reports (Excel) Scan / Delete report (Excel) | |||
7/28/20 | Trusted OCN | 238486 / 238382 / 1 | All matched |
No trusted OCN | 27499 / 27491 / 8 | 2107 / 6484 | |
No trusted OCN - vernacular | 32 / 32 / 0 | 31 / 1 | |
Reproduction - microform | 70367 / 70361 / 6 | 68850 / 1511 | |
Reproduction - electronic | 1 / 1 / 0 | 1 / 0 | |
Collected Bib Detail Error reports (Excel) Scan / Delete report (Excel) | |||
8/2/20 | Trusted OCN | 378785 / 378748 / 1 | All matched |
No trusted OCN | 4700 / 4679 / 21 | 4519 / 160 | |
No trusted OCN - vernacular | 105 / 105 / 0 | 104 / 1 | |
Reproduction - microform | 9124 / 9122 / 2 | 8692 / 430 | |
Reproduction - electronic | 1 / 1 / 0 | ||
Manuscript | |||
8/26/20 | Trusted OCN | 913096 / 913052 / 1 | All matched |
No trusted OCN | 7115 / 7093 / 22 | 6864 / 251 | |
No trusted OCN - vernacular | 62766 / 62252 / 502 | 59648 / 2604 | |
Reproduction - microform | 23416 / 23409 / 7 | 22130 / 1279 | |
Reproduction - electronic | 6 / 3 / 3 | 2 / 1 | |
Scan / Delete | |||
Collected Bib Detail Error reports (Excel) | |||
8/27/20 | Trusted OCN | 0 | |
No trusted OCN | 237 / 237 / 0 | 167 / 70 | |
No trusted OCN - vernacular | 1 / 1 / 0 | 1 / 0 | |
Reproduction - microform | 174154 / 174079 / 74 | 164997 / 9082 | |
Collected Bib Detail Error reports (Excel) | |||
9/8/20 | Trusted OCN | 6617470 / 6616126 / 16 | All matched |
No trusted OCN | 365176 / 362525 / 2584 | 311762 / 50763 | |
No trusted OCN - vernacular | 74608 / 72865 / 1735 | 44951 / 27914 | |
Reproduction - microform | 9541 / 9536 / 5 | 9263 / 273 | |
Reproduction - electronic | 4932 / 4911 / 21 | 4508 / 403 | |
Scan / Delete (WID, MIC, MAP, LAM, DOC, FUN + Dept. libraries) | |||
Collected Bib Detail Error reports (Excel) | |||
AFR, CEL, CHI, DOC, FUN, GIB, HIS, HSL, LAM, LIN, NEL, PAL, PHI, SAN, SMY, URI (HUL) 9/8/20 | Trusted OCN | 271641 / 271591 / | All matched |
No trusted OCN | 103682 / 103561 / 115 | 100855 / 2706 | |
No trusted OCN - vernacular | 2332 / 2326 / 6 | 2269 / 57 | |
Reproduction - microform | 196 / 196 / 0 | 196 / 0 | |
Reproduction - electronic | 5 / 5 / 0 | 4 / 1 | |
Collected Bib Detail Error reports (Excel) | |||
(HUL) 9/8/20 | Trusted OCN | 0 | |
Reproduction - microform | 307700 / 307534 / 165 | 300849 / 6685 | |
Collected Bib Detail Error reports (Excel) | |||
9/8/20 | Trusted OCN | 59018 / 59018 / 0 | All matched |
No trusted OCN | 3946 / 3898 / 47 | 3417 / 481 | |
No trusted OCN - vernacular | 208 / 152 / 56 | 109 / 43 | |
Reproduction - microform | 5 / 5 / 0 | 5 / 0 | |
Reproduction - electronic | 10 / 10 / 0 | 2 / 8 | |
Collected Bib Detail Error reports (Excel) | |||
Harvard Film Archive (HUL) 10/6/20 | Trusted OCN | 27736 / 27736 | All matched |
No trusted OCN | 193 | 140/53 | |
No trusted OCN - vernacular | 1 | 1/0 | |
Reproduction - electronic | 19 | 19/0 | |
Scan / Delete - none | |||
Collected Bib Detail Error reports (Excel) | |||
Frances Loeb Library (HUL) 10/21/20 | Trusted OCN | 240390 / 240375 / 1 | All matched |
No trusted OCN | 6766 / 6737 / 26 | 6592 / 145 | |
No trusted OCN - vernacular | 63 / 61 / 1 | 55 / 6 | |
Reproduction - microform | 3150 / 3147 / 3 | 3117 / 31 | |
Reproduction - electronic | 0 | ||
Scan / Delete report (Excel) | |||
Collected Bib Detail Error reports (Excel) | |||
Law School (HVL) 11/3/20 | Trusted OCN | 998021 / 998006 / 13 | All matched |
No trusted OCN | 66190 / 66001 / 180 | 63141 / 2860 | |
No trusted OCN - vernacular | 12457 / 12311 / 144 | 10815 / 1496 | |
Reproduction - microform | 39215 / 39207 / 8 | 34454 / 4754 | |
Reproduction - electronic | 4 / 4 / 0 | 4 / 0 | |
Manuscript | |||
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Tozzer, Peabody Museum (HUL) 11/18/20 | Trusted OCN | 165743 / 165743 / | All matched |
No trusted OCN | 7728 / 7719 / 7 | 7244 / 475 | |
No trusted OCN - vernacular | 108 / 108 / 0 | 104 / 4 | |
Reproduction - microform | 5040 / 5010 / 30 | 2040 / 2970 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Loeb Music (HUL) 11/27/20 | Trusted OCN | 291702 / 291689 / 2 | All matched |
No trusted OCN | 13992 / 13965 / 20 | 13434 / 531 | |
No trusted OCN - vernacular | 416 / 413 / 3 | 386 / 28 | |
Reproduction - microform | 18162 / 18123 / 39 | 14994 / 3129 | |
Scan / Delete report (Excel) | |||
Collected Bib Detail Error reports (Excel) | |||
Harvard Art Museums, Straus Center for Conservation (MHUAM) 11/30/20 | Trusted OCN | 2878 / 2878 / 0 | All matched |
No trusted OCN | 93 / 91 / 2 | 79 / 12 | |
No trusted OCN - vernacular | 1 / 1 / 0 | 1 / 0 | |
Reproduction - microform | 0 | ||
Reproduction - electronic | 1 / 1 / 0 | 1 / 0 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
BIR, ENV, HSI, PHY, WOL *H (HUL) 12/17/20 | Trusted OCN | 35130 / 35130 / 0 | All matched |
No trusted OCN | 1207 / 1195 / 11 | 1114 / 81 | |
No trusted OCN - vernacular | 9 / 9 / 0 | 7 / 2 | |
Reproduction - microform | 1204 / 1203 / 1 | 340 / 863 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Smithsonian Astrophysics (WOL *S) (SQD) 12/17/20 | Trusted OCN | 19849 / 19849 / 0 | All matched |
No trusted OCN | 406 / 405 / 1 | 391 / 14 | |
No trusted OCN - vernacular | 1 / 1 / 0 | 1 / 0 | |
Reproduction - microform | 80 / 79 / 1 | 42 / 37 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Schlesinger (HUL) 2/11/21 | Trusted OCN | 122758 / 122757 / 1 | All matched |
No trusted OCN | 12374 / 12347 / 27 | 11013 / 1334 | |
Reproduction - microform | 9850 / 9802 / 47 | 9006 / 796 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Ernst Mayr (HMZ) 2/19/21 | Trusted OCN | 156194 / 156194 / 0 | All matched |
No trusted OCN | 3847 / 3812 / 35 | 2493 / 1319 | |
Reproduction - microform | 1993 / 1947 / 46 | 616 / 1331 | |
Reproduction - electronic | 14 / 13 / 1 | 8 / 5 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Botany Libraries  (ARN, AJP, ORC, ARG, ECB, FAR, GRA, FOR) (HMZ) 3/2/2021 | Trusted OCN | 202549 / 202549 / 0 | All matched |
Reproduction - electronic | 6 / 6 / 0 | 3 / 3 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Archives (HUL) 3/10/2021 | Trusted OCN | 89535 / 89534 / 1 | All matched |
No trusted OCN | 1496 / 1407 / 89 | 1045 / 362 | |
Reproduction - microform | 85 / 66 / 19 | 20 / 46 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Houghton, Poetry and Theatre (HOU, POE, THE) (HUL) 3/15/2021 | Trusted OCN | 516611 / 516336 / 3 | All matched |
No trusted OCN | 22548 / 22394 / 154 | 13647 / 8747 | |
Reproduction - microform | 8022 / 7881 / 141 | 2711 / 5170 | |
Scan / Delete report | |||
Collected Bib Detail Error reports (Excel) | |||
Networked Resources (NET) (HUL) | Reproduction - electronic | 92993 / 89363 / 3630 | 53391 / 35972 |
Collected Bib Detail Error reports (Excel) |
Bibliographic Data Sync Processing Log - Test Files
Symbol | Data Sync Collection | Sent/ Processed/ Rejected | Error detail report | Review document | Status |
---|---|---|---|---|---|
HTV | Manuscript | 22 / 20 / 2 | metacoll.SYS.datasync.1034251.D20191225.bibdetailexcpt.1.txt | BER manuscripts test file 20191220 - review HU and OCLC | On hold while OCLC investigates bibs that did not match. |
HTV | Reproductions - Microform | 26 / 26 / 0 | None | BER MFRM holdings data | Complete |
HTV | Reproductions - Electronic | 15 / 15 / 0 | None | BER CDROM holdings data | Complete |
HTV | No trusted OCN | 40 / 31 / 9 | metacoll.SYS.datasync.1034633.D20200211.T214059000.bibdetailexcpt.1.mrc.txt | Bibs that lack a trusted OCN | Complete |
HTV | No trusted OCN - vernacular | 29 / 29 / 0 | None | Bibs that lack a trusted OCN - vernacular | Complete |
HTV | Trusted OCN | 7 / 7 / 0 | None | Bibs with trusted OCN | Complete. |
Data Sync enhancements - June 25, 2020 | |||||
HTV | Manuscript | 22 / 20 / 2 |
Error report details
OCLC documentation on validation errors, sparse records and unresolved records:Â https://help.oclc.org/Metadata_Services/WorldShare_Collection_Manager/Understand_record_processing/Data_sync_processing
Data Sync Exception Description | Bib Validation Error | Example--DRAFT | Resolution by norm rule – DRAFT | Resolution by analysis – DRAFT |
$a in 245 occurs too many times. | Severe | If $a are identical, remove second If $a are different, flag | Agree/KCY | |
Date1/Beginning Date of Publication (008/07-10) is too short. | Severe | Pull from 26X? | Agree/KCY | |
Date2/Ending Date of Publication (008/11-14) is too short. | Severe | Pull from 26X? Could be more difficult. Or make a rule to read the century of a date in the 26X to autocorrect the 008/11-14 | Agree/KCY | |
Invalid code in 1st $a in 1st 041. | Severe | Rule to correct common errors, but otherwise >> | Analysis required. Is there a default language code we could use? ZXX? | |
Invalid relationship - when Form of Item (008/23) is equal to d, then Type of Record (Leader/06) must not be equal to j. | Severe | 008/23 d = large print; LDR/06 j = musical sound recording | Which takes precedent? Change the other | LDR/06=j cannot exist with Form of Item (008/23) =d (see OCLC documentation https://www.oclc.org/bibformats/en/fixedfield/type.html/KCY |
Invalid relationship - when Type of Date/Publication Status (008/06) is equal to c, then Bibliographic Level (Leader/07) must not be equal to m. | Severe | 008/06 c = Continuing resource currently published; LDR/07 m = monograph item | Which takes precedent? Change the other | If 008/06=c, change LDR/07= s /KCY |
Invalid relationship - when Type of Date/Publication Status (008/06) is equal to k, then Bibliographic Level (Leader/07) must not be equal to m. | Severe | 008/06 k = Range of years of bulk of collection; LDR/07 m = monograph item | Which takes precedent? Change the other | If 008/06=k, change LDR 07= c /KCY |
Invalid relationship - when Type of Date/Publication Status (008/06) is equal to m, then Bibliographic Level (Leader/07) must not be equal to s. | Severe | Why is this wrong? 008/06 m = multiple dates; LDR/07 s = serial | 008/06=m (computer file), agree, why is LDR/07 not s? | |
Invalid relationship - when Type of Date/Publication Status (008/06) is equal to s, then Bibliographic Level (Leader/07) must not be equal to s. | Severe | 990118026470203941 | Change Leader/07 to 'a' | Agree/KCY |
Invalid subfield 1st $c in 1st 505. | Severe | Should this be read as: If 1st subfield in 1st 505=c? If yes, then change to $a (??) /KCY | Changeable by norm rule, but to what? | Can we see some examples |
Invalid subfield 1st $d in 1st 260. | Severe | Should this be read as: If 1st subfield in 1st 260=d? If yes, then change to $c (??)/KCY | Changeable by norm rule, but to what? | Can we see some examples |
Invalid subfield 1st $d in 1st 510. | Severe | Should this be read as: If 1st subfield in 1st 510=d? If yes, then change to $b(???)/KCY | Changeable by norm rule, but to what? | Can we see some examples |
Invalid tag 779. | Severe | Just remove? | Agree/KCY | |
1st $6 in 1st 504 is too long. | Critical | $6 is valid, but maybe just remove??? $6=system supplied. do NOT add per documentation https://www.oclc.org/bibformats/en/5xx/504.html | Changeable by norm rule, but to what? | |
Invalid code in 1st $e in 1st 040. | Critical | If 'RDA' is entered with typo, list how to flip back to 'RDA' | Agree/KCY | |
Sparse Check failed. Sparse record | Critical | Here we want to break these out with sample error messages we'd like from OCLC. Look at this spreadsheet for examples: https://docs.google.com/spreadsheets/d/1odQhJlPc4qS6ForJMaEmVgHs4QIbQU_n6i0CAXVAX9U/edit#gid=777684637 |