Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Next revision Both sides next revision | ||
|
batch_uploading_oais_to_oclc_and_aleph [2016/03/24 18:02] kdion |
batch_uploading_oais_to_oclc_and_aleph [2020/04/28 19:10] ldegozzaldi |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Batch Uploading OAIs from Scholarworks into OCLC and Aleph ====== | ====== Batch Uploading OAIs from Scholarworks into OCLC and Aleph ====== | ||
| + | ====== CHANGE TITLE? ETDs (Current) Processing ScholarWorks OAIs ====== | ||
| + | |||
| + | NOTE: My helpful "hints" will appear in //Italics.// | ||
| + | |||
| + | **Introduction** | ||
| + | |||
| + | The Graduate School will email "Packing Lists" dated February, May and September (end of semesters) of new dissertations, theses, MFA theses and occasionally LARP theses. There may be a lag between these dates and when the ETDs are available on ScholarWorks. //I try to process them after a couple of months have passed, to assure that they will be picked up in the Crosswalk harvest.// | ||
| + | |||
| + | **Preparation** | ||
| + | * Have a handy copy (either online or a printout) of the Packing List-in-process. **NOTE:** It's a good idea to save copies of these in appropriate folders. Example: **PackingListReport_Feb2019diss.xlsx** in [Drive]:\OAI\Dissertations\2019\ (i.e. 2019), or OAI\Theses, ThesesMFA or ThesesLARP. | ||
| + | * Open MarcEdit. (**NOTE:** Make sure your MarcEdit XSLT engine is set to SAXON.NET. On MarcEdit home page, click tools(found on top), Preferences, MARCEngine, select SAXON/NET under XSLT Engine.) | ||
| + | |||
| + | **Harvesting from ScholarWorks** | ||
| + | |||
| + | - **Click on Harvest OAI Records:** (Found on either the MarcEdit home page or under (top) tools/OAI Harvester Tools/) Set the following: | ||
| + | * Server address: https://scholarworks.umass.edu/do/oai/ | ||
| + | * Set name (for dissertations): publication:dissertations_harvesting (**IMPORTANT NOTE: Because of software changes made in 2018, Erin Jerome needs to be informed before running a Crosswalk on __dissertations only__! Before they can be pulled, they need to be transferred from "publication:dissertations_2" to a special harvesting subset.**) | ||
| + | * Set name (for theses): publication:masters_theses_2 | ||
| + | * Set name (for MFAs): publication:englmfa_theses (**NOTE:** This series is only for English MFAs; MFAs for art etc. are included in masters_theses_2.) | ||
| + | * Set name (for LARPs): publication: | ||
| + | * Metadata type: dcq (**NOTE:** This is not included in the MarcEdit drop-down, but needs to be typed in. It's a "modified" version of Dublin Core.) | ||
| + | * Crosswalk path: C:\Crosswalk\XML1\OAIDCtoMARCXMLmodified.xsl (**NOTE:** This program needs to be loaded onto your personal C: drive.) | ||
| + | * Start date (for May, in this format): 2019-06-01 | ||
| + | * End date (for May, in this format): 2019-08-31 (**NOTE:** Using August avoids Sept. lists. Occasionally these dates have to be tweaked to include everything on the appropriate Packing List.) | ||
| + | * Hit "OK" and let it run. A green bar will appear if it is working. (**NOTE** This function is a little cranky. //Recently it didn't work for me because I entered 2019-11-31 instead of 2019-11-30.// Everything has to be entered **precisely**! If no amount of tweaking resolves the issue, contact bepress (Digital Commons), which occasionally blocks ScholarWorks harvesting for security purposes, Erin Jerome or Aaron Rubinstein.) | ||
| + | * Once the harvesting is finished, a MarcEdit list will open up, containing the harvested records in raw form. //I will save this immediately into the appropriate OAI folder, as (example) **umdissertations_sept.mrk**// | ||
| + | |||
| + | - **Check harvested records against Grad School's packing list** | ||
| + | * Hint: In MarcEdit, click Edit/Find/enter =100 in "Find what" window/click Find All. This will produce a list that can be saved to the clipboard, and copied into Excel or another program. (**NOTE:** When working in MarcEdit, click File/Save after **every change**!! Do NOT Save if no changes are made.) | ||
| + | * **IMPORTANT NEW STEP, added 2020:**Go to ScholarWorks/Dissertations and Theses and log onto "My account", scroll down to the appropriate series (i.e., DOCTORAL DISSERTATIONS (dissertations_2)/Manage Dissertations/Batch revise Excel ((see [[http://www.library.umass.edu/wikis/acp/doku.php?id=oai_harvesting_via_marcedit|OAI Harvesting Via MarcEdit]] ): Delete from the harvested list any names/records which are not on the packing list | ||
| + | Note any names, MFA or otherwise, from packing list missing in harvested records. (e.g., MFA theses are a different Scholarworks harvest and are done separately.) | ||
| + | |||
| Once our dissertations and theses are OAI harvested from Digital Commons (BePress) via MarcEdit then run through MarcEdit's Task list before being uploaded to Connexion, the bib records are ready to be batch uploaded to OCLC then batch exported to Aleph. | Once our dissertations and theses are OAI harvested from Digital Commons (BePress) via MarcEdit then run through MarcEdit's Task list before being uploaded to Connexion, the bib records are ready to be batch uploaded to OCLC then batch exported to Aleph. | ||
| Line 5: | Line 37: | ||
| **To upload from Connexion to OCLC:** | **To upload from Connexion to OCLC:** | ||
| - | After importing the bib records file from MarcEdit (see [[http://www.library.umass.edu/wikis/acp/doku.php?id=oai_harvesting_via_marcedit|OAI Harvesting Via MarcEdit]] ): | + | After importing the bib records file from MarcEdit |
| (For example purposes, we will use the Connexion file for February 2016 Dissertations which can be opened via CatalogingSearchLocalSaveFile -> <nowiki>T:\\oclcapps\Connexion\Theses\2016_Feb_Dissertations.bib.db)</nowiki>) | (For example purposes, we will use the Connexion file for February 2016 Dissertations which can be opened via CatalogingSearchLocalSaveFile -> <nowiki>T:\\oclcapps\Connexion\Theses\2016_Feb_Dissertations.bib.db)</nowiki>) | ||
| Line 14: | Line 46: | ||
| **To export from Connexion to Aleph:** | **To export from Connexion to Aleph:** | ||
| - | * Go to Tools -> Options and click on the Export tab. Highlight the __Prompt for filename__ option then click on Apply then Close. | + | * Go to Tools -> Options and click on the Export tab. Highlight the __Prompt for filename__ option then check off the box for Display report for immediate export results. Click on Apply then Close. |
| * Open the Local Save file you want to export (2016_Feb_Dissertations - See path above) | * Open the Local Save file you want to export (2016_Feb_Dissertations - See path above) | ||
| * Highlight records | * Highlight records | ||
| * Export (Action - Export or F5) | * Export (Action - Export or F5) | ||
| - | This will ask where to put the output file in your C: drive and what name to use. Make sure the filename is in all lower case - for example, feb2016diss. The file will be downloaded into your C: drive as a .dat file. (You will NOT be notified when the export is finished. Be careful not to Export more than once.) | + | This will ask where to put the output file in your C: drive and what name to use. Make sure the filename is in all __lower case__ - for example, feb2016diss. The file will be downloaded into your C: drive as a .dat file. (Example: C:\Crosswalk\Dissertation&Theses\Connexion_Records\feb2016diss.dat) |
| - | * Open MARCTools | + | * Open MARCTools in MarcEdit. |
| * Input the .dat file from your C: drive (feb2016diss.dat)and name the Output file with a .mb extension (feb2016diss.mb. Execute the MarcBreaker. | * Input the .dat file from your C: drive (feb2016diss.dat)and name the Output file with a .mb extension (feb2016diss.mb. Execute the MarcBreaker. | ||
| - | * Click on Edit Records. Use Replace to change AUMM to AUMEDT. | + | * Click on Edit Records. Use Replace to change AUMM to AUMETD. |
| * Under MARCEditor --> File, click on Compile File into Marc. This will save as a .mrc (MARC) file. | * Under MARCEditor --> File, click on Compile File into Marc. This will save as a .mrc (MARC) file. | ||
| | | ||
| Line 31: | Line 63: | ||
| Make sure the following rules are set: | Make sure the following rules are set: | ||
| * Input File name (for this example, feb2016diss.mrc) | * Input File name (for this example, feb2016diss.mrc) | ||
| - | * Default Holding - AUMEDT | + | * Default Holding - AUMETD |
| * Character Conversion - OCLC_UTF_TO_UTF | * Character Conversion - OCLC_UTF_TO_UTF | ||
| * Fix Routine - UMFIX | * Fix Routine - UMFIX | ||
