Ke emu
This presentation is the property of its rightful owner.
Sponsored Links
1 / 73

KE EMu PowerPoint PPT Presentation


  • 163 Views
  • Uploaded on
  • Presentation posted in: General

KE EMu. at. the. Peabody Museum of Natural History. The four YPM buildings. Peabody (YPM). Environmental Science Center (ESC). Geology / Geophysics (KGL). 175 Whitney (Anthropology). Confluence of YPM, KGL, ESC. ESC. KGL. YPM.

Download Presentation

KE EMu

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


KE EMu

at

the

Peabody Museum of Natural History


The four YPM buildings

Peabody

(YPM)

Environmental

Science Center

(ESC)

Geology / Geophysics

(KGL)

175 Whitney

(Anthropology)


Confluence of YPM, KGL, ESC

ESC

KGL

YPM


Peabody CollectionsCounts & Functional Cataloguing Unit

  • Anthropology 325,000Lot

  • Botany 350,000Individual

  • Entomology1,000,000Individual

  • Invertebrate Paleontology 300,000Lot

  • Invertebrate Zoology 300,000Lot

  • Mineralogy 35,000Individual

  • Paleobotany 150,000Individual

  • Scientific Instruments 2,000Individual

  • Vertebrate Paleontology 125,000Individual

  • Vertebrate Zoology 185,000Lot / Individual

    2.7 million functional units => ~11 million items


Peabody CollectionsFunctional Units Databased

  • Anthropology 325,000 90 %

  • Botany 350,000 1 %

  • Entomology1,000,000 1 %

  • Invertebrate Paleontology 300,000 55 %

  • Invertebrate Zoology 300,000 20 %

  • Mineralogy 35,000 85 %

  • Paleobotany 150,000 60 %

  • Scientific Instruments 2,000100 %

  • Vertebrate Paleontology 125,000 60 %

  • Vertebrate Zoology 185,000 95 %

    930,000 of 2.7 million => 35 % overall


VZ

Kristof Zyskowski

(Vert. Zool. - ESC)

Greg Watkins-Colwell

(Vert. Zool. - ESC)


HSI

Shae Trewin

(Scientific Instruments – KGL )


VP

Mary Ann Turner

(Vert. Paleo. – KGL / YPM)


ANT

Maureen DaRos

(Anthro. - YPM / 175 Whitney)


EMu Planning

2002Collections Computerization Committee deliberations

2003 Q2on-site demonstrations from CM vendors

2003 Q3+talk with existing clients of CM vendors


EMu Planning

2002Collections Computerization Committee deliberations

2003 Q2on-site demonstrations from CM vendors

2003 Q3+talk with existing clients of CM vendors

Lots of other folks…


Classic Argus


Old to the New

Argus ModuleEMu Module

ObjectCatalogue

ObjectConservation

ObjectInternal Movements

LexiconTaxonomy

ActivityAccession Lots

ActivityLoans

SiteCollecting Events

SiteSite

ConstituentParties

PublicationBibliography


Prior Argus Experience

Single CMS shared by all Departments

for about a decade - YPM staff cohabiting

internally and realizing commonalities

- streamlined system administration

- ease strain of future migration path


EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines

1.5 years total


EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines


Local Emu web site


19 trainees

EMu training session


Even with best intentions the ‘EMu Big Picture’ can remain a bit fuzzy…


Clarity…

Ian Turnbull

Negar Samenirad


EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines

06/2005Safe to jump into the water…


Specimens

EMu Users Groupa.k.a. Weekly Therapy- started meetings at go-live- topic du jour as a kick off- then open season on issues - driven by users' experiences


Some Miscellaneous Statistics

  • 1,200,000 Argus records => 2,100,000 EMu records

  • 3 days for Argus server to spit out the final migration files

  • 12 days for EMu server to ingest the final migration files

  • held a final migration “race” between the KE & YPM servers

  • lost few weeks to Vancouver server hiccups, office move, etc.


operating in Emu - IZ

Chomping at the bit…

Invertebrate

Zoology

Lourdes Rojas

Eric Lazo-Wasem

Dan Drew


operating in Emu - IZ

partitioning backlogged

multi-species samples…


operating in Emu - IZ

Site record for lot


operating in Emu - IZ

RTF label

Site record for lot


operating in Emu - IZ

RTF label

Site record for lot

Datamax I-4406 (thermal)


operating in Emu - IZ

RTF label

Site record for lot

Datamax I-4406 (thermal)

…label(s) into jar


Excerpts from YPM Modules

Catalogue - adjustments for speed

Taxonomy - Lexicon tab


Catalogue ANT


Catalogue HSI


Catalogue IZ


DET – IZ4

Yowza ! An identification updater is coming to EMu !

Cloned the grid elements for:

"Current" Identification

"Filed Asth" Identification

into additional, separate fields


Tax – higher


Tax - lex


Tax – lex expand1


Tax – lex expand2


Tax – lex expand2

- levels of children to display is regulated by a registry entry

- assigning the parent sets the full path back up the tree

- optional viewing mechanism grafted onto the base module

PRINCIPLE #1 = LEAVE EXTANT MODULE INTACT !


taxontree1


taxontree2


taxontree2

Other external resources?

Drag and drop reparenting?

Alternate classifications?

Autopopulating Luts fields?


Backend Script Tinkering= Creative Destruction

JPEG 2000 and EMu - protem freeware fix

Admin Module - the proverbial black box


http://www.jpeg.org/jpeg2000

non-proprietary standard

mathematically lossless

lossy (much smaller files)

"perceptually" lossless

desktop sofwtare emerging


http://www.fnordware.com/j2k


JP2 spicebush


JP2 spicebush with J2K


JP2 spicebush with J2K and tail target


JP2 spicebush tails with file sizes

1.54 mB 15 kB


JP2 spicebush tails with moral

lossless JP2 => circa 30-40% original TIFF size

lossy JP2=> go to circa 1%-5%, depending on purpose


Reed Beaman1, Nico Cellinese1,

Bryan Heidorn2, Ashley Green1, Youjun Guo1,

Michael Donoghue1, Barbara Thiers3,

Heather Rolan3 & Melissa Tulig3

1Peabody Museum of Natural History,

Yale University

2Graduate School of Library and Information Science,

University of Illinois at Urbana-Champaign

1The New York Botanical Garden

Funded by the US National Science Foundation


Digital Darkroom

  • TTI 30 x 40 inch vacuum easel copy stand

  • UV free, minimal IR lighting

  • Hardware colorimetric calibration

  • Apple G5 workstation

  • 3.2 Tbytes RAID storage and tape library backup

  • Pipeline to image processing web services

Lynn Jones (Botany)


261 kb

1,302 kb

5,166 kb

62,640 kb


JP2 - without

oops… no thumbnail


JP2 - coding

find imagedir –name *.jp2 –mtime -2 –print

loop on the matches and test to see which recently

loaded JP2 files are missing a thumbnail JPG,

or which JP2 files have been modified more

recently than their existing thumbnail JPG ; then

build filenames for any qualifying target JPGs ;

execute script several times per hour from cron

jasper –f match –F tempfile

convert tempfile –resize 90x90 target


JP2 - without


JP2 - with


Ask your EMu server what it might prefer

JP2 – size matters

a hefty TIFF… or a ballet of tiny JP2s ?


Scripting a data load


Scripting a data load

Save to simple text format


Scripting a data load

Save to simple text format

Script to convert

to Texpress input


Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Script to convert

for Texpress


Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Texpress grammar file

Script to convert

for Texpress


Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Texpress grammar file

Script to convert

for Texpress


Admin

Send output to location of your choice (e.g., Admin Results window)


Admin

Send output to location of your choice (e.g., Admin Results window)

texload -ch -ddatafile-ggrammarfile ecatalogue

texload -as -ddatafile-ggrammarfile ecatalogue


Local catalog service


Ornis


Paleoportal


Cope and labels

Cope MacClintock

(Inv. Paleo.)


Cope chopping

another Happy Camper


finis


  • Login