Ke emu
This presentation is the property of its rightful owner.
Sponsored Links
1 / 73

KE EMu PowerPoint PPT Presentation


  • 127 Views
  • Uploaded on
  • Presentation posted in: General

KE EMu. at. the. Peabody Museum of Natural History. The four YPM buildings. Peabody (YPM). Environmental Science Center (ESC). Geology / Geophysics (KGL). 175 Whitney (Anthropology). Confluence of YPM, KGL, ESC. ESC. KGL. YPM.

Download Presentation

KE EMu

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Ke emu

KE EMu

at

the

Peabody Museum of Natural History


The four ypm buildings

The four YPM buildings

Peabody

(YPM)

Environmental

Science Center

(ESC)

Geology / Geophysics

(KGL)

175 Whitney

(Anthropology)


Confluence of ypm kgl esc

Confluence of YPM, KGL, ESC

ESC

KGL

YPM


Peabody collections counts functional cataloguing unit

Peabody CollectionsCounts & Functional Cataloguing Unit

  • Anthropology 325,000Lot

  • Botany 350,000Individual

  • Entomology1,000,000Individual

  • Invertebrate Paleontology 300,000Lot

  • Invertebrate Zoology 300,000Lot

  • Mineralogy 35,000Individual

  • Paleobotany 150,000Individual

  • Scientific Instruments 2,000Individual

  • Vertebrate Paleontology 125,000Individual

  • Vertebrate Zoology 185,000Lot / Individual

    2.7 million functional units => ~11 million items


Peabody collections functional units databased

Peabody CollectionsFunctional Units Databased

  • Anthropology 325,000 90 %

  • Botany 350,000 1 %

  • Entomology1,000,000 1 %

  • Invertebrate Paleontology 300,000 55 %

  • Invertebrate Zoology 300,000 20 %

  • Mineralogy 35,000 85 %

  • Paleobotany 150,000 60 %

  • Scientific Instruments 2,000100 %

  • Vertebrate Paleontology 125,000 60 %

  • Vertebrate Zoology 185,000 95 %

    930,000 of 2.7 million => 35 % overall


Ke emu

VZ

Kristof Zyskowski

(Vert. Zool. - ESC)

Greg Watkins-Colwell

(Vert. Zool. - ESC)


Ke emu

HSI

Shae Trewin

(Scientific Instruments – KGL )


Ke emu

VP

Mary Ann Turner

(Vert. Paleo. – KGL / YPM)


Ke emu

ANT

Maureen DaRos

(Anthro. - YPM / 175 Whitney)


Emu planning

EMu Planning

2002Collections Computerization Committee deliberations

2003 Q2on-site demonstrations from CM vendors

2003 Q3+talk with existing clients of CM vendors


Emu planning1

EMu Planning

2002Collections Computerization Committee deliberations

2003 Q2on-site demonstrations from CM vendors

2003 Q3+talk with existing clients of CM vendors

Lots of other folks…


Classic argus

Classic Argus


Old to the new

Old to the New

Argus ModuleEMu Module

ObjectCatalogue

ObjectConservation

ObjectInternal Movements

LexiconTaxonomy

ActivityAccession Lots

ActivityLoans

SiteCollecting Events

SiteSite

ConstituentParties

PublicationBibliography


Prior argus experience

Prior Argus Experience

Single CMS shared by all Departments

for about a decade - YPM staff cohabiting

internally and realizing commonalities

- streamlined system administration

- ease strain of future migration path


Emu implementation

EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines

1.5 years total


Emu implementation1

EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines


Local emu web site

Local Emu web site


Emu training session

19 trainees

EMu training session


Even with best intentions the emu big picture can remain a bit fuzzy

Even with best intentions the ‘EMu Big Picture’ can remain a bit fuzzy…


Clarity

Clarity…

Ian Turnbull

Negar Samenirad


Emu implementation2

EMu Implementation

01/2004 Data mapping starts, contract refinement

02/2004 Major data parsing & cleaning starts in Argus

07/2004Contracts signed, Vancouver starts

08/2004Servers configured, YPM-test environment running

09/2004 Begin iterative screen design & tests with tiny datasets

10/2004Draft YPM-live environment added to server

10/2004One week of KE training for collections staff

11/2004Staff working with draft YPM-live environment

02/2005Larry to Vancouver to work with Negar

03/2005YPM-live screen design & data mappings stabilizing

04/2005Last uploads to Argus, prep for final data migration

05/2005Final data migration, all curatorial disciplines

06/2005Safe to jump into the water…


Ke emu

Specimens

EMu Users Groupa.k.a. Weekly Therapy- started meetings at go-live- topic du jour as a kick off- then open season on issues - driven by users' experiences


Some miscellaneous statistics

Some Miscellaneous Statistics

  • 1,200,000 Argus records => 2,100,000 EMu records

  • 3 days for Argus server to spit out the final migration files

  • 12 days for EMu server to ingest the final migration files

  • held a final migration “race” between the KE & YPM servers

  • lost few weeks to Vancouver server hiccups, office move, etc.


Operating in emu iz

operating in Emu - IZ

Chomping at the bit…

Invertebrate

Zoology

Lourdes Rojas

Eric Lazo-Wasem

Dan Drew


Operating in emu iz1

operating in Emu - IZ

partitioning backlogged

multi-species samples…


Operating in emu iz2

operating in Emu - IZ

Site record for lot


Operating in emu iz3

operating in Emu - IZ

RTF label

Site record for lot


Operating in emu iz4

operating in Emu - IZ

RTF label

Site record for lot

Datamax I-4406 (thermal)


Operating in emu iz5

operating in Emu - IZ

RTF label

Site record for lot

Datamax I-4406 (thermal)

…label(s) into jar


Excerpts from ypm modules

Excerpts from YPM Modules

Catalogue - adjustments for speed

Taxonomy - Lexicon tab


Catalogue ant

Catalogue ANT


Catalogue hsi

Catalogue HSI


Catalogue iz

Catalogue IZ


Det iz4

DET – IZ4

Yowza ! An identification updater is coming to EMu !

Cloned the grid elements for:

"Current" Identification

"Filed Asth" Identification

into additional, separate fields


Tax higher

Tax – higher


Tax lex

Tax - lex


Tax lex expand1

Tax – lex expand1


Tax lex expand2

Tax – lex expand2


Tax lex expand21

Tax – lex expand2

- levels of children to display is regulated by a registry entry

- assigning the parent sets the full path back up the tree

- optional viewing mechanism grafted onto the base module

PRINCIPLE #1 = LEAVE EXTANT MODULE INTACT !


Taxontree1

taxontree1


Taxontree2

taxontree2


Taxontree21

taxontree2

Other external resources?

Drag and drop reparenting?

Alternate classifications?

Autopopulating Luts fields?


Backend script tinkering creative destruction

Backend Script Tinkering= Creative Destruction

JPEG 2000 and EMu - protem freeware fix

Admin Module - the proverbial black box


Http www jpeg org jpeg2000

http://www.jpeg.org/jpeg2000

non-proprietary standard

mathematically lossless

lossy (much smaller files)

"perceptually" lossless

desktop sofwtare emerging


Http www fnordware com j2k

http://www.fnordware.com/j2k


Jp2 spicebush

JP2 spicebush


Jp2 spicebush with j2k

JP2 spicebush with J2K


Jp2 spicebush with j2k and tail target

JP2 spicebush with J2K and tail target


Jp2 spicebush tails with file sizes

JP2 spicebush tails with file sizes

1.54 mB 15 kB


Jp2 spicebush tails with moral

JP2 spicebush tails with moral

lossless JP2 => circa 30-40% original TIFF size

lossy JP2=> go to circa 1%-5%, depending on purpose


Ke emu

Reed Beaman1, Nico Cellinese1,

Bryan Heidorn2, Ashley Green1, Youjun Guo1,

Michael Donoghue1, Barbara Thiers3,

Heather Rolan3 & Melissa Tulig3

1Peabody Museum of Natural History,

Yale University

2Graduate School of Library and Information Science,

University of Illinois at Urbana-Champaign

1The New York Botanical Garden

Funded by the US National Science Foundation


Digital darkroom

Digital Darkroom

  • TTI 30 x 40 inch vacuum easel copy stand

  • UV free, minimal IR lighting

  • Hardware colorimetric calibration

  • Apple G5 workstation

  • 3.2 Tbytes RAID storage and tape library backup

  • Pipeline to image processing web services

Lynn Jones (Botany)


Ke emu

261 kb

1,302 kb

5,166 kb

62,640 kb


Jp2 without

JP2 - without

oops… no thumbnail


Jp2 coding

JP2 - coding

find imagedir –name *.jp2 –mtime -2 –print

loop on the matches and test to see which recently

loaded JP2 files are missing a thumbnail JPG,

or which JP2 files have been modified more

recently than their existing thumbnail JPG ; then

build filenames for any qualifying target JPGs ;

execute script several times per hour from cron

jasper –f match –F tempfile

convert tempfile –resize 90x90 target


Jp2 without1

JP2 - without


Jp2 with

JP2 - with


Jp2 size matters

Ask your EMu server what it might prefer

JP2 – size matters

a hefty TIFF… or a ballet of tiny JP2s ?


Scripting a data load

Scripting a data load


Scripting a data load1

Scripting a data load

Save to simple text format


Scripting a data load2

Scripting a data load

Save to simple text format

Script to convert

to Texpress input


Scripting a data load3

Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Script to convert

for Texpress


Scripting a data load4

Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Texpress grammar file

Script to convert

for Texpress


Scripting a data load5

Texpress 'fidsbrief'

Scripting a data load

Save to simple text format

Texpress grammar file

Script to convert

for Texpress


Admin

Admin

Send output to location of your choice (e.g., Admin Results window)


Admin1

Admin

Send output to location of your choice (e.g., Admin Results window)

texload -ch -ddatafile-ggrammarfile ecatalogue

texload -as -ddatafile-ggrammarfile ecatalogue


Local catalog service

Local catalog service


Ornis

Ornis


Paleoportal

Paleoportal


Cope and labels

Cope and labels

Cope MacClintock

(Inv. Paleo.)


Cope chopping

Cope chopping

another Happy Camper


Finis

finis


  • Login