Download
slide1 n.
Skip this Video
Loading SlideShow in 5 Seconds..
Toro 1 PowerPoint Presentation

Toro 1

195 Views Download Presentation
Download Presentation

Toro 1

- - - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

  1. Toro 1 EMu on a Diet

  2. Yale campus

  3. Peabody CollectionsApproximate Digital Timeline

  4. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started

  5. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started • 1994 Gopher services launched for collections data

  6. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started • 1994 Gopher services launched for collections data • 1997 Gopher mothballed, Web / HTTP services launched

  7. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started • 1994 Gopher services launched for collections data • 1997 Gopher mothballed, Web / HTTP services launched • 1998 Physical move of many collections “begins” • 2002 Physical move of many collections “ends”

  8. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started • 1994 Gopher services launched for collections data • 1997 Gopher mothballed, Web / HTTP services launched • 1998 Physical move of many collections “begins” • 2002 Physical move of many collections “ends” • 2003 Search for Argus successor commences • 2003 Informatics Office created & staffed

  9. Peabody CollectionsApproximate Digital Timeline • 1991 Systems Office created & staffed • 1991 Argus collections databasing initiative started • 1994 Gopher services launched for collections data • 1997 Gopher mothballed, Web / HTTP services launched • 1998 Physical move of many collections “begins” • 2002 Physical move of many collections “ends” • 2003 Search for Argus successor commences • 2003 Informatics Office created & staffed • 2004 KE EMu to succeed Argus, data migration begins • 2005 Argus data migration ends, go-live in KE EMu

  10. Big events EMu migration in '05 (all disciplines went live simultaneously) Physical move in '98-'02 (primarily neontological disciplines)

  11. Peabody CollectionsCounts & Functional Cataloguing Unit • Anthropology 325,000 Lot • Botany 350,000 Individual • Entomology 400,000 Lot • Invertebrate Paleontology 300,000 Lot • Invertebrate Zoology 300,000 Lot • Mineralogy 35,000 Individual • Paleobotany 150,000 Individual • Scientific Instruments 3,000 Individual • Vertebrate Paleontology 125,000 Individual • Vertebrate Zoology 185,000 Lot / Individual About 12 million specimens ( 2.1 million EMu-able units )

  12. Peabody CollectionsFunctional Units Databased • Anthropology 325,000 90 % • Botany 350,000 1 % • Entomology 400,000 6 % • Invertebrate Paleontology 300,000 60 % • Invertebrate Zoology 300,000 25 % • Mineralogy 35,000 85 % • Paleobotany 150,000 60 % • Scientific Instruments 3,000 100 % • Vertebrate Paleontology 125,000 60 % • Vertebrate Zoology 185,000 95 % 992,000 of 2.1 million ( 45 % overall )

  13. What happens when …

  14. What happens when … … EMu gets sluggish & unresponsive ?

  15. Why is this &^%$ thing so ridiculously slow ?!

  16. Transient often non-EMu issues

  17. Transient often non-EMu issues Persistent underlying EMu issues

  18. Persistent issues typically have at least some “local aspect” to them So you should look your EMu straight in the eye, and see if there are any local solutions that suggest themselves

  19. TRUISM #1: disk speed affects database speed, so a smaller footprint of data on disk will increase performance

  20. In an absolute sense, EMu proved much faster than Argus, but one intriguing metric was the amount of disk space occupied by the catalogue immediately after migration TRUISM #1: disk speed affects database speed, so a smaller footprint of data on disk will increase performance 1,380 mB 10,400 mB

  21. TRUISM #2: active databases never shrink over time

  22. Were there any existing diet protocols?

  23. Vignettes from attempting to streamline a system, 2005-2007 EMu on a Diet

  24. Vignettes from attempting to streamline a system, 2005-2007 EMu on a Diet Post-migration reassessment (2005-2006)

  25. Vignettes from attempting to streamline a system, 2005-2007 EMu on a Diet Post-migration reassessment (2005-2006) Preparation for Darwin Core (2006-2007)

  26. Vignettes from attempting to streamline a system, 2005-2007 EMu on a Diet Post-migration reassessment (2005-2006) Preparation for Darwin Core (2006-2007) Implications of end user habits (2007-)

  27. The ecatalogue database was a rate limiter an EMu data directory

  28. The ecatalogue database was a rate limiter an EMu data directory

  29. The ecatalogue database was a rate limiter an EMu data directory

  30. EMu maintenance jobs emulutsrebuild rebuilds lookup list tables emumaintenance batch quick & dirty optimization (oflow) emumaintenance compact full optimization of database table components

  31. EMu maintenance jobs emulutsrebuild rebuilds lookup list tables emumaintenance batch quick & dirty optimization (oflow) emumaintenance compact full optimization of database table components

  32. Default EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact

  33. Default EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact

  34. Default EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact

  35. Revised EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact

  36. Revised EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact

  37. Revised EMu “cron” maintenance job schedule Mo Tu We Th Fr Sa Su late night workday evening = emulutsrebuild = emumaintenance batch = emumaintenance compact