1 / 54

PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCES

PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCES. Dietrich Schüller Audiovisual Archiving Visions, Challenges, Strategies Nijmegen, 29 th November 2004. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCES Dietrich Schüller. History of linguistic research closely related to sound recording

bethesda
Download Presentation

PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCES

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCES Dietrich Schüller Audiovisual Archiving Visions, Challenges, Strategies Nijmegen, 29th November 2004

  2. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller History of linguistic research closely related to sound recording Audiovisual archives were initiated by research bodies • Vienna 1899 • Paris and Berlin 1900 • St. Petersburg 1908… • mushroomed with the advent of battery operated audio recorders in the mid-1950s • with truly portable video recorders in the 1980s video recordings became increasingly important

  3. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Audio (and upcoming video) documents - sources proper for ethno-linguistic research • total amount audio and video carriers worldwide estimated to be 100 +100 million hours • amount of ethno-linguistic recordings unknown

  4. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Visions: Future Archive usage scenarios – the topic of this workshop

  5. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Preconditions for any visionary outlook • physical existence of information • linguistic data gathering did not start yesterday, but already 1890 - hitherto accumulated research documents to be included • considerable amounts of relevant recordings outside the world of linguistic research institutions

  6. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Challenges • carrier degradation • format and system obsolescence • analogue-to-digital conversion • digital preservation

  7. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Strategies • spotting and ingesting language resources outside linguistic archives/institutions • spotting and safeguarding unattended collections • labour division: archives vs dedicated data bases

  8. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Carrier degradation Mechanical audio carriers cylinders brittle, mouldy, extremely vulnerable shellac-78 rpm fairly stable, fragile instantaneous discs highly endangered vinyl (LP) discs fairly stable, vulnerable

  9. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Instantaneous disc 1990 2001

  10. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Magnetic tape - audio and video most endangered: • acetate tape historical audio • pigment binder break down post 1975 audio and video • MP / ME tape R-Dat, Video/Hi8, DV

  11. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller

  12. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Compact Discs - Digital Versatile Discs replicated CDs + DVDs fairly stable ? recordable CDs + DVDs highly endangered DVDs: higher data density - lower data security

  13. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Format obsolescence and availability of equipment audio format obsolete equipment now soon cylinders x specialist only coarse groove discs x specialist only micro groove discs (vinyls) x fading out quarter inch tape x fading out micro cassettes x fading out compact cassette ? ? R-Dat x fading out MiniDisc ? ?

  14. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Format obsolescence and availability of equipment video professional format obsolete equipment now soon 2" quadruplex x specialist only 1" x specialist only Umatic x fading out M II x specialist only Betacam SP ? ? D 1 x fading out D 2 x fading out D 3 x fading out D 5 x ? DigiBeta x ? IMX ? ?

  15. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Format obsolescence and availability of equipment video home format obsolete equipment now soon VCR x specialist only Video 2000 x specialist only Betamax x specialist only VHS ? ? S-VHS ? ? Video8 x ? Video Hi8 x ? Digital 8 ? ? DV ? ?

  16. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Traditional paradigm of preserving documents: preserve the original Around 1990 shift of preservation paradigm: Long term preservation of • deteriorating original documents • machines of all formats and their spare parts is hopeless! Audio (and video) preservation must be based on subsequent digital (= lossless) copying of contents

  17. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Viable solution: Digital Mass Storage Systems (DMSSs) – robotic storage systems ·self-checking ·self-regenerating ·self-migrating DMSS prerequisite for remote access to audiovisual collections Radio Archives introduced DMSSs since 1992 National and Research Archives following

  18. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Storage requirement per hour preservation access audio 0.63 - 2GB <0.1GB video ~ 80GB (CCIR 601) ~ 2GB (DVD) ~22GB (MPEG50, DVCPRO50) film (35mm) 3.6 TB (!)  photographs 40-100MB/image ~ 1MB/image

  19. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Intermediary solutions- manual imitation of DMSS produce carriers free of uncorrectable errors and with a minimum of correctable errors – check each carrier and keep the error status record check error status at regular intervals, ideally of each carrier, at least of representative samples of each batch copy contents to new carrier before signal becomes irretrievable (refreshment) copy to new systems before hard- and/or software becomes obsolete (migration)

  20. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Problems of intermediary solutions Original digital target formats R-Dat and CD-R • R-Dat close to obsolescence • CD-R (and DVD-Rs) presently unreliable Labour intensive Documents of both formats are already endangered

  21. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Present development Avoid consumer market media (CD-Rs, DVD-Rs) and industrial (=proprietary) audio and video formats (R-Dat, DV, DigiBeta, IMX… ) Go to computer (IT) environment and openly defined file formats: Wave for audio, MXF - linear and MJPEG 2000 lossless compressed - for video Small, scalable approaches successfully under way

  22. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESMichael Risnyovszky Small, scalable approaches towards DMSSs successfully under way To start with: A single LTO drive or a small autoloader for making backups Workstation with firewire/usb2 attached desktop RAID

  23. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESMichael Risnyovszky Using 2 or more workstations Network switch Workstation Workstation File server LTO autoloader

  24. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESMichael Risnyovszky Further expanded Several workstations 1Gigabit server backbone File server with SCSI-attached drive enclosure(s) Library with 1 or 2 LTO drives

  25. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESMichael Risnyovszky A small DMSS Several workstations 1Gigabit Server Backbone Library with 2 LTO drives, could be connected to the SAN or directly attached to one of the file servers 2 or more file servers Independent, highly scalable storage unit in a SAN environment

  26. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant technical task ahead: Feeding analogue and digital single carriers into a safe digital environment • time consuming • labour intensive • in demand of well maintained equipment and expert knowledge

  27. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Transfer principles • complete, unmodified transfer of originals to digital • no data reduction (“compression”) - unless original was data reduced Digital resolutions for analogue originalsaudio • 48 kHz/24 bit minimum (radio) • 96/24 standard (heritage and research archives • 192/24 upcoming for mechanical originals • “the worse the signal, the higher the resolution” Keep originals as long as possible

  28. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Transfer factors cylinders, instantaneous discs open ended 78 rpm discs 1: 5 ? vinyl discs depending on condition magnetic tape audio 1:3 minimum including content description 1:6 ….or: 1 hour of original tape material takes one day ! magnetic tape video 1: 8–20 (!)

  29. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Transfer may take many years, even decades Consequently • storage/handling of collections must be optimised to retard deterioration • strategies must be developed to ensure future availability of replay equipment - present greatest challenges • audio: low speed quarter inch tape machines • video “professional” player for half inch home formats

  30. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Transfer contents is technically demanding Use modern replay equipment aligned to original (=historical) format parameters • speed • track configurations • equalisation Generally, do NOT use original recording equipment

  31. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Quarter inch audio tape track formats 1

  32. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Quarter inch audio tape track formats 2 Butterfly head

  33. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller S/N vs track width

  34. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Tape flux frequency response for different equalization time constants (DIN 45 513) and recordings speeds (consumer formats)

  35. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Tape equalisations 1

  36. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Tape equalisations 2

  37. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Tape equalisations 3

  38. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Tape equalisations 4

  39. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Many (most?) audio research documents need azimuth adjustment

  40. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Replay machines must be kept in good condition • spare part supply becomes an ever increasing problem • engineering knowledge and skills fading out ….transfer is more than pressing the replay button!

  41. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant financial challenge 1: cost of equipment  audio: ·digital mass storage systems $ 100,000++ ·“intermediary solutions” $ 20,000+ ·future “personal” DMSS $ 30,000??  video: • “video file archiving” $ 80.000+

  42. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant financial challenge 2: keeping digital documents alive requires ongoing devotion and financial input professional, automated preservation: 8-12 $/GB/year manual solutions cheaper, but less secure and only viable up to the low TB range

  43. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant strategic aims 1: Spotting and ingesting language resources outside linguistic archives/institutions • broadcast archives • national/regional/municipial archives • parliamentary archives • oral history archives /collections

  44. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant strategic aims 2: Safeguarding the documents of endangered /extinct languages • 80% of audiovisual materials related to ethno-linguistics are outside proper archival custody • private collections and small research/cultural units, unaware of necessary preservation measures – or lacking financial and personal resources • unique sources of the last 50 years are left unattended and will rot away within 10-30 years • spotting and preserving these collections must be organised on a great scale!

  45. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Generally, small collections are lacking • awareness • expertise • analogue replay equipment • digital workstations • financial means for keeping digital data alive Viable solutions will require cooperative solutions Greatest problem: mistrust

  46. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller EU funded Project TAPE objectives: • spotting small collections outside professional archival care, in cooperation with respective NGOs • awareness raising • developing training programmes and materials • organising training events Similar projects on regional and international scales needed

  47. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Predominant strategic aims 3: Labour division between • archives (in the narrower sense) • content related data bases

  48. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Archives in the narrower sense • repositories of raw materials • focus on high standard ingest/transfer and preservation • metadata coarsely structured and restricted to otherwise unobtainable secondary information Sources for………

  49. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Data bases (“archives” in the wider sense) • content/region etc related • specifically structured • time and place (school) oriented • structurally between raw material and publication • not responsible for high standard ingest/transfer and preservation • legal and moral rights clearance viable for dedicated corpora

  50. PHONOGRAMMARCHIV - AUSTRIAN ACADEMY OF SCIENCESDietrich Schüller Two-tier structure allows • Optimising preservation and access to specialised corpora by labour division • Cost of transfer from archives to be born by data bases

More Related