190 likes | 287 Views
Researching Fedora, Fedora Meeting Copenhagen 09/28/05. Researching Fedora To Serve As Central Repository For Denmark’s State And University Library. Building An Use Case Implementation With Denmark’s Broadcasting Archive Of Radio And Television (BART).
E N D
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Researching Fedora To Serve As Central Repository For Denmark’s State And University Library Building An Use Case Implementation With Denmark’s Broadcasting Archive Of Radio And Television (BART) Stephan Drescher, std@statsbiblioteket.dk
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 picture 1Analog Antenna Set That’s where it all started … In an attic…
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Options for System • complete outsourcing of task • from shelf • taylormade system • own development • around black box professional equipment • high-end consumer + Linux
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Nature of the data harvest process • 24/7/365 • single shot • large quantities of data (220 GB a day) • several independent input sources • no unique identifier in or between sources • different MIME types • data needs to be evaluated and eventually corrected after 48 hours • automatically ingested into repository
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 figure 1Where will be Fedorawithin Bart’s resource workflow?
figure 2Setup Capture Researching Fedora, Fedora Meeting Copenhagen 09/28/05 PC #1 DR1 Hauppauge WinTV lokal disk DR2 Hauppauge WinTV TV2 Hauppauge WinTV EMC mass- storage PC #1’ DR1 Hauppauge WinTV lokal disk DR2 Hauppauge WinTV TV2 Hauppauge WinTV PC #2 DR P1 Hauppauge WinTV lokal disk DR P2 Hauppauge WinTV DR P3 Hauppauge WinTV PC #2’ DR P1 Hauppauge WinTV lokal disk DR P2 Hauppauge WinTV DR P3 Hauppauge WinTV
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Encoder setup • 3 x MPEG1/2 hardware encoder = control quality and amount of data • PCM output = lossless audio, but down-sampled • both FM Radio and TV frequency tuning on a single card = flexible fallback configuration • parallel setup = backup from original signal source
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 picture 2Encoder And Sampler digital resources factory … basement
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Mass storage specs • 80 - 100 TB a year (average 220 GB a day) • Backup on tape
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 figure 3 Mass Storage The cooled place…
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 figure 3 Signal coverage
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Create recordings order • Failover definitions • Channel definitions • Virtual encoder definition • Compression definitions • Source definitions • Physical encoder definition • Valid Compression per physical encoder type • Encoder mappings • Virtual encoder • Physical encoder • Abstract schedule definition • Query definitions (where to get start/stop info)
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Metadata • Descriptive metadata • program information • creator, author --> Dublin Core • Technical metadata • encoding format • create/modified dates --> METS • Logistical data • addresses • Path to footage e.g. --> METS
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Collect metadata • Ritzau Media Service, (MSSQL database) • DR 1, (XML stream) • Logfiles recording, (filesystem) • Logfiles storage, migration (filesystem)
Automatic harvest and ingest system Researching Fedora, Fedora Meeting Copenhagen 09/28/05
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 Scheduler application • Modules • Bouncer • Harvester • LogSniffer • Recorder • Transformer • Inspector • Ingester • Migrator • Syncronizer
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 e.g. Virtual encoder definition in Recorder module
Researching Fedora, Fedora Meeting Copenhagen 09/28/05 figure 4 Main Class Table