Ingest Processing Explained
40 likes | 150 Views
Learn how the Ingest Processor efficiently organizes files into individual items for processing. Understand the process from start to finish and its benefits in managing content ingestion.
Ingest Processing Explained
E N D
Presentation Transcript
General Overview The preprocessor calls the actual ingest after sorting files into individual items Signals readiness by placing a flag file in the dropbox Ingest Processor ImageProc Toolset Fedora Ingest Preprocessor Started either manually or a by a cron job
Ingest Pre-processor Ingest Preprocessor • Takes source files which is laid out in a flat file structure (depending on the type of the content source files include master files, derivatives, TEI, XML metadata, etc.) and sorts the files into a directory hierarchy expected by the Ingest Processor • So, it turns a flat directory into many item-level directories. • Calls the ingest process which handles the actual creation and modification of the Fedora objects in the repository
Ingest Processor Ingest Processor • Each item dropbox corresponds to a conceptual item. For example, for the “Paged Content Model”, an item is a book, for the “Journal Content Model”, it is a journal volume and so on. • The Ingest Processor takes this directory structure and creates the corresponding object hierarchy in the repository • It also creates a METS document that includes similar structural description of the item