1 / 38

Architectures: From Video Storage to Campus Rich Media Services

Architectures: From Video Storage to Campus Rich Media Services. Alan McCord and Dan Hague University of Michigan SURA/ViDe Conference March 26, 2003. Agenda. 0-10 minutes Introductions, Al setting the stage for Dan 11-30 minutes Dan describing his IP SANS solution 31-50 minutes

ernie
Download Presentation

Architectures: From Video Storage to Campus Rich Media Services

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Architectures:From Video Storage to Campus Rich Media Services Alan McCord and Dan Hague University of Michigan SURA/ViDe Conference March 26, 2003 SURA/ViDe

  2. Agenda • 0-10 minutes • Introductions, Al setting the stage for Dan • 11-30 minutes • Dan describing his IP SANS solution • 31-50 minutes • Al weaving the IP SANS solution into a model architecture for rich media on campus • 51-60 minutes • q/a and discussion SURA/ViDe

  3. Introduction • Individual campus video projects can easily require many Gigabytes of storage for even a short ten-minute asset. Once stored, those assets need to be cataloged, streamed and otherwise re-purposed. SURA/ViDe

  4. Remember This Scene? Digital video of patient interview Tape of 1975 orchestra concert Brent Scowcroft dialog 1962 Robert Frost poetry reading Championship field hockey game Yesterdays’ CHEM101 lecture SURA/ViDe

  5. The Campus Challenge • We need to acquire, index, access, use, and archive “perishable IP” for • Course delivery (on-campus and DL) • Archives and collections • Research projects • External communications (Web, Broadcast, and print) SURA/ViDe

  6. Why DAMS Is Important • Our networks can support digital video payload • Students use P2P to manage media assets • BUT • Rich media still absent from most instruction • Lack of large-scale rich media services • Faculty and librarians lack experience / tools for managing rich media individually or institutionally • Lack of tools to manage IP rights • Lack of rich media workflow tools SURA/ViDe

  7. How Do We Do This? • A campus-wide collaborative approach • Metadata standards • Ingestion, cataloging, and retrieval tools • Lots of bandwidth • Lots of storage • Disk attached storage (DAS) inexpensive but lacks speed and scalability • Traditional storage area networks (SAN) are difficult to manage in highly decentralized organizations • IP-based iSCSI storage may serve campus-wide needs for fast, inexpensive, scalable video storage SURA/ViDe

  8. eStorage - UM Mass Storage Large Scale storage as applied to the Unified Messaging project and the Video Storage, Logging and Retrieval solution SURA/ViDe

  9. Unified Messaging • High Availability • Redundant Architecture • Scalability Port • Load Balancing Between Ports • Load Balancing Between Switches SURA/ViDe

  10. Video Storage, Logging, Retrieval • “Huge” Storage Volumes (68 GigaByte up to 1 TeraByte) • Performance & High Throughput • IP Network Centric • Standards Based • Utilize UM Purchasing to drive down costs SURA/ViDe

  11. High Availability • If one switch fails the hosts are served by the redundant switch. SURA/ViDe

  12. Redundancy • Redundant Power Supplies • Redundant Cooling Fans SURA/ViDe

  13. Scalability Port • To cascade between switches there is a scalability port that allows the creation of a director class switch. SURA/ViDe

  14. Load Balancing Between Ports • Four (4) FC storage ports are available per switch. SURA/ViDe

  15. Load Balancing Between Switches • The load can be spread over multiple switch ports • Each switch has 3 GigE ports • Each switch has 4 FC ports or 6 SCSI ports SURA/ViDe

  16. 4 each JBOD chassis 28 each 73 GigaByte FC drives (68Gig after formatting) 2 each controllers / switches development 2 each controllers / switches production Huge Storage Volumes SURA/ViDe

  17. Performance and High Throughput • 7000 packets per second using 1500 Byte packets ~ 84 M throughput • 11,000 packets per second in other tests • MPEG-2 4:2:0 remove video encoding from the Media Union to Arbor Lakes • Clustering of MS Exchange Servers to support Unified Messaging SURA/ViDe

  18. IP Network Centric • Dedicated Fibre Channel SAN islands are becoming a thing of the past • Leverage large qualified support staff that support existing campus IP network • Storage is available on demand to IP connected devices from any high speed IP faceplate SURA/ViDe

  19. Standards Based • iSCSI draft standard has been ratified by the ITEF and new beta products are showing up every month • Microsoft will include the iSCSI driver in Windows2003 (previously Windows.net) • Cisco and IBM will continue to deliver iSCSI drivers until the OS versions are stable SURA/ViDe

  20. Additional Storage via UM Purchasing • Traditional vendors require storage upgrades to be purchased from the switch manufacturer • 2 more Terabytes are needed and the acquisition will go through UM Purchasing • More vendors are entering this market every quarter driving down the cost SURA/ViDe

  21. More Information • WGBH - PBS television station in Boston http://daminfo.wgbh.org • University of Michigan DAMS Initiative http://sitemaker.umich.edu/dams • iSCSI Storage Switches http://www.sanrad.com • Unified Messaging Project http://www.cti2.com SURA/ViDe

  22. Storage Summary • We are applying iSCSI storage today for: • Unified Messaging • Video on Demand • We are looking at applying iSCSI for: • Archiving 70,000 .wav files for the hospital • Increasing the storage on existing NAS servers internally within our department • Driving down the cost of file storage to allow the DAMS solution to reach more students and faculty SURA/ViDe

  23. What Are We Up To? • Potential DAMS “early wins” • Course management systems • Digital libraries • Personal > unit > institutional repositories • Evaluating three COTS DAMS product suites • DAMS not a core competency • Leverage developer investment • Focus on open standards and tools SURA/ViDe

  24. Market Segments • Content repositories (brand management) • Workflow management (marketing production) • Content and version control (Web production) • Digital media ingesting and logging • DAM infrastructure tool suites • Digital rights management • Encryption and content distribution systems • Systems integration services • Hosting services SURA/ViDe

  25. What Are The Components? • Integrated repository for content & metadata • Infrastructure to manage digital media assets • Ingesting and format conversion * • Metadata tagging and cataloging * • Searching and retrieval • Packaging and delivery to creative and production environments * • Managing flow and control of assets * • Managing IP rights and rules * SURA/ViDe

  26. Digital Asset Management Content Management and Production Media Assets Database Audiences Web - Internet Web - Intranet Internal UM Information External Publications Controlled Access Search Assets Preview and Edit Production Publish/Distribution • Search on: • Text content • Keywords • Speech • Sound/music patterns • Image descriptions • “More like this” search on: • Image content • Audio content • Video content • Parallel preview (thumbnail) and Rich-data view: • File/Asset size • Compression type • Quality • Language • Translation • Preview edit • Compressed format • Rich format • Rights & royalties • Searchable • Display • Reporting • Translate • HTML • XML • Text • Video formats • Audio formats • Publish • To multiple media formats • Distribution via • Network • User-defined industry standard output devices (DAT, BETA-SP, ZIP, CD-RW, etc) • Edit tools • Application tools and integration of industry standard tools for applications where requested by customer (e.g., MS Word, Avid Media Composer, Adobe PhotoShop, etc.) • Content • Size • Cropping • Output Format/File type What DAMS “Is” To Us What DAMS “Is” SURA/ViDe

  27. Static assets Image, text, web, dataset Auto / bulk ingest Format conversion Video assets Tape, live, digital Format conversion Auto ingest Virage integration Ingesting Assets SURA/ViDe

  28. Multiple Metadata Schemas • Instructional objects • SCORM / IMS • MPEG 7 • Merged video content and metadata • MPEG 21 • E-Commerce / DRM metadata • Institutional repository • Dublin Core, MARC • Discipline-specific and project-specific schemas SURA/ViDe

  29. MS Office plug-ins Quark plug-ins Imports into Dreamweaver FTP and e-mail packaging EDL files for video editors XML wrapping Re-Packaging Assets Event Tape  Audio/  Edit   Time Code    Video Action       Tracks NAR -- THROUGHOUT HISTORY...PEOPLE AS WELL 001   AX    A2/V     C     00:00:10:00 00:00:13:0001:00:00:00 01:00:03:00 DAWA SONAM IN GROUP 002   P17   A2/V     C     01:00:08:07 01:01:20:0901:00:03:00 01:01:15:04 NAR -- THESE PEOPLE...TOWN MEETINGS 003   15    A2/V     C     15:02:17:00 15:02:36:0001:01:15:04 01:01:34:04 WIDE SHOT 004   15    A2/V     C     15:10:00:00 15:10:06:0001:01:34:04 01:01:40:04 SURA/ViDe

  30. Auto-ingest and initial tagging Multi-stage tagging Content assembly and approval Automated notification Archiving Workflow Tools SURA/ViDe

  31. Individual Domain COLLABORATIVE RESEARCH STUDENT RESEARCH Project or Group Domain MEDIA STORY COURSE TOOLS DELIVERY Department Domain Public Domain Campus Domain School/Unit Domain Security/Privacy/Authentication Ingestion/Metadata Creation Metadata/Indexing/Query Management Text, Graphics Images Video in multiple resolutions Audio in multiple resolutions Entire Existing Databases Executable Programs and Complex Applications Digital Media Assets Database Digital Rights Management SURA/ViDe

  32. What We’ve Done • Established advocacy / evaluation team • Constructed “phase one” demo lab • Gained executive support • Linked with campus / higher ed DAMS initiatives • Conducted market review • Established vendor relationships • Issued RFP SURA/ViDe

  33. Where We Are Today • Received and reviewed five proposals • Evaluation team narrowed field to • Artesia / Sun • Documentum / BearingPoint (KPMG) • Ancept / IBM (Content Manager) • Day-long campus visits • Hands-on experiences and site visits • Decision in process “as we speak” SURA/ViDe

  34. Unit Unit Unit Unit Unit eTools Collaboratory Components Digital Rights Management Digital Asset Management System (DAMS) Typical cycle of shareddevelopment resource Survey Teams are “portfolio” assignments for eTools staff and include many Unit participants Streaming Media Staffing is done at the level of “Projects” and “Service Nodes” DAMS/COMPS Implementation Emerging Digital Video Standards and Tools Content Management and Publishing System (COMPS) Project Support Services LILI Production Specialty Output Progress ofInformation,Knowledge, Shared Vision, Guding Beliefs Progress ofShared ApplicationsDevelopment Emerging Web Standards and Tools Workflow Best Practices Media Ingestion & Transcoding Digital Broadcast Production Systems (DIBS) “Walk-in” Services Sprite Technology VR: Tactile, Spatial, Olfactory Event-based Multimedia - Academic (RSC, panels) - Performances - University (Commencement) By Special Arrangement Location-independent Learning Integration (LILI) Survey Teams(Emerging Standards, Technology, Tools) Projects Service Nodes Where We’re Headed SURA/ViDe

  35. Limiting Factors • Common understanding about metadata and asset life cycles • Storage • “Two-tailed order of magnitude problem” • End-to-end bandwidth • Both on- and off-campus • Diverse document types and platforms • Asset capture and ingestion tools • Availability of tech & user support SURA/ViDe

  36. Fire-starters • Convergence of DAMS and library systems • Widespread use of consumer digital video capture and editing tools / appliances • Development of easy-to-use transcoding tools to re-purpose rich media for multiple desktops • Wireless phones • tablet computers • classroom projection systems • etc. SURA/ViDe

  37. Impact on Video Services • Video capture / encoding provides content for ingestion into repository • Streaming will support retrieval / packaging • Exposing rich media to creative users will drive • Video capture, encoding, transcoding • Streaming services • Network bandwidth on- and off-campus • Mass storage • New services and service levels SURA/ViDe

  38. Closing Discussion U-M DAMS Initiative sitemaker.umich.edu/dams/ amccord@umich.edu dhague@umich.edu SURA/ViDe

More Related