CS257 Modelling Multimedia Information LECTURE 5. Introduction. Let’s review… What we’re dealing with (video data) What kinds of moving images might be stored in a digital video database What kinds of queries people might want to make to a video database
Techniques for modelling and querying video content
Diverse range of video database applications, users and information needs
“Ferries departing at night”
“Animal rights protesters outside Hillingdon cat farm, wearing masks”
From Enser and Sandom (2002).
Need to attach metadata to different parts of the video [More on this in Part 1 of this Lecture]
Need more structured descriptions of what’s happening (both for queries and for video metadata), i.e. who is doing what to whom with what and why. [More on this in Lecture 6]
[More on this in Lecture 6]
Start Time / Frame: 1
End Time / Frame: 103
Start Time / Frame: 104
End Time / Frame: 155
Interval 3Overlapping Intervals
Start Time / Frame: 008
End Time / Frame: 035
Start Time / Frame: 045
End Time / Frame: 086
Start Time / Frame: 000
End Time / Frame: 210
From: Corridoni et al (1996), ‘Multi-perspective Navigation of Movies’, Journal of Visual Languages and Computing 7, 445-466. [Available through Library eJournals].
Video Data: In the beginning….
The MPEG standards: some hows and whys….
Each standard developed with a specific aim
Compression: video data at 1.5 Mbits/s
Started 1988; finished 1992
(MPEG-1 Audio Layer III MP3)
Combines visual, audio and timing information into one data stream suitable for digital transmission
Quality issues: fidelity of colour map; pixel resolution; frame resolution
Started 1990; finished 1996
Digital Storage Media Command and Control: protocols for managing bitstreams
Next generation mobile communication
(Started 1993; parts finished in 2000/1)
**FROM FRAMES TO AUDIO-VISUAL OBJECTS**
Coding of audio-visual objects - real or synthetic
Standard scene description (cf. VRML):
Indexing and retrieval
“Multimedia Content Description Interface”
“different from previous MPEG standards… what is represented is not the information itself but information about the information”
i.e. it is a metadata standard.
Description Definition Language
There are 4 copies of this article in the Library Article Collection.
Multimedia Standards in Television / Media Production
For a short article about mxf and aaf, see:
Martinez, J.M., Koenen, R., and Pereira, F. (2002), “MPEG-7: the generic multimedia content description standard, part 1.” IEEE Multimedia 9 (2), April-June 2002, 78–87
Martinez, J.M. (2002), “Standards - MPEG-7 overview of MPEG-7 description tools, part 2. ” IEEE Multimedia 9 (3), July-Sept. 2002, 83 -93.
Chang, S.-F., Sikora, T. and Purl (2001), “An Overview of the MPEG-7 Standard”, IEEE Transactions on Circuits and Systems for Video Technology, 11 (6), 688-695.
Nack, F. and Lindsay, A.T. (1999), “Everything you wanted to know about MPEG-7. Part 1.” IEEE Multimedia 6 (3), July-Sept. 1999, 65 –77.
Nack, F. and Lindsay, A.T. (1999), “Everything you wanted to know about MPEG-7. Part 2.” IEEE Multimedia 6 (4), Oct.-Dec. 1999 , 64 –73