1 / 15

StreetTIVO

StreetTIVO. Arjen P. de Vries arjen@acm.org. N5: Semantic Access. Main goal: Improve search system engineering efficiency Approach: Given Declarative specification of collection, background information, and context Declarative specification of retrieval model

juro
Download Presentation

StreetTIVO

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. StreetTIVO Arjen P. de Vriesarjen@acm.org StreetTIVO

  2. N5: Semantic Access • Main goal: • Improve search system engineering efficiency • Approach: • Given • Declarative specification of collection, background information, and context • Declarative specification of retrieval model • Generate a parameterised search system StreetTIVO

  3. Collection + Search Strategy  System StreetTIVO

  4. TRECVID example • A query • //VideoSegment[ about(./transcript, “airplane taking off”) and about(./keyframe, airplane-in-sky.jpg)] • and a retrieval model specification … [avg( [log((0.9*psd(s,d)) + (0.1*ps(s))) | s<$NSamples]) | d<$NDocs ] … StreetTIVO

  5. Spiegle Prototype Retrieval model specification (RAM) + Collection schema (XML)+ Cirquid XML-IR (TIJAH) + MonetDB/XQuery StreetTIVO

  6. Waterland Demo • Demonstration system querying “De Digitale Voorziening” at the Dutch broadcasters NEXI.cgi TIJAH 4 VIDEO (IR engine) MonetDB/ XQuery StreetTIVO

  7. StreetTIVO

  8. TIJAH’s NEXI query language ~ XPath+about MonetDB/XQuery to present result fragments grouped by video let $NEXI_QUERY:="//segment[about(.,metro)]" let $ranking := doc(fn:concat($NEXI_CGI,$NEXI_QUERY)) let $vids := distinct-values($ranking//Result/@docID) let $vranking := element Vranking { for $v in $vids let $vshots := $ranking//Result[@docID=$v] let $vscore := for $f in $vshots/@score return $f cast as xs:double let $MAXvscore := max($vscore) let $MINvscore := min($vscore) order by $MAXvscore descending return element Vid { attribute id {$v}, attribute score {$MAXvscore}, for $s in $vshots[@score > $MINvscore] return $s } } StreetTIVO

  9. Golden demo • “A demo not seen anywhere else” • Co-operation between projects: • N1: Multimedia FeaturesTwente, UvA, Delft • N3: Ambient Data ManagementCWI, Philips, Twente • N5: Semantic AccessCWI, Twente StreetTIVO StreetTIVO

  10. PVR + MultimediaN Features • Teletekst • ASR (automatic speech recognition) • Scene- and/or shot-segmentation • Detecting repeated objects • Tracking a library of famous people • [your fav “detector” here…] • + Information Retrieval StreetTIVO StreetTIVO

  11. Challenge: feature detection takes long time Idea: P2P  Collaborative Multimedia Indexing StreetTIVO Work distribution Result exchange Fault tolerance StreetTIVO

  12. StreetTIVO CWI Seed farm 10 workstations StreetTIVO

  13. StreetTIVO Work distribution Result exchange Fault tolerance AmbientDB StreetTIVO aims for the world-wide MythTV community (starting in NL). Scalability and robustness! CWI Seed farm 10 workstations StreetTIVO

  14. TIJAH 4 VIDEO (IR engine) Multimedia Feature Detection SOAP/XQuery XQuery/embedded StreetTIVO module AmbientDB P2P database StreetTIVO Architecture Extending the search functionality corresponds to installing a new detector and updating the TIJAH 4 VIDEO XQuery queries StreetTIVO

  15. Thijs Westerveld (CWI) Multimedia search Matthijs Mourits (CWI) mythTV boxes Jennie Zhang (CWI) P2P data management Djoerd Hiemstra (CTIT) TIJAH Roeland Ordelman (CTIT) ASR (Dutch) YOUR NAME IS WELCOME HERE!!! Key Persons StreetTIVO

More Related