As a PhD student I've written and helped co-author several papers about understanding and managing large video collections using content based retrieval techniques. Though tremendous progress has been made in this field, it's not always clear to users what these techniques do exactly, and how they should be applied in a real world scenario.
My expertise in this field lies with designing and testing advanced and sometimes blatantly far fetched user interfaces which help the user in the loop, and let the user learn how to explore a collection of unknown video fragments by using all kinds of automated analysis techniques.
Here is a list of publications with my name (somewhere) on or in it. For a more complete list of all publications related to my work and demos of our interactive semantic video search engine I'd suggest visiting the the MediaMill website.
Journal publications
O de Rooij, M Worring, and J J van Wijk. MediaTable: Interactive Categorization of Multimedia Collections. In IEEE Computer Graphics and Applications, 30(5), 2010. PDF
Ork de Rooij, and Marcel Worring. Browsing Video Along Multiple Threads. In IEEE Transactions on Multimedia, 12(2), 2010. PDF
Alan F Smeaton, Peter Wilkins, Marcel Worring, Ork de Rooij, Tat-Seng Chua, and Huanbo Luan. Content-based video retrieval: Three example systems from TRECVid. In Int. J. Imaging Syst. Technol., 18(2-3), 2008.
Cees G M Snoek, Marcel Worring, Ork de Rooij, Koen E A van de Sande, Rong Yan, and Alexander G Hauptmann. VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems. In IEEE MultiMedia, 15(1), January--March 2008. PDF
Conference proceedings
Ork de Rooij, Cees G M Snoek, and Marcel Worring. Balancing Thread Based Navigation for Targeted Video Search. In Proceedings of the ACM International Conference on Image and Video Retrieval, Niagara Falls, Canada, 2008.
Ork de Rooij, Cees G M Snoek, and Marcel Worring. Consuming Videos With The ForkBrowser. In Proceedings of the 14th Advanced School for Computing and Imaging (ASCI), Heijen, The Netherlands, 2008.
Ork de Rooij, Cees G M Snoek, and Marcel Worring. Query on Demand Video Browsing. In Proceedings of the ACM International Conference on Multimedia, Pages 811--814, Augsburg, Germany, 2007. PDF
Marcel Worring, Ork de Rooij, and Ton van Rijn. Browsing visual collections using graphs. In MIR `07: Proceedings of the ACM International Workshop on Multimedia Information Retrieval, Pages 307--312, Augsburg, Germany, 2007.
Arnold W M Smeulders, Jan C van Gemert, Bouke Huurnink, Dennis C Koelma, Ork de Rooij, Koen E A van de Sande, Cees G M Snoek, Cor J Veenman, and Marcel Worring. Semantic Video Search. In International Conference on Image Analysis and Processing, Modena, Italy, 2007. PDF
Marcel Worring, Cees G M Snoek, Ork de Rooij, Giang P Nguyen, and Arnold W M Smeulders. The MediaMill Semantic Video Search Engine. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Honolulu, Hawaii, USA, 2007. PDF
Ork de Rooij, Cees G M Snoek, and Marcel Worring. Multi Thread Video Browsing. In Proceedings of the 13th Advanced School for Computing and Imaging (ASCI), None Heijen, The Netherlands, 2007.
Marcel Worring, Cees G M Snoek, Ork de Rooij, Giang P Nguyen, and Dennis C Koelma. Lexicon-based Browsers for Searching in News Video Archives. In Proceedings of the International Conference on Pattern Recognition, Pages 1256--1259, Hong Kong, China, 2006. PDF
Ork de Rooij, and Marcel Worring. Browsing News Video using Semantic Threads. In Proceedings of the 12th Advanced School for Computing and Imaging (ASCI), None Lommel, Belgium, 2006.
Technical demonstrators
Ork de Rooij, Cees G M Snoek, and Marcel Worring. MediaMill: Fast and Effective Video Search using the ForkBrowser. In Proceedings of the ACM International Conference on Image and Video Retrieval, Niagara Falls, Canada, 2008.
Ork de Rooij, Cees G M Snoek, and Marcel Worring. MediaMill: Semantic Video Browsing using the RotorBrowser. In Proceedings of the ACM International Conference on Image and Video Retrieval, Pages 649--649, Amsterdam, The Netherlands, 2007. PDF
Cees G M Snoek, Marcel Worring, Bouke Huurnink, Jan C van Gemert, Koen E A van de Sande, Dennis C Koelma, and Ork de Rooij. MediaMill: Video Search using a Thesaurus of 500 Machine Learned Concepts. In Proceedings of the 1st International Conference on Semantic and Digital Media Technologies, Athens, Greece, 2006. PDF
Marcel Worring, Cees G M Snoek, Bouke Huurnink, Jan van Gemert, Dennis Koelma, and Ork de Rooij. The MediaMill Large-lexicon Concept Suggestion Engine. In Proceedings of the ACM International Conference on Multimedia, Pages 785--786, Santa Barbara, USA, 2006. PDF
Marcel Worring, Cees G M Snoek, Ork de Rooij, Giang P Nguyen, Richard van Balen, and Dennis C Koelma. MediaMill: Advanced Browsing in News Video Archives. In Proceedings of the International Conference on Image and Video Retrieval, CIVR 2006, Tempe, Arizona, July 13-15, 2006, Pages 533--536, Heidelberg, Germany, 2006. PDF
Cees G M Snoek, Marcel Worring, Jan van Gemert, Jan-Mark Geusebroek, Dennis Koelma, Giang P Nguyen, Ork de Rooij, and Frank Seinstra. MediaMill: Exploring News Video Archives based on Learned Semantics. In Proceedings of the ACM International Conference on Multimedia, Pages 225--226, Singapore, 2005. PDF
TRECVID Proceedings
Cees G M Snoek, Koen E A van de Sande, Ork de Rooij, Bouke Huurnink, Jasper R R Uijlings, Michiel van Liempt, Miguel Bugalho, Isabel Trancoso, Fei Yan, Muhammad A Tahir, Krystian Mikolajczyk, Josef Kittler, Maarten de Rijke, Jan-Mark Geusebroek, Theo Gevers, Marcel Worring, Dennis C Koelma, and Arnold W M Smeulders. The MediaMill TRECVID 2009 Semantic Video Search Engine. In Proceedings of the 7th TRECVID Workshop, Pages , Gaithersburg, USA, 2009. PDF
Cees G M Snoek, Koen E A van de Sande, Ork de Rooij, Bouke Huurnink, Jan C van Gemert, Jasper R R Uijlings, Jiyin He, Xirong Li, Ivo Everts, Vladimir Nedovic, Michiel van Liempt, Richard van Balen, Fei Yan, Muhammad A Tahir, Krystian Mikolajczyk, Josef Kittler, Maarten de Rijke, Jan-Mark Geusebroek, Theo Gevers, Marcel Worring, Arnold W M Smeulders, and Dennis C Koelma. The MediaMill TRECVID 2008 Semantic Video Search Engine. In Proceedings of the 6th TRECVID Workshop, Pages , Gaithersburg, USA, 2008. PDF
Cees G M Snoek, I Everts, Jan C van Gemert, Jan-Mark Geusebroek, Bouke Huurnink, Dennis C Koelma, Michiel van Liempt, Ork de Rooij, Koen E A van de Sande, Arnold W M Smeulders, Jasper R R Uijlings, and Marcel Worring. The MediaMill TRECVID 2007 Semantic Video Search Engine. In Proceedings of the 5th TRECVID Workshop, Pages , Gaithersburg, USA, 2007. PDF
Cees G M Snoek, Jan C van Gemert, Theo Gevers, Bouke Huurnink, Dennis C Koelma, Michiel van Liempt, Ork de Rooij, Koen E A van de Sande, Frank J Seinstra, Arnold W M Smeulders, Andrew H C Thean, Cor J Veenman, and Marcel Worring. The MediaMill TRECVID 2006 Semantic Video Search Engine. In Proceedings of the 4th TRECVID Workshop, Pages , Gaithersburg, USA, 2006. PDF
Cees G M Snoek, Jan C van Gemert, Jan-Mark Geusebroek, Bouke Huurnink, Dennis C Koelma, Giang P Nguyen, Ork de Rooij, Frank J Seinstra, Arnold W M Smeulders, Cor J Veenman, and Marcel Worring. The MediaMill TRECVID 2005 Semantic Video Search Engine. In Proceedings of the 3rd TRECVID Workshop, Pages , Gaithersburg, USA, 2005. PDF