| Acknowledgments | 5 |
|---|
| Contents | 7 |
|---|
| Contributors | 9 |
|---|
| List of Abbreviations | 13 |
|---|
| Part I Introduction | 18 |
|---|
| Introduction to Semantic Multimedia | 19 |
| 1.1 Introduction | 19 |
| 1.2 Multimedia Ontologies | 23 |
| 1.3 Multimedia Ontologies, Analysis and Reasoning – Theory | 24 |
| 1.4 Applications of Semantic Multimedia | 27 |
| 1.5 Alternative Approaches to Multimedia Ontologies | 27 |
| 1.6 Conclusions | 28 |
| References | 28 |
| Part II Multimedia Ontologies, Analysis and Reasoning – Theory | 31 |
|---|
| Multimedia Content Description Using Semantic Web Languages | 33 |
| 2.1 Introduction | 33 |
| 2.2 Multimedia Content Description Using MPEG-7 | 35 |
| 2.3 Web Ontology Languages | 43 |
| 2.4 MPEG-7 Ontologies | 50 |
| 2.5 Mapping Approach | 52 |
| 2.6 Use Cases | 55 |
| 2.7 An Integrated Ontological Infrastructure for the Semantic Description of Multimedia Content | 60 |
| 2.8 Conclusions | 68 |
| References | 68 |
| Ontology-Based Reasoning Techniques for Multimedia Interpretation and Retrieval | 71 |
| 3.1 Introduction | 71 |
| 3.2 Ontology-Based Information Retrieval | 74 |
| 3.3 Automatic Construction of Metadata for Media Objects | 87 |
| 3.4 Uncertain and Ambiguous Interpretations | 102 |
| 3.5 Conclusions | 110 |
| References | 110 |
| Introducing Context and Reasoning in Visual Content Analysis: An Ontology- Based Framework | 115 |
| 4.1 Introduction | 115 |
| 4.2 RelevantWork | 117 |
| 4.3 Ontology Infrastructure | 120 |
| 4.4 Context Analysis | 123 |
| 4.5 Constraint Reasoning to Eliminate Ambiguities in Labelled Images | 128 |
| 4.6 Experimental Results and Evaluation | 132 |
| 4.7 Conclusions and Further Discussions | 135 |
| References | 136 |
| Audio Content Analysis | 139 |
| 5.1 Introduction | 139 |
| 5.2 Overview of Audio Content Analysis | 141 |
| 5.3 General Audio Classification and Segmentation | 145 |
| 5.4 Speaker Segmentation | 148 |
| 5.5 Spoken Content Indexing and Spoken Document Retrieval | 158 |
| 5.6 Music Content Analysis | 164 |
| 5.7 Summary and Concluding Remarks | 172 |
| References | 173 |
| Part III Applications Using Semantic Web Technologies | 179 |
|---|
| Personalised Multimedia Summaries | 181 |
| 6.1 Introduction | 181 |
| 6.2 Personalised Multimedia Summaries | 183 |
| 6.3 Use Case – Personalised Soccer Summaries | 184 |
| 6.4 Contextual Coherence of Personalised Summaries | 192 |
| 6.5 Conclusions | 197 |
| References | 198 |
| The Role of Ontologies for 3D Media Applications | 201 |
| 7.1 Introduction | 201 |
| 7.2 3D Media Representation: From Geometry to Semantics | 203 |
| 7.3 Knowledge and Ontologies for 3D Media Applications | 208 |
| 7.4 3D Application Ontologies: The Experience of AIM@SHAPE | 213 |
| 7.5 Conclusions | 219 |
| References | 220 |
| The Application of Semantic Web Technologies to Multimedia Data Fusion within eScience | 223 |
| 8.1 Introduction | 223 |
| 8.2 The Relevance of Semantic Web Technologies to eScience | 224 |
| 8.3 Data-Driven Discovery of Novel Fuel Cell Materials | 226 |
| 8.4 Semantic WildNet | 232 |
| 8.5 Ethnographic Media Analysis | 236 |
| 8.6 Conclusions | 240 |
| References | 241 |
| Part IV Applications Using Alternative Approaches to Multimedia Ontologies | 243 |
|---|
| Mind the Gaps – Finding the Appropriate Dimensional Representation for Semantic Retrieval of Multimedia Assets | 245 |
| 9.1 Introduction: Multimedia Retrieval | 245 |
| 9.2 Dimensionality Reduction Techniques | 253 |
| 9.3 The Journey of Latent Semantic Analysis from the Textual Domain to the Multimedia Landscape | 257 |
| 9.4 Conclusion | 265 |
| References | 265 |
| Filling the Semantic Gap in Video Retrieval: An Exploration | 269 |
| 10.1 Introduction: Bridging the Semantic Gap | 269 |
| 10.2 Are Semantic Concepts Useful to Video Retrieval? | 270 |
| 10.3 What Kinds of Concepts Should be Chosen? | 279 |
| 10.4 How can we Use the Concepts to Help Video Search? | 285 |
| 10.5 Conclusions and Future Work | 290 |
| References | 291 |
| Part V Conclusion | 295 |
|---|
| Conclusions Relating to Semantic Multimedia and Ontologies | 297 |
| 11.1 Reflections on Semantic Multimedia and Ontologies | 297 |
| 11.2 Harmonisation of Multimedia Ontologies | 298 |
| 11.3 For Further Reading and Research | 299 |
| Further Reading | 299 |
| Web Resources | 301 |
| Index | 303 |
