1. Video representation and suspicious event detection using semantic technologies
- Author
-
Giovanni Merlino, Antonio Puliafito, Muneendra Ojha, Ashish Singh Patel, Om Prakash Vyas, and Dario Bruneo
- Subjects
Smart city, data integration, data modeling, surveillance video, ontology, video semantics, video dataset, object tracking ,Computer Networks and Communications ,Computer science ,Event (relativity) ,02 engineering and technology ,computer.software_genre ,video dataset ,video semantics ,0202 electrical engineering, electronic engineering, information engineering ,ontology ,data integration ,object tracking ,Smart city ,surveillance video ,business.industry ,Representation (systemics) ,020207 software engineering ,Computer Science Applications ,Semantic technology ,020201 artificial intelligence & image processing ,Artificial intelligence ,business ,computer ,Natural language processing ,data modeling ,Information Systems - Abstract
Storage and analysis of video surveillance data is a significant challenge, requiring video interpretation and event detection in the relevant context. To perform this task, the low-level features including shape, texture, and color information are extracted and represented in symbolic forms. In this work, a methodology is proposed, which extracts the salient features and properties using machine learning techniques and represent this information as Linked Data using a domain ontology that is explicitly tailored for detection of certain activities. An ontology is also developed to include concepts and properties which may be applicable in the domain of surveillance and its applications. The proposed approach is validated with actual implementation and is thus evaluated by recognizing suspicious activity in an open parking space. The suspicious activity detection is formalized through inference rules and SPARQL queries. Eventually, Semantic Web Technology has proven to be a remarkable toolchain to interpret videos, thus opening novel possibilities for video scene representation, and detection of complex events, without any human involvement. The proposed novel approach can thus have representation of frame-level information of a video in structured representation and perform event detection while reducing storage and enhancing semantically-aided retrieval of video data.
- Published
- 2021
- Full Text
- View/download PDF