Active video-based surveillance system: the low-level image and video processing techniques needed for implementation
127
Citation
36
Reference
10
Related Paper
Citation Trend
Abstract:
The importance of video surveillance techniques has considerably increased since the latest terrorist incidents. Safety and security have become critical in many public areas, and there is a specific need to enable human operators to remotely monitor the activity across large environments. For these reasons, multicamera systems are needed to provide surveillance coverage across a wide area, ensuring object visibility over a large range of depths. In the development of advanced visual-based surveillance systems, a number of key issues critical to its successful operation must be addressed. This article describes the low-level image and video processing techniques needed to implement a modern surveillance system. In particular, the change detection methods for both fixed and mobile cameras (pan and tilt) are introduced and the registration methods for multicamera systems with overlapping and nonoverlapping views are discussed.Keywords:
Visibility
In recent years, tremendous advances have been made in Artificial Intelligence (AI) algorithms in the field of image processing. Despite these advances, video compression using AI algorithms has always faced major challenges. These challenges often lie in two areas of higher processing load in comparison with traditional video compression methods, as well as lower visual quality in video content. Careful study and solution of these two challenges is the main motivation of this article that by focusing on them, we have introduced a new video compression based on AI. Since the challenge of processing load is often present in online systems, we have examined our AI video encoder in video streaming applications. One of the most popular applications of video streaming is traffic cameras and video surveillance in road environments which here we called it CCTVs. Our idea in this type of system goes back to fixed background images, where always occupied the bandwidth not efficiently, and the streaming video is related to duplicate background images. Our AI-based video encoder detects fixed background and caches it at the client-side by the background subtraction method. By separating the background image from the moving objects, it is only enough to send the moving objects to the destination, which can save a lot of network bandwidth. Our experimental results show that, in exchange for an acceptable reduction in visual quality assessment, the video compression processing load will be drastically reduced.
Video post-processing
Video denoising
Cite
Citations (3)
Since the growing application of realtime video acquisition and process technology in the fields of security moniter,video conference and network chatting,this paper introduces how to develop the framework of video image acquistion project based on video for windows library;and because call-back function being the common interface of video card on capturing and processing video data,this paper analyzes how to process the acquired video data in real time with self-defined call-back function,and explains the adoption of grads differential method to acquire the active contour of video image in real time, which could be applied in the video image processing project,such as video object moniter, face detection.
Video post-processing
Cite
Citations (0)
Due to the Corona Virus Diseases (COVID-19) pandemic, education is completely dependent on digital platforms, so recent advances in technology have made a tremendous amount of video content available. Due to the huge amount of video content, content-based information retrieval has become more and more important. Video content retrieval, just like information retrieval, requires some pre-processing such as indexing, key frame selection, and, most importantly, accurate detection of video shots. This gives the way for video information to be stored in a manner that will allow easy access. Video processing plays a vital role in many large applications. The applications required to perform the various manipulations on video streams (as on frames or say shots). The high definition of video can take a lot of memory to store, so compression techniques are huge in demand. Also, object tracking or object identification is an area where much considerable research has taken place and it is in progress.
Video retrieval
Digital video
Identification
Cite
Citations (0)
Recent approaches have achieved great success on still image object detection. Despite the high accuracy, directly applying image object detectors for video object detection is rather slow. Inspired from the fact that object tracking is much more efficient than object detection, we propose to combine object detection and tracking for fast video object detection. Computational expensive detection network is applied on sparsely arranged key frames, while proposals of non-key frames are obtained through tracking and regression of previous frame's proposals. Assisted with an adaptive key-frame arrangement module, our method can adaptively decide whether to track or to detect based on tracking quality. Extensive experiments show that the proposed method can significantly boost detection speed with a rather small drop in detection accuracy.
Object-class detection
Tracking (education)
Key frame
Frame rate
Cite
Citations (8)
Video post-processing
Cite
Citations (6)
Digital video
Optical Flow
Tracking (education)
Cite
Citations (2)
The article deals with issues related to the speed of the video stream of video information, depending on the quality of video data required, from spatial resolution and frame rate. With the tendency of growth of volumes of video information and not providing the corresponding data volumes of the productivity of technologies of transmission and processing of video information in complexes videoconferencing - it is necessary to improve the coding methods. In order to increase the efficiency of management and operational activities, it is proposed to improve the existing methods of encoding a dynamic video stream object with algorithms for motion compensation for video conferencing in the control system.
Videoconferencing
Cite
Citations (0)
When video replaces film the digitized video data accumulates very rapidly, leading to a difficult and costly data storage problem. One solution exists for cases when the video images represent continuously repetitive 'static scenes' containing negligible activity, occasionally interrupted by short events of interest. Minutes or hours of redundant video frames can be ignored, and not stored, until activity begins. A new, highly parallel digital state machine generates a digital trigger signal at the onset of a video event. High capacity random access memory storage coupled with newly available fuzzy logic devices permits the monitoring of a video image stream for long term or short term changes caused by spatial translation, dilation, appearance, disappearance, or color change in a video object. Pretrigger and post-trigger storage techniques are then adaptable for archiving the digital stream from only the significant video images.
Video post-processing
Digital video
Video production
Cite
Citations (0)
The proliferation of video consumption, especially over mobile devices, has created a demand for efficient interactive video applications and high-level video analysis. This is particularly significant in real-time applications and resource-limited scenarios. Pixel-domain video processing is often inefficient for many of these applications due to its complexity, whereas compressed domain processing offer fast but unreliable results. In order to achieve fast and effective video processing, this paper proposes a novel video encoding architecture that facilitate efficient compressed domain processing, while maintaining compliance with the mainstream coding standards. This is achieved by optimizing the accuracy of motion information embedded in the compressed video, in addition to compression efficiency. In a motion detection application, we demonstrate that the motion estimated by the proposed encoder can be directly used to extract object information, as opposed to conventionally coded video. The incurred rate distortion overheads can be weighed against the reduced processing required for video analysis targeting a wide spectrum of computer vision applications.
Video post-processing
Quarter-pixel motion
Cite
Citations (4)
Object detection and object tracking are usually treated as two separate processes. Significant progress has been made for object detection in 2D images using deep learning networks. The usual tracking-by-detection pipeline for object tracking requires that the object is successfully detected in the first frame and all subsequent frames, and tracking is done by associating detection results. Performing object detection and object tracking through a single network remains a challenging open question. We propose a novel network structure named trackNet that can directly detect a 3D tube enclosing a moving object in a video segment by extending the faster R-CNN framework. A Tube Proposal Network (TPN) inside the trackNet is proposed to predict the objectness of each candidate tube and location parameters specifying the bounding tube. The proposed framework is applicable for detecting and tracking any object and in this paper, we focus on its application for traffic video analysis. The proposed model is trained and tested on UA-DETRAC, a large traffic video dataset available for multi-vehicle detection and tracking, and obtained very promising results.
Tracking (education)
Traffic Analysis
Cite
Citations (24)