Publication     Conference     Thesis

City-wide Surveillance with Multiple Cameras

Motivation
  Surveillance cameras are becoming an important asset in homeland security. Many large cities have installed surveillance cameras along city streets to monitor and record human activities. The recorded videos provide valuable information to the police for solving crimes ranging from theft to terrorist activities. To use the information in the videos,
it is necessary to sieve through the videos manually to identify the relevant video segments. A computer system for
automatic analysis of videos will save a lot of manual effort.

An important surveillance application is to track the motion of an object of interest, e.g., a car or a human, using one
or more cameras, and plot the motion path in a city map. This is not a trivial task because the cameras are typically
located sparsely in the city area and they do not overlap in camera views. So, well-known techniques such as multiple-view geometry does not work at all. A novel technique needs to be develop to achieve the goal.
   
Research Goal
 

Our research goal is to develop a framework for city-wide surveillance with multiple cameras. This involves solving several tasks:
> Localization of cameras in city map
> Tracking of moving objects over multiple non-overlapping cameras
> Analysis of motion paths
> Detection of abnormal motion and behavior over wide area

   
Localization of Cameras in City Map
  Given n pairs of corresponding 3D positions and 2D image positions, where the 3D points are approximate, apply an iterative algorithm to determine the location and orientation of a camera in a city map. The difficulty and challenge of this problem is that a camera view is more or less orthogonal to the city map. So, there are very few common features between the two views for a computer vision algorithm to correctly identify corresponding points automatically.
 
  Sample Results

Input: approximte corresponding points in city map and camera view are marked with red crosses.
City map
Camera view
   
Output: Camera position is marked with blue cross in city map. Corresponding points are well mapped through the recovered camera position and orientation.
City map
Camera view
   
Researchers
>> A/Prof. Leow Wee Kheng, Dept. of Computer Science, Natioanl University of Singapore
>> Dr. Cheng-Chieh Chiang, Dept. of Information Technology, Takming University of Science & Technology, Taiwan.
>> Yi-Ping Hung, Dept. Computer Science & Information Engineering, National Taiwan University, Taiwan
   
Publications
>> W. K. Leow, C.-C. Chiang, and Y.-P. Hung. Localization and Mapping of Surveillance Cameras
in City Map, Proc. ACM Int. Conf. on Multimedia, 27 Oct 27- 1 Nov 2008.

3 July 2016