US9076268B2 - Method and system for analyzing multi-channel images - Google Patents
Method and system for analyzing multi-channel images Download PDFInfo
- Publication number
- US9076268B2 US9076268B2 US13/793,420 US201313793420A US9076268B2 US 9076268 B2 US9076268 B2 US 9076268B2 US 201313793420 A US201313793420 A US 201313793420A US 9076268 B2 US9076268 B2 US 9076268B2
- Authority
- US
- United States
- Prior art keywords
- image
- images
- selected images
- combined
- analyzing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B13/00—Burglar, theft or intruder alarms
- G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
- G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
- G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
- G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
- G08B13/19639—Details of the system layout
- G08B13/19645—Multiple cameras, each having view on one of a plurality of scenes, e.g. multiple cameras for multi-room surveillance or for tracking an object by view hand-over
-
- G06T7/2053—
-
- G06T7/2093—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/254—Analysis of motion involving subtraction of images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/292—Multi-camera tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30232—Surveillance
Definitions
- Methods and system consistent with exemplary embodiments of the inventive concept relate to analyzing multi-channel images, and more particularly, to analyzing multi-channel images received through a plurality of channels, combining the multi-channel images into a single image, and performing a single microprocessor image analysis based on the combined single image.
- An image surveillance system is a system for real-time surveillance or ex post facto check which is constituted by installing a plurality of cameras at a plurality of locations to monitor an area or a plurality of areas.
- the cameras are configured to transmit images obtained by monitoring the locations.
- the image surveillance system may also store the images in a storage device.
- Image signals obtained by the plurality of cameras are transmitted to a device, such as a digital video recorder (DVR) or a network video recorder (NVR), for management convenience, and a user may manage a plurality of channels through which the image signals are transmitted, simultaneously.
- a device such as a digital video recorder (DVR) or a network video recorder (NVR)
- DVR digital video recorder
- NVR network video recorder
- Korean Patent No. 0338421 discloses a method of providing wide-angle moving images by combining and synthesizing a plurality of moving images obtained by a plurality of video cameras through a plurality of channels, respectively.
- a surveillance system adopting the method disclosed in Korean Patent No. 0338421 should have the same number of microprocessors as the channels to analyze the plurality of images. If, however, the number of microprocessors is insufficient to analyze the plurality of images, an alternative method of sequentially analyzing and displaying the plurality of images by using a time-division technique has been used.
- One or more exemplary embodiments provide a method and a system for analyzing multi-channel images for improving the performance and efficiency of a surveillance system by processing and analyzing images based on combined images.
- a method of analyzing multi-channel images including: receiving a plurality of images through a plurality of channels, respectively; combining selected images among the plurality of images into a single image; and performing an image analysis with respect to: entirety of the combined image by treating the selected images as a single image; or each of the selected images in the combined image.
- different image analyzing methods may be applied to at least two of the selected images, respectively.
- the method may further include: obtaining information regarding each of the selected images and determining whether to perform the image analysis with respect to entirety of the combined image by treating the selected images as a single image, or with respect to each of the selected images in the combined image, based on the obtained information.
- the image analysis is performed with respect to entirety of the combined image by treating the selected images as a single image, and, if at least one of the selected images in the combined image is not larger than the reference size, the image analysis is performed with respect to each of the selected images in the combined image.
- the image analysis is performed with respect to entirety of the combined image by treating the selected images as a single image, and if at least one of the selected images in the combined image is constituted by pixels not larger than the reference number of pixels, the image analysis is performed with respect to each of the selected images in the combined image.
- the method of analyzing multi-channel images may include pre-processing the combined image before the performing the image analysis, wherein the pre-processing comprises at least one of image size conversion, color space conversion and color dimension conversion.
- the method of analyzing multi-channel images may include detecting a foreground region in the combined image by processing the entirety of the combined image by treating the selected images as a single image, wherein the performing the image analysis comprises detecting occurrence of camera tempering to at least one of a plurality of cameras, from which the plurality of images are obtained, with respect to each of the plurality of channels.
- the method of analyzing multi-channel images may include: detecting a motion region in the combined image by processing the entirety of the combined image with treating the selected images as a single image; obtaining location information about the motion region; and determining a channel, among selected channels among the plurality of channels, corresponding to the motion region.
- the method of analyzing multi-channel images may include: combining the selected images used for the image analysis into another single image, after performing the image analysis with respect to each of the selected images in the combined image; and outputting the other single image with a result of the image analysis.
- a multi-channel image analyzing system including: an image receiving unit which receives a plurality of images through a plurality of channels, respectively; an image combining unit which combines selected images among the plurality of images into a single image; and an image analyzing unit which performs an image analysis with respect to: entirety of the combined image by treating the selected images as a single image; or each of the selected images in the combined image.
- the image combining unit may be configured to combine a user-selected number of images.
- the image analyzing unit may perform the image analysis with respect to each of the selected images in the combined image by applying different image analyzing methods to at least two of the selected images, respectively.
- the multi-channel image analyzing system may further include an image analyzing method selecting unit which obtains information regarding each of the selected images and determines whether to perform the image analysis with respect to entirety of the combined image by treating the selected images as a single image, or with respect to each of the selected images in the combined image, based on the obtained information.
- the image analyzing method selecting unit determines that all of the selected images in the combined image are larger than a reference size, the image analyzing unit performs the image analysis with respect to entirety of the combined image by treating the selected images as a single image, and if the image analyzing method selecting unit determines that at least one of the selected images in the combined image is not larger than the reference size, the image analyzing unit performs the image analysis with respect to each of the selected images in the combined image.
- the image analyzing method selecting unit determines that all of the selected images in the combined image are constituted by pixels larger than a reference number of pixels, the image analyzing unit performs the image analysis with respect to entirety of the combined image by treating the selected images as a single image, and wherein, if the image analyzing method selecting unit determines that at least one of the selected images in the combined image is constituted by pixels not larger than the reference number of pixels, the image analyzing unit performs the image analysis with respect to each of the selected images in the combined image.
- the multi-channel image analyzing system may further include an image pre-processing unit which performs pre-processing the combined image before the image analyzing unit performs the image analysis, wherein the pre-processing comprises at least one of image size conversion, color space conversion and color dimension conversion.
- the image analyzing unit may include: a foreground detection unit which detects a foreground region in the combined image by processing the entirety of the combined image by treating the selected images as a single image; and an event detecting unit which detects occurrence of camera tempering to at least one of a plurality of cameras, from which the plurality of images are obtained, with respect to each of the plurality of channels.
- the image analyzing unit may include: a foreground detection unit which detects a motion region in the combined image by processing the entirety of the combined image with treating the selected images as a single image; and an event detecting unit which obtains location information about the motion region, and determines a channel, among selected channels in the plurality of channels, corresponding to the motion region.
- the multi-channel image analyzing system may further include an image output unit which: combines the selected images used for the image analysis into another single image, after the image analyzing unit performs the image analysis with respect to each of the selected images in the combined image; and outputs the other single image with a result of the image analysis.
- FIGS. 1A and 1B illustrate system configurations of a surveillance camera system according to exemplary embodiments
- FIG. 2 is a diagram showing a time-division technique used for processing multi-channel images, according to an exemplary embodiment
- FIG. 3 is a schematic diagram showing a configuration of a multi-channel image analyzing system according to an exemplary embodiment
- FIGS. 4A to 4D illustrate methods of combining multi-channel images to a single image, according to exemplary embodiments
- FIGS. 5A and 5B are diagrams showing states of a combination and an analysis of multi-channel images in view of respective components of the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment
- FIG. 6 is a diagram showing an internal configuration of the image analyzing unit which detects an event in an image, according to an exemplary embodiment
- FIG. 7 is a flowchart of operations of an image analysis by the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment.
- FIG. 8 is a flowchart of operations of an image analysis by the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment.
- inventive concept will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments of the inventive concept are shown.
- the inventive concept may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the inventive concept to those skilled in the art.
- Like reference numerals in the drawings denote like elements, and thus their description will be omitted.
- FIG. 1A is a diagram showing a system configuration of a surveillance camera system which monitors an area by displaying images of the monitored area, according to an exemplary embodiment.
- images of the monitored area are converted to electrical image signals by an image detecting device, such as an image sensor included in a camera 1 , and the electrical image signals are output.
- the electrical image signals obtained by the camera 1 are decoded into images by a video decoder 2 if the electrical image signals have been encoded at the camera 1 , and a microprocessor 3 analyzes and processes the decoded image signals.
- the image signals are re-encoded for transmission by a video encoder 4 and are transmitted to an image output 5 such as a display.
- multi-channel images of at least one monitored area are captured and converted to respective electrical image signals by a plurality of surveillance cameras including cameras 1 a , 1 b and 1 c which includes respective image sensors.
- the electrical image signals are decoded by a video decoder 2 if the electrical image signals have been encoded at the plurality of cameras, respectively.
- a plurality of microprocessors including microprocessors 3 a , 3 b and 3 c analyze the decoded image signals of respective channels.
- a video encoder 4 re-encodes the analyzed and processed image signals for transmission to the image output 5 .
- FIG. 2 is a diagram showing a time-division technique used for processing multi-channel images by the single microprocessor.
- the single microprocessor processes a single channel per clock cycle and processes another channel after a clock cycle is completed.
- one channel image signal is processed by one microprocessor. Therefore, as the number of channels increases, the number of microprocessors also increases. Therefore, a method of analyzing images, according to an exemplary embodiment, provides a system in which multi-channel images are combined to be processed by a single microprocessor.
- FIG. 3 is a schematic diagram showing a configuration of a multi-channel image analyzing system according to an exemplary embodiment.
- the multi-channel image analyzing system includes a plurality of cameras including cameras 10 a , 10 b and 10 c which includes respective image sensors.
- the system also includes an image input unit 100 , an image combining unit 200 , an image processing unit 300 , and an image output unit 400 .
- the plurality of cameras are image capturing devices for obtaining images of at least one monitored area.
- the cameras may be arranged to provide multi-channel images of the monitored area.
- the cameras may be image capturing devices that are installed at the at least one monitored area for surveillance, e.g., CCTVs, camcorders, etc.
- the cameras respectively include respective image sensors including image sensors 11 a , 11 b and 11 c for converting captured images to electric image signals.
- the image input unit 100 converts analog image signals input from the plurality of cameras to digital signals.
- FIG. 3 shows that the image input unit 100 corresponding to respective channels is arranged outside the cameras, the image input unit 100 may also be arranged in the respective cameras with the image sensors. Furthermore, the image input unit 100 may include a video decoder 100 a for converting the input analog image signals to digital image signals.
- the image combining unit 200 may combine multi-channel images transmitted from the image input unit 100 to a single image.
- the image combining unit 200 combines the multi-channel images to a single image according to the number of channels and a user-selected method of outputting the multi-channel images.
- FIGS. 4A to 4D illustrate methods of combining multi-channel images to a single image, according to exemplary embodiments.
- FIG. 4A illustrates a result of receiving 16 images with a same size and combining the 16 images to a single image.
- FIG. 4B illustrates a result of receiving eight images with different sizes and combining the eight images to a single image.
- the upper-right image is three times larger than the other images, and the image combining unit 200 may generate a single image by combining the eight images with different sizes.
- the image combining unit 200 generates a single image by combining 13 images, where the center image is larger than images of the other channels.
- FIG. 4D the image combining unit 200 generates a single image by combining images of eight channels.
- the image combining unit 200 may generate a single image by combining a plurality of images by using various methods based on settings of a method of outputting multi-channel images set by a user and may combine images with different sizes.
- the image processing unit 300 processes and analyzes a single combined image or images of respective channels based on the combined image.
- the image processing unit 300 may be embodied as a single chip that could perform storage, calculations, and control functions.
- the image processing unit 300 may process and analyze the entire combined image.
- the images of eight channels are processed and analyzed as a single image.
- the image processing unit 300 may analyze individual images of respective channels. In other words, in a case as shown in FIG. 4A , the image processing unit 300 may individually analyze the 16 images of respective channels.
- the image processing unit 300 processes the largest image, that is, the upper-right image, and seven other images, respectively.
- the image processing unit 300 processes 13 images in a case as shown in FIG. 4C and processes eight images in a case as shown in FIG. 4D .
- the image processing unit 300 may process and analyze a single combined image, the image processing unit 300 may be embodied with a single microprocessor, unlike in the surveillance camera system illustrated in FIG. 1B . Detailed descriptions of operations of the image processing unit 300 will be given below.
- the image processing unit 300 includes an image pre-processing unit 310 , an analysis method selecting unit 320 , and an image analyzing unit 330 .
- the image pre-processing unit 310 of the image processing unit 300 performs necessary image pre-processing prior to analyzing the multi-channel images.
- the image pre-processing may include resizing images, converting color space of images, converting color dimension of images, etc.
- the image pre-processing unit 310 performs image pre-processing on the single combined image, and thus, an overall processing speed may be improved as compared to processing each of the multi-channel images.
- the analysis method selecting unit 320 selects whether to use the single combined image or the multi-channel images, that is, images of respective channels for an image analysis. As described above, if an image analysis is performed on a single image generated by combining the multi-channel images by the image combining unit 200 , resources of the image processing unit 300 may be efficiently utilized. However, some image analyzing methods applicable to images with a size equal to or above a predetermined size may not be applied to a single combined image. Therefore, the analysis method selecting unit 320 selects whether the image analyzing unit 330 analyzes a single combined image or images of respective channels, based on an image analyzing method to be employed.
- an image analyzing method may be selectively applied based on details of information required for analyzing images. It may be also decided how much data required for an image analysis may be extracted based on the size of input images. Therefore, image analyzing methods may differ according to the sizes of individual channel images extracted from a single combined image. Therefore, there are a few restrictions for an analysis of a single combined image with megapixel sizes, whereas applicable functions may be limited for a combination of smaller images.
- the image combining unit 200 needs to generate a combined image having a size of 720 ⁇ 480 pixels. Therefore, in a single combined image, the size of each of the images of respective channels should become 180 ⁇ 120 pixels. Since some image analyzing methods may not be applied to images having a size of 180 ⁇ 120 pixels, the analysis method selecting unit 320 may select to perform an image analysis on individual images of respective channels, not the single combined image.
- the analysis method selecting unit 320 determines whether a detailed image analysis is necessary and provides related information to the image combining unit 200 so that the image combining unit 200 adjusts the number of multi-channel images to be combined into a single image.
- an image analysis may be performed with small input images, and thus, the analysis method selecting unit 320 selects to perform an image analysis on an entire single image generated by combining images of one or more channels.
- image analyzing methods which need detailed information, such as face detection or plate number detection, may be applied to channels corresponding to input images with sizes equal to or above a predetermined size, the analysis method selecting unit 320 selects different image analyzing methods with respect to respective channels.
- the image analyzing unit 330 performs an image analysis on images of respective channels or a single combined image based on a pre-processed single combined image.
- the image analyzing unit 330 may apply image analyzing methods, such as detecting a background region, detecting and tracking a foreground region and objects, detecting particular events, counting objects, detecting camera tampering, detecting faces, etc., without limitation.
- the image analyzing unit 330 may apply different image analyzing methods for respective channels.
- images of respective channels may be individually analyzed according to the applied image analyzing methods.
- the image analyzing unit 330 may perform an image analysis on a combined single image for image analyzing methods that are applicable to small input images, such as detecting camera tampering, and may perform an image analysis on individual images of respective channels for image analyzing methods that are applicable to relatively large input images, such as detecting faces.
- the image output unit 400 outputs results of the image analysis for respective channels in a single combined image.
- the image output unit 400 may not only output an image, but also provide an alarm in a case where a meaningful event is detected by the image analyzing unit 330 .
- the image output unit 400 includes a video encoder 410 and a transmitting unit 420 .
- the video encoder 410 re-encodes results of analyzing images to output the images, whereas the transmitting unit 420 generates and transmits output signals so that a user may view the encoded images via an external device.
- FIGS. 5A and 5B are diagrams showing states of a combination and an analysis of multi-channel images in view of respective components of the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment.
- FIGS. 5A and 5B show two cases, respectively, in which six multi-channel images and nine multi-channel images are input to the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment.
- six individual images are input to the image input unit 100 .
- the images may be respectively obtained by six cameras, where an image obtained by one camera may occupy one channel.
- the image input unit 100 receives and decodes the respective images.
- the image combining unit 200 combines images of one or more channels from among the images received by the image input unit 100 .
- the image input unit 100 receives images from the image input unit 100 .
- six images with different sizes are combined to a single image according to a rule preset by a user.
- the number of images to be combined increases, the number of microprocessors or resources used by a microprocessor for analyzing images decreases, and thus, an image analysis may be performed efficiently.
- images combined by the image combining unit 200 are transmitted to the image processing unit 300 for an image analysis.
- the image pre-processing unit 310 performs pre-processing for analyzing the images combined by the image combining unit 200 .
- the image pre-processing unit 310 may consider the multi-channel images as a single image and may perform the pre-processing the multi-channel images as a single image. In other words, the image pre-processing unit 310 considers a combination of the six images as a single image and performs pre-processing for the single image.
- the image pre-processing unit 310 performs pre-processing based on the images combined by the image combining unit 200 , less resources of the image processing unit 300 may be occupied as compared to a case of performing pre-processing on first through sixth images individually.
- the image analyzing unit 330 performs an image analysis based on the pre-processed combined image.
- the image analyzing unit 330 considers the image generated by combining the first through sixth images as a single image and analyzes the combined image.
- the image analyzing unit 330 may apply an image analyzing method that may be applied to even small images.
- the image analyzing unit 330 performs motion detection on the entire single combined image and obtains location information regarding a region in which a motion is detected. Next, based on a result of combining images by the image combining unit 200 , the image analyzing unit 330 determines a channel corresponding to the region in which the motion is detected.
- the image output unit 400 encodes the combined image again and transmits the encoded image to an external device via a transmitting unit.
- the encoding and transmission may be performed with respect to the combined image instead of each of the six images.
- FIG. 5B shows that, based on a selection by the analyzing method selecting unit 320 , nine channel images are combined into a single image and pre-processing of the images are performed with respect to the single combined image, while the image analysis is performed on individual images.
- the image input unit 100 receives first through ninth images from the respective cameras via respective channels.
- the image combining unit 200 may generate a single image by combining the nine images based on settings.
- the image pre-processing unit 310 performs pre-processing on the combined single image, and thus, the efficiency of utilizing resources of the image processing unit 300 may be improved as compared to a case of performing pre-processing on individual images.
- the image analyzing unit 330 may separate the single combined image back into individual images and perform an image analysis on the individual images. As shown in FIG. 5B , while the image analyzing unit 330 considers the combined image as a single image and performs an image analysis thereto in FIG. 5A , the image analyzing unit 330 separates the combined image into first through ninth images and performs an image analysis respectively on the individual images.
- the reason for selecting this method compared to that of FIG. 5A is that different image analyzing methods may be applied based on sizes of images.
- the image analyzing unit 330 may perform an image analysis on a combined image as shown in FIG. 5A in case of detecting the overall change in the combined image and using an image analyzing method that may be applied to even small images.
- the image analyzing unit 330 may separate a combined image into individual images and perform an image analysis respectively on the individual images as shown in FIG. 5B in a case of using an image analyzing method that may be applied to images with a size equal to or above a predetermined size.
- the image analyzing unit 330 may analyze a combined image by applying various image analyzing methods. Detailed description of a case where the image analyzing unit 330 uses an image analyzing method of detecting an event by separating a foreground and a background will be given below.
- FIG. 6 is a diagram showing an internal configuration of the image analyzing unit 330 which detects an event in an image, according to an exemplary embodiment.
- the image analyzing unit 330 includes a background generating unit 331 , a foreground and object detecting unit 332 , and an event detecting unit 333 .
- the background generating unit 331 generates values corresponding to a region determined as a background which is a region without a motion in a combined image generated by the image combining unit 200 and pre-processed by the image pre-processing unit 310 .
- the background generating unit 331 may detect a background region by using known methods, such as differences between image frames, a local binary pattern (LBP) histogram, a Gaussian mixture model, etc.
- LBP local binary pattern
- the foreground and object detecting unit 332 detects a moving region in the combined image based on a background image generated by the background generating unit 331 and obtains a region determined as a region of an actually moving object.
- a system for automatically detecting a moving object may be useful in a case where it is expensive for a person to monitor all images in a surveillance system.
- the background generating unit 331 and the foreground and object detecting unit 332 may perform corresponding operations on a single combined image. This is because no detailed information is necessary for detecting a background and objects.
- the image analyzing unit 330 may perform an image analysis on an entire combined image or individual images, as an occasion demands.
- the event detecting unit 333 tracks motions of moving object regions according to changes of images in each individual channel.
- the multi-channel image analyzing system according to the present embodiment may automatically inform a user if the event detecting unit 333 detects any meaningful motion.
- the event detecting unit 333 may analyze tracked motion values and may detect and inform of an unauthorized motion or a particular event.
- the event detecting unit 333 may set a threshold value of motions considered as an event. Based on the threshold value, the event detecting unit 333 may not inform of subtle motions, such as trembling of branches due to the wind, and may inform of a motion equal to or exceeding the threshold value, such as a person passing.
- FIG. 7 is a flowchart of operations of an image analysis by the multi-channel image analyzing system of FIG. 3 , according to an exemplary embodiment.
- the image input unit 100 receives a plurality of images captured by the plurality of cameras through a plurality of channels, respectively (S 1 ).
- the image combining unit 200 combines selected channel images from among the plurality of channel images into a single image according to user settings and transmits the single combined image to the image processing unit 300 (S 2 ).
- the image pre-processing unit 310 of the image processing unit 300 performs pre-processing prior to an image analysis (S 3 ).
- the analyzing method selecting unit 320 determines whether an image analyzing method to be applied requires detailed information regarding images to be analyzed (S 4 ).
- the image analyzing unit 330 performs image analysis on the combined image (S 5 ).
- the image analyzing unit 330 determines a region of the combined image in which the particular event is detected (S 6 ).
- the image analyzing unit 330 performs image analysis on individual images (S 7 ).
- the image output unit 400 outputs a result of the image analysis in a single combined image (S 8 ).
- FIG. 8 is a flowchart of operations of an image analysis by the multi-channel image analyzing system of FIG. 3 , according to another exemplary embodiment.
- the analysis method selecting unit 320 obtains information about a reference image size for applying a desired image analyzing method to a single combined image generated by combining selected channel images among a plurality of channel images (operation S 11 ).
- an image analyzing unit performs an image analysis with respect to the entire combined image by treating the selected channel images as a single image using a corresponding image analyzing method (operation S 13 ).
- the image analyzing unit performs an image analysis with respect to each of the individual channel images by using the corresponding image analyzing method (operation S 15 ).
- the image analyzing unit 330 performs an image analysis channel-by-channel only on some individual channel images with sizes smaller than the reference image size by using the corresponding image analyzing method (operation S 16 ).
- the image analyzing unit 330 transmits a result of applying the corresponding image analyzing method using an image output unit (operation S 17 ).
- a multi-channel surveillance system may process and analyze images based on a combined image, and thus, the performance of the surveillance system may be improved.
Abstract
Description
Claims (18)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2012-0025225 | 2012-03-12 | ||
KR1020120025225A KR101747214B1 (en) | 2012-03-12 | 2012-03-12 | Muliti-channel image analyzing method and system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20130236120A1 US20130236120A1 (en) | 2013-09-12 |
US9076268B2 true US9076268B2 (en) | 2015-07-07 |
Family
ID=49114192
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/793,420 Active 2033-08-27 US9076268B2 (en) | 2012-03-12 | 2013-03-11 | Method and system for analyzing multi-channel images |
Country Status (3)
Country | Link |
---|---|
US (1) | US9076268B2 (en) |
KR (1) | KR101747214B1 (en) |
CN (1) | CN103313032B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10922554B2 (en) * | 2019-01-21 | 2021-02-16 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102157765B1 (en) * | 2013-12-24 | 2020-09-18 | 주식회사 케이티 | System for analyzing multi-channel image based on extraction of image transition and method thereof |
CN107424187B (en) | 2017-04-17 | 2023-10-24 | 奥比中光科技集团股份有限公司 | Depth calculation processor, data processing method and 3D image device |
CN108495125B (en) * | 2018-05-04 | 2020-07-21 | 昆山丘钛微电子科技有限公司 | Camera module testing method, device and medium |
KR102459993B1 (en) * | 2020-12-30 | 2022-10-28 | 아진산업(주) | Black box system by using around view monitoring image |
KR20230173481A (en) * | 2022-06-17 | 2023-12-27 | 주식회사 메타캠프 | Apparatus for Metaverse Service by Using Multi-Channel Structure and Channel Syncronizaton and Driving Method Thereof |
CN116886912B (en) * | 2022-12-06 | 2024-02-13 | 广州开得联软件技术有限公司 | Multipath video coding method, device, equipment and storage medium |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5800364A (en) * | 1993-03-01 | 1998-09-01 | Orthotics Limited | Foot orthoses |
KR100338421B1 (en) | 2000-05-03 | 2002-05-27 | 남재열 | Apparatus and method for encoding of wide view video |
US20030234907A1 (en) * | 2002-06-24 | 2003-12-25 | Takashi Kawai | Compound eye image pickup apparatus and electronic apparatus equipped therewith |
US20040057618A1 (en) * | 2002-09-25 | 2004-03-25 | Southwest Research Institute | Interactive computer aided analysis of images from sensor combinations |
US20040075741A1 (en) * | 2002-10-17 | 2004-04-22 | Berkey Thomas F. | Multiple camera image multiplexer |
US20050134941A1 (en) * | 2003-12-18 | 2005-06-23 | Matsushita Electric Industrial Co., Ltd. | Scanner apparatus, method for controlling scanner apparatus and multifuntion apparatus |
KR20060086505A (en) | 2005-01-25 | 2006-08-01 | 금동교 | Digital security system using motion detection and operating method thereof |
KR100853959B1 (en) | 2007-06-19 | 2008-08-25 | 주식회사 씨앤비텍 | System and method for remote surveillance of multi channel video using iptv network |
KR20100033605A (en) | 2008-09-22 | 2010-03-31 | (주) 엑스알플러스 | Mlti-picture image display method and information display method for video supervisory system |
US20100079594A1 (en) * | 2008-09-26 | 2010-04-01 | Harris Corporation, Corporation Of The State Of Delaware | Unattended surveillance device and associated methods |
US8073261B2 (en) * | 2006-12-20 | 2011-12-06 | Axis Ab | Camera tampering detection |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101350916A (en) * | 2008-09-05 | 2009-01-21 | 北京中星微电子有限公司 | Method and apparatus for monitoring camera-shooting of digitization multi-element network |
US8718379B2 (en) * | 2009-09-15 | 2014-05-06 | Texas Instruments Incorporated | Method and apparatus for image capturing tampering detection |
CN101794515B (en) * | 2010-03-29 | 2012-01-04 | 河海大学 | Target detection system and method based on covariance and binary-tree support vector machine |
-
2012
- 2012-03-12 KR KR1020120025225A patent/KR101747214B1/en active IP Right Grant
-
2013
- 2013-03-11 US US13/793,420 patent/US9076268B2/en active Active
- 2013-03-12 CN CN201310077768.4A patent/CN103313032B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5800364A (en) * | 1993-03-01 | 1998-09-01 | Orthotics Limited | Foot orthoses |
KR100338421B1 (en) | 2000-05-03 | 2002-05-27 | 남재열 | Apparatus and method for encoding of wide view video |
US20030234907A1 (en) * | 2002-06-24 | 2003-12-25 | Takashi Kawai | Compound eye image pickup apparatus and electronic apparatus equipped therewith |
US20040057618A1 (en) * | 2002-09-25 | 2004-03-25 | Southwest Research Institute | Interactive computer aided analysis of images from sensor combinations |
US20040075741A1 (en) * | 2002-10-17 | 2004-04-22 | Berkey Thomas F. | Multiple camera image multiplexer |
US20050134941A1 (en) * | 2003-12-18 | 2005-06-23 | Matsushita Electric Industrial Co., Ltd. | Scanner apparatus, method for controlling scanner apparatus and multifuntion apparatus |
KR20060086505A (en) | 2005-01-25 | 2006-08-01 | 금동교 | Digital security system using motion detection and operating method thereof |
US8073261B2 (en) * | 2006-12-20 | 2011-12-06 | Axis Ab | Camera tampering detection |
KR100853959B1 (en) | 2007-06-19 | 2008-08-25 | 주식회사 씨앤비텍 | System and method for remote surveillance of multi channel video using iptv network |
KR20100033605A (en) | 2008-09-22 | 2010-03-31 | (주) 엑스알플러스 | Mlti-picture image display method and information display method for video supervisory system |
US20100079594A1 (en) * | 2008-09-26 | 2010-04-01 | Harris Corporation, Corporation Of The State Of Delaware | Unattended surveillance device and associated methods |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10922554B2 (en) * | 2019-01-21 | 2021-02-16 | Samsung Electronics Co., Ltd. | Electronic apparatus and control method thereof |
Also Published As
Publication number | Publication date |
---|---|
US20130236120A1 (en) | 2013-09-12 |
KR20130104075A (en) | 2013-09-25 |
CN103313032B (en) | 2017-08-25 |
CN103313032A (en) | 2013-09-18 |
KR101747214B1 (en) | 2017-06-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9076268B2 (en) | Method and system for analyzing multi-channel images | |
US20220014717A1 (en) | Analytics-Drived Summary Views for Surveillance Networks | |
KR101942808B1 (en) | Apparatus for CCTV Video Analytics Based on Object-Image Recognition DCNN | |
US10123051B2 (en) | Video analytics with pre-processing at the source end | |
US10084972B2 (en) | Monitoring methods and devices | |
US8922659B2 (en) | Dynamically reconfigurable intelligent video surveillance system | |
KR102334888B1 (en) | Display-based video analytics | |
US9509961B2 (en) | Multichannel video content analysis system using video multiplexing | |
US9549120B2 (en) | Adaptive data path for computer-vision applications | |
US20110221895A1 (en) | Detection of Movement of a Stationary Video Camera | |
JP2010136032A (en) | Video monitoring system | |
KR101365237B1 (en) | Surveilance camera system supporting adaptive multi resolution | |
US9230176B2 (en) | Method of detecting camera tampering and system thereof | |
US9628874B2 (en) | Imaging apparatus and method of providing video summary | |
EP2608151A2 (en) | System for communicating relationship data associated with image characteristics | |
KR102263071B1 (en) | Method for video monitoring, Apparatus for video monitoring and Computer program for the same | |
EP3629577B1 (en) | Data transmission method, camera and electronic device | |
US20200344444A1 (en) | Data transmission method, camera and electronic device | |
JP5769468B2 (en) | Object detection system and object detection method | |
KR102201241B1 (en) | Apaptive Object Recognizing Apparatus and Method for Processing Data Real Time In Multi Channel Video | |
KR102126794B1 (en) | Apparatus and Method for Transmitting Video Data | |
CN110855930B (en) | Intelligent identification method and system for network equipment | |
Mustafah et al. | Smart cameras enabling automated face recognition in the crowd for intelligent surveillance system | |
KR20150121773A (en) | Distributed Intelligent Video Analysis System and Method | |
US20180314886A1 (en) | System and method for automated analytic characterization of scene image data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SAMSUNG TECHWIN CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHOI, EUN-JI;LIM, JEONG-EUN;CHANG, IL-KWON;REEL/FRAME:029963/0912 Effective date: 20130307 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: HANWHA TECHWIN CO., LTD., KOREA, REPUBLIC OF Free format text: CHANGE OF NAME;ASSIGNOR:SAMSUNG TECHWIN CO., LTD.;REEL/FRAME:041428/0429 Effective date: 20150629 |
|
AS | Assignment |
Owner name: HANWHA AEROSPACE CO., LTD., KOREA, REPUBLIC OF Free format text: CHANGE OF NAME;ASSIGNOR:HANWHA TECHWIN CO., LTD;REEL/FRAME:046927/0019 Effective date: 20180401 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: HANWHA AEROSPACE CO., LTD., KOREA, REPUBLIC OF Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME;ASSIGNOR:HANWHA TECHWIN CO., LTD.;REEL/FRAME:048496/0596 Effective date: 20180401 |
|
AS | Assignment |
Owner name: HANWHA TECHWIN CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HANWHA AEROSPACE CO., LTD.;REEL/FRAME:049013/0723 Effective date: 20190417 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
AS | Assignment |
Owner name: HANWHA VISION CO., LTD., KOREA, REPUBLIC OF Free format text: CHANGE OF NAME;ASSIGNOR:HANWHA TECHWIN CO., LTD.;REEL/FRAME:064549/0075 Effective date: 20230228 |