WO2008075635A1

WO2008075635A1 - Imaging device and imaging system

Info

Publication number: WO2008075635A1
Application number: PCT/JP2007/074208
Authority: WO
Inventors: Haruo Kogane
Original assignee: Panasonic Corporation
Priority date: 2006-12-19
Filing date: 2007-12-17
Publication date: 2008-06-26
Also published as: JP2008154073A

Abstract

An imaging system (1) is a system for performing imaging operation while synchronizing multiple imaging devices (10). An imaging device (10) has an operation section (46) for receiving an input of setting information, a communication section (44) for sending the setting information, received by the operation section (46), to other imaging devices (10), and a control section (36) for changing a setting of the imaging device in synchronism with timing at which the other imaging devices (10) change settings based on the setting information sent by the communication section (44). Thus, the settings of the multiple imaging devices are matched to each other.

Description

Specification

Imaging apparatus and imaging system

[0001] This application claims the benefit of Patent Application No. 2006-34 1364, filed in Japan on December 19, 2006, the contents of which are incorporated herein by reference. To do.

Technical field

The present invention relates to a technique for matching settings of a plurality of imaging devices that perform imaging in synchronization.

Yes

Background art

Conventionally, for example, an imaging system using a plurality of imaging devices such as a stereo camera is known. In such an imaging system, there is a need for matching the settings of the imaging conditions of a plurality of imaging devices.

[0004] In the conventional system, when the setting is changed in one imaging device, the setting file of the imaging device is copied to a medium such as a removable disk and transferred to another imaging device.

As a technique for transmitting apparatus setting information using communication means, a technique as disclosed in Japanese Patent Application Laid-Open No. 2001-337797 has been known. In this patent publication, for example, a computer terminal S connected via a communication line such as a LAN, setting information relating to user mode setting is created in accordance with an input from an operator, and the created setting information is set as a device to be set. Send to. The device to which the setting information has been transmitted registers the setting information in the storage memory. Then, the mode can be easily set by selecting the registered user mode in the device.

Disclosure of the invention

Problems to be solved by the invention

[0006] In the technique described in the above-mentioned patent publication, the setting information of the apparatus is transmitted! /, But this method cannot be applied to the setting of the imaging apparatus. Patent gazette technology is a printer, Because it is intended for scanner settings, etc., it can be configured to send information set by the operator! In an imaging device, settings are usually changed while viewing the captured image. Therefore, it is not possible to adopt a configuration in which setting information is created at a location distant from the imaging device.

[0007] Further, for example, when changing settings of an imaging device that is capturing an image in synchronization with a stereo camera or the like, it is necessary to synchronize the timing of setting changes of a plurality of cameras. Stereo cameras display stereoscopic images using the parallax between the left and right images. For example, if the left and right imaging devices have different zoom ratio settings, they will cause inconveniences when stereoscopic images cannot be seen. . In particular, when a stereo camera is used in a surgical operation, there is no need for momentary video distortion!

[0008] In view of the above background, the present invention provides an imaging device and an imaging system capable of matching the settings of a plurality of imaging devices.

Means for solving the problem

An imaging apparatus according to the present invention is an imaging apparatus that performs imaging in synchronization with another imaging apparatus, a setting information reception unit that receives input of setting information related to the settings of the imaging apparatus, and the setting information reception The setting information transmission unit that transmits the setting information received by the setting unit to the other imaging device and the setting change based on the setting information received by the setting information reception unit are transmitted by the setting information transmission unit. A setting change unit configured to synchronize with the timing at which another imaging apparatus changes the setting according to the setting information.

[0010] As described below, there are other aspects of the present invention. Accordingly, the disclosure of the present invention is intended to provide part of the present invention and is not intended to limit the scope of the invention described and claimed herein.

Brief Description of Drawings

FIG. 1 is a diagram illustrating a configuration of an imaging apparatus according to an embodiment.

FIG. 2 is a diagram showing a configuration of an imaging system according to the embodiment.

FIG. 3 is a diagram showing an example of a sharing setting information table

[Figure 4] Figure 4 shows an example of the write timing table.

FIG. 5 is a diagram showing an operation of changing the setting of the imaging system of the embodiment. [FIG. 6] FIG. 6 is a timing chart showing the operation of changing the settings of the imaging system of the embodiment. [FIG. 7] FIG.

BEST MODE FOR CARRYING OUT THE INVENTION

[0012] The following is a detailed description of the present invention. It will be understood that the embodiments described below are merely examples of the present invention, and the present invention can be modified in various ways. Accordingly, the specific configurations and functions disclosed below do not limit the scope of the claims.

Yes

[0013] The imaging apparatus according to the present embodiment is an imaging apparatus that performs imaging in synchronization with another imaging apparatus, a setting information receiving unit that receives input of setting information related to settings of the imaging apparatus, and the setting information A setting information transmission unit that transmits the setting information received by the reception unit to another imaging device, and a setting change based on the setting information received by the setting information reception unit is transmitted by the setting information transmission unit. A setting change unit configured to synchronize with the timing at which the other imaging device changes the setting according to the setting information.

[0014] With this configuration, since the setting is changed in synchronization with the timing at which the other imaging device changes the setting, it is possible to appropriately change the setting of the imaging device while the plurality of imaging devices are operating. Here, the processing unit in which the imaging device executes processing is synchronized with the processing unit of the other imaging device, and the setting change unit obtains the timing of the processing unit in which the other imaging device changes the setting, and the same processing unit Alternatively, the configuration may be changed. In addition, the setting change unit may obtain the next processing unit of the processing unit for which the setting information is transmitted by the setting information transmission unit as a processing unit for which another imaging device changes the setting.

[0015] In the imaging apparatus of the present embodiment, the setting information transmitting unit has a configuration for transmitting difference information indicating a difference between the setting information received by the setting information receiving unit and the current setting information.

[0016] With this configuration, the amount of information transmitted by the imaging apparatus can be reduced.

[0017] The imaging apparatus according to the present embodiment is a table that stores setting information to be shared with other imaging apparatuses, and the setting information input to the setting information receiving unit is to be shared with other imaging apparatuses. A determination unit that determines whether or not the setting information is based on the table, and when the input setting information is determined to be setting information to be shared with another imaging device, The setting information transmission unit has a configuration for transmitting setting information to another device.

[0018] With this configuration, only setting information that should be shared with other imaging devices is transmitted, and it is not necessary to share the setting information. Can reduce the amount

The imaging apparatus according to the present embodiment includes a nonvolatile memory that stores setting information. The setting information to be written and the setting stored in the nonvolatile memory before the setting information is written to the nonvolatile memory. Compared with the information, if the setting information of both is different, the configuration information is written in the nonvolatile memory.

[0020] With this configuration, the setting processing time can be reduced, and the number of times of rewriting the nonvolatile memory can be reduced.

[0021] In the imaging apparatus according to the present embodiment, the setting information receiving unit includes a display unit that displays options of setting information stored in advance, and one of the options displayed on the display unit. And a selection unit that receives an input.

[0022] With this configuration, setting information can be easily set because setting information can be selected from options.

[0023] In the imaging apparatus according to the present embodiment, the setting information receiving unit has a configuration for receiving an input from a keyboard or a pointing device.

[0024] With this configuration, setting information can be easily input using an easy-to-operate interface.

[0025] In the imaging apparatus of the present embodiment, the setting information transmission unit has a configuration for transmitting the setting information to another imaging apparatus via a LAN or the Internet.

[0026] With this configuration, the imaging devices can be easily connected to each other.

[0027] The imaging system according to the present embodiment is an imaging system in which a plurality of imaging devices perform imaging in synchronization, and each imaging device receives setting information regarding setting information regarding the setting of the imaging device. A setting unit based on the setting information received by the receiving unit, the setting information transmitting unit that transmits the setting information received by the setting information receiving unit, and the setting information receiving unit; A setting change unit that synchronizes with the timing at which another imaging device changes the setting according to the setting information sent by the setting information sending unit. It has the structure which I did.

[0028] With this configuration, since the setting is changed in synchronization with the timing when the other imaging device changes the setting, the setting of the imaging device can be appropriately changed while a plurality of imaging devices are operating.

[0029] Hereinafter, an imaging apparatus and an imaging system according to an embodiment of the present invention will be described with reference to the drawings. In the following description, a stereo camera that displays images captured by two imaging devices and can display stereoscopic images using human parallax will be described as an example.

FIG. 1 is a diagram illustrating a configuration of an imaging apparatus 10 according to the embodiment, and FIG. 2 is a diagram illustrating a configuration of the imaging system 1 according to the embodiment.

As shown in FIG. 2, the imaging system 1 of the present embodiment includes two imaging devices 10 and a display monitor 16 that displays an image captured by the imaging device 10. The imaging device 10 includes an imaging element unit 12 and a main body 14. The imaging element unit 12 is not limited to, for example, a force S that can use a CCD or CMOS imaging element. The two imaging devices 10 are connected by an external synchronous connection 18 and perform imaging operations in synchronization. The two imaging devices 10 are connected by an RS232C Cape Nore 20 and can perform bidirectional data communication. As a result, the imaging apparatus 10 can use the force S to exchange setting information.

In the present embodiment, since a stereo camera is taken as an example, the number of imaging devices 10 is two, but the present invention is applied to an imaging system 1 including three or more imaging devices 10. It is also possible to do. In this case, since the accuracy of the oscillation circuit of the device is sufficiently high, the imaging system can be realized by including it in external data communication such as a LAN.

A configuration of the imaging device 10 will be described with reference to FIG. The imaging device 10 includes a lens 22 that collects light from the object, an imaging element unit 12 that converts the light transmitted through the lens 22 into an image signal, and signal processing that matches the imaging element unit 12. The processing unit 24, various signal processing units that perform image processing on the signal output from the preprocessing unit 24, the video signal output unit 34 for outputting the image processed by the signal processing unit, And a control unit 36 for controlling each configuration!

The image sensor unit 12 and the preprocessing unit 24 are connected to a synchronization signal generation control unit 40. The image sensor unit 12 and the preprocessing unit 24 are controlled according to the synchronization signal generated by the synchronization signal generation control unit 40.

The imaging apparatus 10 includes a YC separation processing unit 26, an enhancement signal processing unit 28, and a video signal character information mixing unit 30 as various signal processing units that process the signal output from the preprocessing unit 24. And an encoding unit 32. Each of these signal processing units has the same configuration as that of the normal imaging device 10. Each signal processing unit performs signal processing based on the setting of the setting register 38.

The imaging device 10 includes an external synchronization circuit 42, a communication unit 44, and an operation unit 46 as an interface with the outside. The external synchronization circuit 42 is a circuit for synchronizing with another imaging device 10 connected by the external synchronization connection 18. The communication unit 44 is configured to transmit / receive data to / from another imaging device 10 via the RS232C cable 20. The operation unit 46 is an interface for accepting an operation from the user. The operation unit 46 may be configured by, for example, a keyboard or a pointing device.

The imaging device 10 includes a nonvolatile memory 48. The non-volatile memory 48 stores a shared setting information table, a save specification table, and setting information of the imaging device 10. Note that not all setting information is stored in the nonvolatile memory 48, but only setting information that should be retained when the power is turned off is stored.

FIG. 3 is a diagram illustrating an example of data stored in the sharing setting information table. The shared setting information table is a table for classifying setting information into information that should be shared with other imaging devices 10 and information that need not be shared.

As shown in FIG. 3, in the shared information setting table, “sharing setting information” to be shared by the imaging device 10 in the imaging system 1 and the setting that may be different in each imaging device 10 “non- "Share setting information" is stored. In the example shown in Fig. 3, gain setting, auto gain setting, electronic shutter setting, auto electronic shutter setting, electronic zoom magnification setting, etc. are set as “shared setting information”, and individual camera brightness gain fine adjustment settings, camera individual color gain “Fine adjustment setting force Non-shared setting information”. Thus, for example, when electronic zoom magnification setting information is input, not only the imaging device 10 that has received the input but also all the imaging devices 10 in the imaging system 1 are set to the input electronic zoom magnification. Is done. FIG. 4 is a diagram illustrating an example of data stored in the save designation table. The save specification table is a table indicating setting information to be saved in the nonvolatile memory 48. As shown in FIG. 4, the storage designation table stores a classification of setting information “with non-volatile memory writing” and setting information “with non-volatile memory writing”. The setting information classified as “Non-volatile memory written” is the setting information to be stored in the non-volatile memory. Setting information classified as “Non-volatile memory writing” is not stored in non-volatile memory! /, Setting information.

In the example shown in FIG. 4, the setting information such as gain setting, auto gain setting, electronic shutter setting, auto electronic shutter setting, etc. is “non-volatile memory writing”, and the electronic zoom magnification setting is “non-volatile”. No memory writing ”. For example, when the setting information of the electronic zoom magnification is input or transmitted from another imaging device 10, the force S for setting the setting information of the electronic zoom magnification in the setting register 38, the nonvolatile memory Do not write to 48. Therefore, the setting information of the electronic zoom magnification is reset when the imaging system 1 is turned off.

[0041] Next, the operation of the imaging system 1 of the present embodiment will be described. In the imaging system 1 of the present embodiment, when the setting of one imaging device 10 out of the plurality of imaging devices 10 is changed, the setting change is reflected on the other imaging devices 10.

FIG. 5 is a flowchart showing an operation for changing the setting of the imaging system 1. In FIG. 5, in order to distinguish the two imaging devices 10, they are described as an imaging device 10A and an imaging device 10B. First, one imaging apparatus 10A receives input of setting information from the operation unit 46 (S10). For accepting the input of the setting information, for example, an interface may be employed in which a menu showing setting options is displayed on the screen, and the user selects a desired setting from the menu. Thereby, the user can input setting information appropriately.

[0043] Upon receiving the input of setting information, the imaging device 10A analyzes the input setting information (S12). Subsequently, the imaging apparatus 10A determines whether the input setting information is setting information that should be shared with other imaging apparatuses 10 based on the shared setting information table (S14). . Here, if the input setting information is not the setting information that should be shared with the other imaging device 10 (NO in S14), the imaging device 10A changes its own setting and ends the process. (S26).

[0044] When the setting information input to the imaging device 10A is setting information to be shared with the imaging device 10B (YES in S14), the imaging device 10A includes the current setting information and the changed setting information. A difference message indicating the difference between the two is generated (S16), and the generated difference message is transmitted to another imaging apparatus 10B (S18). After transmitting the difference message, the imaging device 10A waits without changing the setting until the imaging device 1OB is ready to change the setting (S20).

When receiving the differential message (S22), the imaging device 10B analyzes the received differential message (S24). The imaging device 10B obtains the content of the setting information from the received difference message and changes the setting (S28). Specifically, the control unit 36 writes the setting information obtained from the difference message in the setting register 38. When new setting information is written in the setting register 38, the signal processing units such as the YC separation processing unit 26 and the emphasis signal processing unit 28 perform control based on the setting information written in the setting register 38. Further, the imaging device 10A changes the setting at the timing when the imaging device 10B changes the setting (S26). Specifically, the control unit 36 writes the setting information input from the operation unit 46 in the setting register 38. As will be described later, the imaging device 10A obtains the next processing unit of the processing unit that transmitted the difference message as the timing at which the imaging device 10B changes the setting.

FIG. 6 is a timing chart showing the operations of the imaging device 10A and the imaging device 10B from when the setting change is input until the setting is actually changed. The imaging device 10A and the imaging device 10B are synchronously controlled by the synchronization signal generated by the synchronization signal generation control unit 40, and the timing of the processing unit, which is a unit for executing the processing, is aligned. A rectangular signal described in each processing unit indicates a read timing from the image sensor unit 12. The image sensor unit 12 reads the signal during the period when the signal is High. The imaging device 10A and the imaging device 10B start processing at a predetermined time in the processing unit (indicated by times tl to t4 in FIG. 6). Until a predetermined time, input commands and data are queued.

For example, as shown in FIG. 6, the imaging apparatus 10A accepts a setting information input command during the period P1. The input command is queued until time tl and is waiting to be processed. At time tl, the imaging apparatus 10A analyzes and shares the command input at time tl. Judgment whether or not it is presence information, and generation of a difference message (period P2).

[0048] Next, at time t2, the imaging device 10A transmits a differential message to the imaging device 10B (period P3). In the present embodiment, since imaging device 10A and imaging device 10B are directly connected by RS232C cable 20, there is almost no message transmission delay time. Therefore, the period P3 during which the differential message is transmitted from the imaging apparatus 10A and the period P4 during which the imaging apparatus 10B receives the differential message are substantially the same.

[0049] At time t3, the imaging device 10A changes the setting based on the setting change information input in the period P1. Further, the imaging device 10B analyzes the difference message received during the period P3, and changes the setting according to the received difference message. Thereby, the settings of both the imaging device 1 OA and the imaging device 10B are simultaneously changed from the next processing unit.

[0050] Here, an example in which the setting is changed in the processing unit next to the processing unit in which the imaging device 10B has received the difference message is described. The change in the force setting is not necessarily performed after the reception of the difference message. It does not have to be performed in the next processing unit. For example, after receiving a differential message, the setting may be changed after a predetermined processing unit. By determining the number of processing units after which the setting message is changed after reception of the differential message, the imaging device 10A and the imaging device 10B can synchronize the setting change.

Next, storage of setting information in the nonvolatile memory 48 will be described. The imaging device 10 stores the setting information written in the setting register 38 in the nonvolatile memory 48. The timing of storage in the nonvolatile memory 48 may be set immediately after the setting register 38 is changed or before the imaging apparatus 10 is turned off.

FIG. 7 is a diagram illustrating an operation of storing the setting information of the imaging device 10 in the nonvolatile memory 48. First, the imaging apparatus 10 refers to the storage designation table and determines whether the setting information extracted from the setting register 38 is setting information to be stored in the nonvolatile memory 48 (S30). If it is determined that the setting information is classified as “Non-volatile memory writing” (NO in S30), the imaging device 10 does not save the setting information and the setting register 38 Read information.

[0053] If it is determined that the setting information is classified as “with non-volatile memory writing” (YES in S30), the imaging apparatus 10 sets the setting value of the setting information to be written and the non-volatile information. A comparison is made as to whether or not the set value already stored in the memory 48 is! /, !!, NA! / (S32). As a result, if the two setting values do not match (YES in S32), the setting value read from the setting register 38 is written in the nonvolatile memory 48 (S34). If the set values of both match (NO in S32), the imaging apparatus 10 reads the next set information from the setting register 38 without writing the set values.

Heretofore, the configurations and operations of the imaging system 1 and the imaging device 10 of the present embodiment have been described.

[0054] In the imaging system 1 of the present embodiment, when setting information is input to one imaging device 10A, the input setting information is sent to the other imaging device 10B, and is the same as the one imaging device 10A. The settings are changed as follows. As a result, the settings of all the imaging devices 10 included in the imaging system 1 can be changed simply by changing the settings of one imaging device 10A.

The imaging system 1 according to the present embodiment has a function of transmitting the input setting information to any other imaging apparatus 10 in any imaging apparatus 10 included in the imaging system 1. Even if the setting information is input to, it is reflected in the other imaging apparatus 10.

In the imaging device 10 according to the present embodiment, the imaging device 10 to which the setting information is input transmits the setting information to the other imaging device 10 and then the timing at which the other imaging device 10 changes the setting. Then, wait without changing its own setting, and change the setting at the same timing as other imaging devices 10. Thereby, the settings of all the imaging devices 10 in the imaging system 1 are changed at the same time. For example, in a stereo camera, when changing settings such as the zoom rate, the zoom rates of all the imaging devices 10 are changed synchronously, so that stereoscopic images can be viewed appropriately even during or immediately after the change of the zoom rate. .

In the present embodiment, since the setting information is stored in the nonvolatile memory 48, the setting information is retained even if the power is turned off, and the setting information is set when the power is turned on next time. No need to re-enter.

In the present embodiment, when writing the setting information to the nonvolatile memory 48, the setting information to be written is compared with the setting information already stored in the nonvolatile memory 48. If they do not match, the setting information is written to the nonvolatile memory 48, so that the same setting information can be prevented from being written and the number of times of writing can be reduced. This will write Even when a non-volatile memory with a limited number of times is used, the useful life can be extended. As a result, the freedom degree of selection of the non-volatile memory to be used can be increased.

As described above, the power described in detail with reference to the embodiments of the imaging system and the imaging apparatus of the present invention is not limited to the above-described embodiments.

[0060] In the embodiment described above, the force S described in the example in which two imaging devices 10 are directly connected by the RS232C cable 20, the imaging device 10 is connected by a local area network (LAN). It may be connected via the Internet. In this case, for example, a twisted wire cross cable for Ethernet can be connected to the imaging device 10.

In the above embodiment, the communication start state between the plurality of imaging devices 10 may be automatically detected by monitoring power-on and cable wiring.

[0062] In the above embodiment, the configuration may be such that the model ID is exchanged when each imaging device 10 is activated, and it is confirmed whether the setting can be shared.

[0063] In the above embodiment, the shared setting information may be transmitted together with the device ID by the communication start state detection or user operation.

[0064] In the above-described embodiment, the plurality of imaging devices 10 can be arranged with force S according to the usage and the like.

[0065] In the above embodiment, regarding the setting change other than the shared setting information, for example, the setting may be reflected at the timing of closing the menu for each display page of the menu setting.

Yes

[0066] In the above-described embodiment, the plurality of imaging devices 10 are synchronized by connecting them with the external synchronization connection 18. However, the synchronization of the imaging devices 10 is based on a trigger by external communication or synchronization of an internal clock. Means may be used.

[0067] The power of explaining the preferred embodiment of the present invention considered at the present time. It will be understood that various modifications can be made to the present embodiment, and the true spirit and scope of the present invention are understood. It is intended that the appended claims cover all such variations that fall within the scope. As described above, the present invention has an excellent effect of being able to synchronize the timing of setting changes in a plurality of imaging devices, such as a stereo camera, an image recognition system, and a distance measuring device. This is useful for systems that capture images synchronously with multiple cameras.

Claims

The scope of the claims

[1] An imaging device that performs imaging in synchronization with another imaging device,

A setting information receiving unit that receives input of setting information relating to the setting of the imaging device; a setting information transmitting unit that transmits the setting information received by the setting information receiving unit to another imaging device;

A setting change that is performed based on the setting information received by the setting information receiving unit in synchronization with the timing at which another imaging device changes the setting according to the setting information transmitted by the setting information transmitting unit. And

An imaging apparatus comprising:

2. The imaging apparatus according to claim 1, wherein the setting information transmitting unit transmits difference information indicating a difference between the setting information received by the setting information receiving unit and the current setting information.

[3] a table storing setting information to be shared with other imaging devices;

A determination unit that determines, based on the table, whether the setting information input to the setting information receiving unit is setting information to be shared with another imaging apparatus;

2. The imaging device according to claim 1, wherein when the input setting information is determined to be setting information to be shared with another imaging device, the setting information transmission unit transmits the setting information to the other device. .

[4] A non-volatile memory for storing setting information is provided.

Before writing the setting information to the non-volatile memory, the setting information to be written is compared with the setting information stored in the nonvolatile memory. If the setting information is different, the setting information is stored in the non-volatile memory. The imaging device according to claim 1, wherein the imaging device is written to.

[5] The setting information receiving unit

A display unit for displaying pre-stored setting information options;

A selection unit that accepts input of one of the options displayed on the display unit; and

The imaging device according to claim 1, further comprising:

6. The imaging apparatus according to claim 1, wherein the setting information receiving unit receives an input from a keyboard or a pointing device.

7. The imaging apparatus according to claim 1, wherein the setting information transmission unit transmits the setting information to another imaging apparatus via a LAN or the Internet.

[8] An imaging system in which a plurality of imaging devices perform imaging in synchronization,

Each imaging device

Setting change that is performed based on the setting information received by the setting information receiving unit in synchronization with the timing at which another imaging device changes the setting according to the setting information transmitted by the setting information transmitting unit. And

An imaging system comprising: