WO2014065336A1

WO2014065336A1 - Insertion system, insertion support device, insertion support method and program

Info

Publication number: WO2014065336A1
Application number: PCT/JP2013/078738
Authority: WO
Inventors: 藤田　浩正; 良東條
Original assignee: オリンパス株式会社
Priority date: 2012-10-25
Filing date: 2013-10-23
Publication date: 2014-05-01
Also published as: CN104755007B; EP2912987A4; US20150223670A1; JP2014083289A; EP2912987A1; JP6128796B2; CN104755007A

Abstract

Insertion state information about an insertion unit which is inserted into a body is acquired by means of an insertion state acquisition unit (61); shape information about the body is acquired by a body shape acquisition unit (62); and the insertion state information and body shape information are inputted into a positional relation calculation unit (63) and the positional relation of the insertion unit relative to the body is calculated. Then, when the calculation result of the positional relation calculation unit (63) is outputted by an output unit (64), the output state of the calculation result in the output unit (64) is controlled by a control unit (66).

Description

Insertion system, insertion support apparatus, insertion support method, and program

The present invention provides an insertion system for inserting and inserting an insertion part of an insertion tool such as an endoscope or a catheter into an inserted body, and assisting the insertion of the insertion part into the inserted body in such an insertion system. The present invention relates to an insertion support apparatus, an insertion support method, and a program for causing a computer to execute a procedure of the insertion support apparatus.

As an assisting device for observing by inserting the insertion portion into the inserted body, for example, in Patent Document 1, when inserting the endoscope insertion portion into a human body, the shape of the endoscope insertion portion is displayed on the display portion. The structure which displays is disclosed.

This is because, in an endoscope apparatus, a plurality of flexible bending detection optical fibers each having a bending detection portion whose amount of light transmission changes in accordance with the angle of the bent angle is formed into a flexible belt-shaped member. It is attached in a state where it is arranged in parallel, and it is inserted and arranged over almost the entire length in the endoscope insertion part, and the bending state of the belt-like member in the part where each bending detection part is located from the light transmission amount of each bending detection optical fiber. The bending state is detected and the bending state of the endoscope insertion portion is displayed on the monitor screen.

US Pat. No. 6,846,286

In general, there are few places to be marked in the inserted body, and if it is difficult to determine which part of the inserted body is observed from the captured image alone, it is also possible to capture (observe) all the necessary parts. hard.

The technique disclosed in Patent Document 1 can present the shape of the insertion portion inside the inserted body that cannot be seen from the outside of the inserted body when inserted into the inserted body. However, it has not been proposed to detect which part of the inserted body is imaged (observed) and to display it.

Further, even in a tubular insertion tool such as a catheter that does not have an imaging unit but is inserted into the inserted body and performs a predetermined work, a detection method and a method for displaying the position inside the inserted body Is also desired.

The present invention has been made in view of the above points, and is an insertion that can provide an operator with information for determining where in the body to be imaged or where the user is working. It is an object to provide a system, an insertion support apparatus, an insertion support method, and a program.

According to the first aspect of the present invention, the insertion portion to be inserted into the inserted body, the insertion state acquiring portion for acquiring the insertion state information of the insertion portion, and the target for acquiring the shape information of the inserted body. An insertion body shape acquisition unit, a positional relationship calculation unit that inputs the insertion state information and the inserted body shape information and calculates a positional relationship of the insertion unit with respect to the inserted body, and a calculation of the positional relationship calculation unit An insertion system having an output unit for outputting a result and a control unit for controlling an output state of the calculation result at the output unit is provided.

Further, according to the second aspect of the present invention, in the insertion support device for supporting the insertion of the insertion part of the insertion tool into the inserted body, an insertion state acquisition part for acquiring insertion state information of the insertion part; Positional relationship for calculating the positional relationship of the insertion part with respect to the inserted body by inputting the inserted body shape acquisition unit that acquires the shape information of the inserted body, the insertion state information, and the inserted body shape information An insertion support device is provided that includes a calculation unit, an output unit for outputting the calculation result of the positional relationship calculation unit as display information, and a control unit for controlling the output state of the calculation result in the output unit. The

According to the third aspect of the present invention, in the insertion support method used in the insertion support apparatus for supporting the insertion of the insertion part of the insertion tool into the inserted body, the insertion state information of the insertion part is acquired. An insertion state acquisition step, an inserted body shape acquisition step for acquiring shape information of the inserted body, the insertion state information and the inserted body shape information are input, and the position of the insertion portion with respect to the inserted body Insertion support comprising: a positional relationship calculation step for calculating a relationship; an output step for outputting the calculation result of the positional relationship calculation step as display information; and a control step for controlling the output state of the calculation result at the output step A method is provided.

Further, according to the fourth aspect of the present invention, the insertion state acquisition procedure for acquiring the insertion state information of the insertion part in the insertion support device that supports the insertion of the insertion part of the insertion tool into the inserted body. And an insertion object shape acquisition procedure for acquiring the insertion object shape information, the insertion state information and the insertion object shape information, and calculating a positional relationship of the insertion portion with respect to the insertion object. Provided is a program that executes a positional relationship calculation procedure, an output procedure for outputting the calculation result of the positional relationship calculation procedure as display information, and a control procedure for controlling the output state of the calculation result in the output procedure Is done.

According to the present invention, it is possible to provide information for determining where in the inserted body an image or work is being performed, so what part of the inserted body is being imaged or worked, and where necessary. Provided an insertion system, an insertion support device, an insertion support method, and a program capable of making it easy for an operator to determine whether all of the images have been taken or worked, and preventing oversight of an observation or work place can do.

In addition, according to the present invention, in outputting the positional relationship of the insertion portion with respect to the insertion object calculated by the positional relationship calculation unit at the output unit, by setting at least the output start time by the control unit, always Since it is output only when necessary, it is not output, so that it is possible to provide easy-to-understand output (easy to see, easy to make mistakes, and can be judged quickly) without providing unnecessary information.

FIG. 1A is a diagram showing a schematic configuration of an insertion system to which an insertion support apparatus according to the first embodiment of the present invention is applied. FIG. 1B is a block configuration diagram of the insertion support apparatus according to the first embodiment. FIG. 1C is a diagram for explaining an example of provision of information by the output unit of the insertion support apparatus according to the first embodiment. FIG. 2A is a diagram illustrating a schematic configuration of a flexible endoscope apparatus as an insertion tool in the insertion system according to the first embodiment. FIG. 2B is a perspective view of the distal end of the insertion portion. FIG. 3A is a diagram for explaining a configuration of an insertion / rotation detection unit. FIG. 3B is a diagram for explaining the operation principle of the insertion / rotation detection unit. FIG. 4 is a diagram illustrating an insertion state of the insertion portion into the inserted body. FIG. 5A is a diagram illustrating a case where the bending portion is bent in the upward direction on the paper surface for explaining the principle of the fiber shape sensor. FIG. 5B is a diagram illustrating a case where the bending portion is not curved for explaining the principle of the fiber shape sensor. FIG. 5C is a diagram illustrating a case where the bending portion is bent in a downward direction in the drawing for explaining the principle of the fiber shape sensor. FIG. 6 is a view showing a structure for attaching the fiber shape sensor to the insertion portion. FIG. 7 is a diagram illustrating an operation flowchart of the insertion support apparatus according to the first embodiment. FIG. 8A is a diagram for describing an example of an entrance / exit of an insertion target body. FIG. 8B is a diagram for explaining another example of the entrance / exit of the inserted object. FIG. 8C is a diagram for explaining still another example of the entrance / exit of the inserted object. FIG. 8D is a diagram for explaining another example of the entrance / exit of the inserted object. FIG. 9A is a diagram for explaining where the first position display shows in the inserted body. FIG. 9B is a diagram for explaining where the second position display shows in the inserted body. FIG. 10 is a timing chart for explaining the output timing of the output unit under the control of the control unit. FIG. 11 is a diagram for explaining another example of a form of providing information. FIG. 12A is a diagram for explaining a display example when an insertion unit is inserted into an insertion object with a branch as yet another example of a form of providing information. FIG. 12B is a diagram for explaining another display example. FIG. 12C is a diagram for explaining still another display example. FIG. 13A is a diagram illustrating a state before rotation for explaining a change in a captured image due to rotation of the insertion unit. FIG. 13B is a diagram illustrating a state after rotation for explaining a change in a captured image due to rotation of the insertion unit. FIG. 14A is a diagram for describing another example of a form of providing information. FIG. 14B is a diagram for explaining still another example of the information provision form. FIG. 14C is a diagram for describing another example of a form of providing information. FIG. 14D is a diagram for explaining yet another example of the information provision form. FIG. 14E is a diagram for describing another example of a form of providing information. FIG. 14F is a diagram for describing still another example of the information provision form. FIG. 15 is a diagram for explaining still another example of the information provision form. FIG. 16A is a block diagram of an insertion system according to the second embodiment of the present invention. FIG. 16B is a diagram for explaining an example of provision of information by the display device of the insertion system according to the second embodiment and the output unit of the insertion support device according to the second embodiment of the present invention. FIG. 17 is a diagram showing a schematic configuration of a rigid endoscope apparatus as an insertion tool in the insertion system according to the third embodiment of the present invention. FIG. 18 is a diagram showing a schematic configuration of a catheter as an insertion tool in the insertion system according to the fourth embodiment of the present invention.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

[First Embodiment]
As shown in FIG. 1A, an insertion system 1 according to the first embodiment of the present invention includes an insertion unit 31 that is inserted into an inserted body 2 and an imaging unit 32 that images the inserted body 2. 3, the insertion / rotation detection unit 4 and the fiber shape sensor 5 as detection units for detecting displacement amount information of the insertion unit 31, and the insertion unit based on the displacement amount information from the insertion / rotation detection unit 4 and the fiber shape sensor 5. The insertion state information of 31 is acquired, the positional relationship of the insertion part 31 with respect to the insertion object 2 is calculated based on the insertion state information and the shape information of the insertion object 2, and the calculation result is displayed and output. And an insertion support apparatus 6 according to the first embodiment of the invention.

Hereinafter, in the present embodiment, the insertion tool 3 will be described as a flexible endoscope device as shown in FIG. 2A, for example. This flexible endoscope apparatus includes an insertion unit 31 and an operation unit 33 configured integrally with the insertion unit 31. The insertion portion 31 is a flexible tubular member and can be inserted into the inserted body 2 from the insertion port 21 of the inserted body 2. Note that the inside of the insertion object 2 is filled with a predetermined material such as air, physiological saline, or a chemical solution. As shown in FIG. 2B, an imaging opening 34 is provided at the end of the insertion portion 31 in the insertion direction (hereinafter referred to as the insertion portion distal end), and in the vicinity of the insertion portion distal end inside the insertion portion 31. As shown in FIG. 1A, an imaging unit 32 is built in. The light incident on the imaging opening 34 is received by the imaging unit 32 and imaged. The image captured by the imaging unit 32 is displayed and output by the insertion support device 6 according to the first embodiment.

The imaging unit 32 is disposed not in the vicinity of the distal end of the insertion unit inside the insertion unit 31 but in the operation unit 33, and is connected to the imaging opening 34 by a light guide or the like, and is incident on the imaging opening 34. Of course, the image may be guided to the imaging unit 32 to perform imaging.

The insertion portion 31 has a bending portion 35 in the vicinity of the distal end of the insertion portion. The bending portion 35 is connected by an operation lever provided in the operation portion 33 and a wire, although not particularly illustrated. Yes. Accordingly, the wire is pulled by moving the operation lever, and the bending operation of the bending portion 35 is possible.

Although not shown, the insertion portion 31 has an illumination optical fiber, guides light from an illumination light source (not shown) disposed in the operation portion 33, and inserts the insertion portion 31. The light is emitted from the tip light supply unit 36 as illumination light for imaging. Further, a treatment opening 37 is provided at the distal end of the insertion portion, and a treatment instrument inserted through the insertion portion 31 from the operation portion 33 can extend out of the insertion portion 31 from the treatment opening 37. Yes.

Hereinafter, the configuration of each unit will be described in detail.
The insertion / rotation detection unit 4 is installed in the vicinity of the insertion port 21 of the inserted body 2, detects the insertion amount and rotation amount of the insertion unit 31, and inserts support as one of the displacement amount information of the insertion unit 31. Output to device 6. Specifically, the insertion / rotation detection unit 4 includes a light source 41, a light projection lens 42, a light reception lens 43, an optical pattern detection unit 44, and a displacement amount calculation unit 45, as shown in FIG. 3A.

The light emitted from the light source 41 is applied to the insertion unit 31 through the light projecting lens 42, and the light reflected by the insertion unit 31 is received by the optical pattern detection unit 44 through the light receiving lens 43. The optical pattern detection unit 44 continuously detects the image of the insertion unit 31 surface, which is an optical pattern, with detection times t ₀ , t ₁ , t ₂ ,..., T _n ,.

As shown in FIG. 3B, the displacement amount calculation unit 45 is an arbitrarily selected reference pattern that exists in an image (optical pattern PT _n ) of image data captured at an arbitrary time t _n by the optical pattern detection unit 44. alpha and, this time t _n of the image data captured to a time t _{n + 1} after the lapse of an arbitrary time from the image (optical pattern PT n _{+ 1)} optical pattern consistent with the reference pattern alpha present in part of the alpha ' The displacements on the image data are compared, and the displacement amounts on the images in the x-axis direction and the y-axis direction are calculated. Here, as shown in FIG. 3B, the optical pattern detection unit 44 is positioned so that the x-axis of the optical pattern detection unit 44 coincides with the axial direction of the insertion unit 31. Therefore, the displacement amount Δx _f in the x-axis direction calculated by the displacement amount calculation unit 45 is proportional to the insertion amount of the insertion unit 31, and the displacement amount Δy _f in the y-axis direction is proportional to the rotation amount of the insertion unit 31. The displacement amount (insertion amount and rotation amount) on the image thus calculated by the displacement amount calculation unit 45 is output to the insertion support device 6 as displacement amount information. In addition, since the increase / decrease direction of each displacement amount shows the direction of insertion and rotation of the insertion part 31, the displacement amount information also includes information on the insertion direction and the rotation direction.

The acquisition of the displacement amount information is not limited to the above method, and may be obtained based on image data.

Further, the fiber shape sensor 5 is installed inside the insertion portion 31 as shown in FIG. The fiber shape sensor 5 is composed of a plurality of optical fibers, and has one curvature detection unit 51 in one optical fiber. The curvature detection unit 51 is configured by removing the clad of the optical fiber and exposing the core, and applying a light absorbing member. In such a curvature detection unit 51, as shown in FIGS. 5A to 5C, the amount of light absorbed by the curvature detection unit 51 changes according to the curvature of the bending unit 35. The amount of light to be changed changes, that is, the amount of light transmission changes. In the present embodiment, the fiber shape sensor 5 is composed of a plurality of optical fibers, but is not limited thereto, and may be a single optical fiber.

The fiber shape sensor 5 configured as described above includes two curve detectors facing the X-axis direction and the Y-axis direction, respectively, in order to detect the X-axis curve and the Y-axis curve shown in FIG. Two optical fibers 52 are arranged so that 51 becomes a pair, and the amount of bending at one place is detected. And the some optical fiber 52 is arrange | positioned so that the curvature detection part 51 used as a pair may be arrange | positioned along with the longitudinal direction (insertion direction) of the insertion part 31. FIG. Then, light from a light source (not shown) is guided by each optical fiber 52, and a light transmission amount that changes depending on the bending amount of each optical fiber 52 is detected by a light receiving unit (not shown). The detected light transmission amount is output to the insertion support device 6 as one piece of displacement amount information of the insertion unit 31.

In addition, the curvature detection part 51 is provided not only in the bending part 35 of the insertion part 31 but also on the operation part side from that, so that the flexibility of the insertion part 31 can be used according to the internal structure of the inserted body 2. It is desirable to be able to detect the bending state of the portion other than the bending portion 35 of the insertion portion 31 that is freely bent.

As shown in FIG. 6, an illumination optical fiber 38 and an imaging portion wiring 39 are also provided inside the insertion portion 31. The imaging unit 32 is a dark part by guiding light from an illumination light source (not shown) disposed in the operation unit 33 by the illumination optical fiber 38 and emitting it as illumination light from the distal end of the insertion unit. The inside of the insert 2 can be imaged.

In addition, as illustrated in FIG. 1B, the insertion support device 6 according to the present embodiment includes an insertion state acquisition unit 61, an inserted body shape acquisition unit 62, a positional relationship calculation unit 63, an output unit 64, and a storage unit 65, and The control unit 66 is configured.

Based on the displacement amount information output from the displacement amount calculation unit 45 of the insertion / rotation detection unit 4, the insertion state acquisition unit 61 inserts at least a part of the insertion unit 31 into the inserted object 2. For example, the position and orientation of a certain point of the insertion unit 31 are acquired. Further, based on the light transmission amount that changes depending on the bending amount of each optical fiber 52 as the displacement amount information detected by the fiber shape sensor 5, as insertion state information into the inserted body 2, the insertion portion 31 further includes The position and orientation of each curvature detection unit 51 are acquired.

The inserted body shape acquisition unit 62 acquires the shape information (inserted body shape information) of the inserted body 2. The inserted body shape information is configured based on data from the outside or the inside of the inserted body 2 before the insertion portion 31 is inserted into the inserted body 2.

In other words, the insertion object shape information based on data from the outside uses, for example, a CT diagnostic apparatus, an ultrasonic diagnostic apparatus, an X-ray apparatus, or the like that can be detected by being transmitted through the insertion object 2. Configured.

Further, the inserted object shape information based on the data from the inside uses the trajectory data when the insertion part 31 is moved in the space of the inserted object 2 or when the tip of the insertion part contacts the inserted object 2. It is configured by connecting position information. If position information at the time of contact between the distal end of the insertion portion and the inserted body 2 is used, the size of the space can be detected, and more accurate inserted body shape information can be acquired. Moreover, when the to-be-inserted body 2 is a human internal organ, it can comprise by estimating from a physique, and when the to-be-inserted body 2 is a structure, it can also comprise by inputting a shape with drawing. .

In addition, the acquisition of the inserted body shape information by the inserted body shape acquisition unit 62 may be performed by connecting a device constituting the inserted body shape information such as a CT diagnostic apparatus and directly acquiring the information. The inserted object shape information output from the apparatus may be temporarily stored in a storage medium, and the stored inserted object shape information may be read out or downloaded via a network and acquired. Absent. Furthermore, the insertion object shape acquisition unit 62 is not limited to such an interface or data reader, and may itself be a device that constitutes the insertion object shape information.

The positional relationship calculation unit 63 is an insertion unit for the inserted body 2 based on the insertion state information acquired by the insertion state acquisition unit 61 and the inserted body shape information acquired by the inserted body shape acquisition unit 62. 31 is calculated, that is, where the entire insertion portion 31 and the distal end are directed toward the inserted body 2. Specifically, the positional relationship calculation unit 63 firstly determines the shape information of the insertion unit 31 based on the position and orientation of each curvature detection unit 51 of the insertion unit 31 as the insertion state information acquired by the insertion state acquisition unit 61. Is calculated. Then, for example, the obtained shape information of the insertion portion 31, the position and orientation of a certain point of the insertion portion 31 as the insertion state information acquired by the insertion state acquisition portion 61, and the inserted object shape acquisition portion 62. Based on the to-be-inserted body shape information acquired in step 1, the positional relationship of the insertion portion 31 with respect to the to-be-inserted body 2, that is, the direction (axial direction) facing the position of the distal end of the insertion portion is calculated. Then, based on the calculation result and the inserted body shape information, the intersection point between the direction in which the distal end of the insertion portion faces and the inserted body 2 is calculated. That is, as shown in FIG. 4, the positional relationship calculation unit 63 has an intersection 72 between the straight line formed in the direction in which the distal end of the insertion unit faces (imaging direction 71) and the shape of the inserted body 2, that is, the visual field (imaging region). 73) The center is obtained as the imaging position P.

Usually, since the point of interest to be observed is caught at the center of the visual field, the center is often more important than the periphery of the visual field. Here, an example in which the intersection is obtained as the imaging position P has been shown, but the imaging unit 32 captures an image from the distance between the position of the distal end of the insertion unit and the imaging surface of the inserted body 2 based on the inserted body shape information. The field of view (imaging area 73) that is the area of the inserted object 2 that is inserted may be calculated as the imaging position P. In this case, if parameters such as the refractive index of a predetermined material interposed between the insertion portion 31 and the inserted body 2 and the angle of view information (such as the focal length of the lens) of the imaging portion 32 are used, the imaging region is more accurately detected. 73 can be obtained. Thus, by obtaining the imaging region 73 as the imaging position P, the range captured by the imaging unit 32 can be grasped. In addition, a partial region 74 or a point in the field of view (imaging region 73) may be calculated as the imaging position P. For example, when the imaging region 73 cannot be accurately detected, it is possible to prevent erroneous detection that a non-imaging range has been captured by calculating a small region in consideration of the error. That is, observation omission can be prevented.

The positional relationship calculation unit 63 obtains the obtained shape information of the insertion portion 31 and the obtained positional relationship of the insertion portion 31 with respect to the inserted body 2, that is, the direction (axial direction) facing the position of the distal end of the insertion portion. The inserted body shape information acquired by the inserted body shape acquisition unit 62 and the imaging position information indicating the obtained imaging position P (for example, the intersection 72) are output to the control unit 66 as a calculation result.

The output unit 64 is configured so that the operator can determine where the tip of the insertion unit faces in the inserted body 2 from the calculation result of the positional relationship calculation unit 63 under the control of the control unit 66. Display output. The output unit 64 also functions as a display unit that can display the captured image obtained from the imaging unit 32.

The storage unit 65 stores the calculation result of the positional relationship calculation unit 63 and the captured image obtained from the imaging unit 32 under the control of the control unit 66.

The control unit 66 controls the output state of the display output in the output unit 64 and the storage in the storage unit 65 of the calculation result of the positional relationship calculation unit 63. That is, the calculation results from the positional relationship calculation unit 63 are sequentially output to the control unit 66, but the control unit 66 causes the output unit 64 to display and output all of the output calculation results. For the imaging position information indicating at least a part of the imaging position P (for example, the intersection 72), the presence / absence of the display output, that is, the display output start time and the display output end time is controlled, or the calculation result is displayed. The type of display, that is, the display method is controlled. Similarly, the storage in the storage unit 65 is controlled so that at least a part of the calculation result output from the positional relationship calculation unit 63 is stored. Further, not only the calculation result of the positional relationship calculation unit 63 but also the storage of the captured image from the imaging unit 32 can be similarly controlled.

For example, the control unit 66 can include a determination unit 67 that determines whether the distal end of the insertion unit has reached a predetermined position. Here, the “predetermined position” refers to a portion that requires observation or treatment inside the inserted body 2. The determination unit 67 makes this determination based on a part of the calculation result output from the positional relationship calculation unit 63, that is, the shape information of the insertion unit 31, the direction (axial direction) facing the position of the distal end of the insertion unit, and the target. This is performed based on the insert shape information, or is performed by pattern matching or the like from the captured image obtained from the imaging unit 32. Then, the control unit 66 controls the output unit 64 and the storage unit 65 based on the determination result of the determination unit 67.

The control unit 66 also has a function of sending information stored in the storage unit 65 (calculation results of the positional relationship calculation unit 63, captured images, etc.) to the output unit 64 for display.

The operation of the insertion support apparatus 6 configured as described above will be described with reference to FIG. Here, for simplification of description, the calculation result of the positional relationship calculation unit 63 by the control unit 66, that is, the output state of the display output at the output unit 64 of the imaging position P (for example, the intersection 72), and the storage The storage control in the unit 65 will be described by taking as an example a case where only display output and storage start control are performed.

First, the insertion object shape information is acquired by the insertion object shape acquisition unit 62 (step S1). Thereafter, the insertion state acquisition unit 61 acquires the insertion state information of the insertion unit 31 into the inserted body 2 (step S2). And the shape of the insertion part 31 is calculated by the positional relationship calculation part 63 based on the position and direction of each curvature detection part 51 of the insertion part 31 as insertion state information (step S3). Thereafter, based on the calculated shape of the insertion portion 31, the position and orientation of a point of the insertion portion 31 as the acquired insertion state information, and the acquired insertion target shape information, the insertion target 2 The positional relationship of the insertion portion 31 with respect to the angle, that is, the direction (axial direction) facing the position of the distal end of the insertion portion is calculated (step S4).

Then, the determination unit 67 of the control unit 66 determines whether or not the distal end of the insertion unit has reached a predetermined position (step S5). For example, when the bladder is taken as an example of the inserted body 2, whether or not the distal end of the insertion portion has reached a predetermined position is determined based on whether the distal end of the insertion portion 31 inserted from the urethral opening, which is the insertion port 21. It is determined whether or not the entrance / exit 22 of the bladder as shown in 8A, that is, the connecting portion between the bladder and the urethra has been reached. Or it can also be judged by whether or not the distal end of the insertion portion has reached a predetermined distance from the bladder wall, for example, a distance of about 2 cm. Whether the predetermined distance from the doorway 22 or the bladder wall has been reached is obtained from the calculation result (position of the distal end of the insertion section and the inserted body shape information) output from the positional relationship calculation section 63 or from the imaging section 32. This can be determined from the captured image. Alternatively, it is possible to determine from the captured image obtained from the imaging unit 32 based on whether or not the blood vessel interval of the bladder wall has become approximately 100 pixels, for example. Further, since the imaging unit 32 cannot obtain a captured image suitable for observation even if it is too close to the subject, the predetermined position can have a range. For example, the distance between the bladder wall and the bladder wall may be approximately 2 cm to 5 mm in terms of distance, and the blood vessel interval of the bladder wall may be in the range of approximately 100 pixels to approximately 500 pixels in terms of pixels.

Here, when the distal end of the insertion portion has not yet reached the predetermined position, a part of the calculation result output from the positional relationship calculation unit 63 by the control unit 66, that is, the shape information of the insertion unit 31, After causing the output unit 64 to display the insertion state of the insertion portion 31 with respect to the shape of the inserted body 2 based on the direction (axial direction) facing the position of the distal end of the insertion section and the inserted body shape information ( In step S6), the above operation is repeated from step S2.

Thus, when the distal end of the insertion unit reaches a predetermined position, the control unit 66 displays on the output unit 64 imaging position information indicating the imaging position P (for example, the intersection 72) that is a part of the calculation result. While outputting, it is made to preserve | save in the memory | storage part 65 (step S7). Thereafter, the above operation is repeated from step S2.

With this operation, the output unit 64 displays as shown in FIG. 1C. That is, in the present embodiment, the output unit 64 displays and outputs the captured image (captured image display 641) from the imaging unit 32 and the insertion state (insertion state display 642) of the insertion unit 31. Here, the insertion state display 642 is displayed and output as two-dimensional diagrams 6421 and 6422 obtained by dividing the inserted body 2 as the inserted body shape information by a predetermined portion. Further, on the two-dimensional diagrams 6421 and 6422 obtained by dividing the inserted body 2 by a predetermined location, the imaging position P, that is, the intersection 72 between the inserted body 2 and the axial direction (imaging direction 71) of the distal end of the insertion portion is concerned. Information is displayed and output. Here, the two-dimensional diagrams 6421 and 6422 are generated by the control unit 66 based on the shape information of the insertion unit 31. That is, the first two-dimensional diagram 6421 is a diagram showing a state in which the shape of the object to be inserted 2 is divided by the YZ plane at the coordinates of the object to be inserted 2 and opened left and right as shown in FIG. 9A. As shown in FIG. 9B, the second two-dimensional view 6422 is a view from a different viewpoint from the first two-dimensional view 6421. As shown in FIG. It is a figure which shows the state opened by dividing up and down. Then, the control unit 66 causes the current position display 643 to be displayed and output as information related to the imaging position P on the two-dimensional diagrams 6421 and 6422 of the output unit 64.

However, the current position display 643 is not always performed. That is, as shown in FIG. 10, when the insertion system starts operating at time T1, the captured image display 641 starts immediately, but the current position display 643 on the two-dimensional diagrams 6421 and 6422 is not displayed. The display output of the current position display 643 on the two-dimensional diagrams 6421 and 6422 is started only when the determination unit 67 of the control unit 66 determines that the distal end of the insertion unit has reached a predetermined position (time T2). . The display output of the captured image display 641 and the display output of the current position display 643 on the two-dimensional diagrams 6421 and 6422 are continued until the insertion system is terminated at time T4. Alternatively, regarding the current position display 643 on the two-dimensional diagrams 6421 and 6422, the determination unit 67 of the control unit 66 also determines that the distal end of the insertion unit has returned before a predetermined position, and at that time ( The display output may be terminated at time T3).

The current position display 643 may be the intersection 72 itself between the inserted body 2 and the axial direction of the distal end of the insertion portion. However, as described above, the imaging region 73 is used, or for example, the intersection 72 is the center. It is easier to visually recognize a certain range such as a partial region 74 in the imaging region.

Further, the output unit 64 can display and output an insertion portion shape schematic display 644 indicating the shape of the insertion portion 31 in addition to the current position display 643 as information relating to the current imaging position P. That is, since the shape of the insertion portion 31 and the position and orientation of the insertion portion tip are calculated by the positional relationship calculation portion 63 as described above, what is the insertion state of the insertion portion 31 in the inserted body 2? The insertion portion shape outline display 644 can be performed.

Furthermore, the output unit 64 can also display and output the position trajectory display 645 using the calculation result stored in the storage unit 65. The calculation result stored in the storage unit 65 can also be stored from the time (time T2) when the distal end of the insertion unit reaches a predetermined position based on the determination of the determination unit 67. It should be noted that the position trajectory display 645 also has a certain range similar to the current position display 643. Further, in this case, in order to distinguish between the current position display 643 and the position locus display 645, some identification display is performed such as changing each other's color, density, and pattern, or making the position locus display 645 blinking. Display information is desirable. This identification display form may be controlled by the control unit 66 in response to selection by an operator's switch operation. In this case, the switch includes the operation unit 33 of the flexible endoscope device that is the insertion tool 3, a foot switch, a location where an operator's brain wave and muscle movement can be detected, the housing of the insertion support device 6, It can be arranged on a treatment instrument inserted through the insertion portion 31 from the operation portion 33 of the endoscope apparatus.

In addition, the determination unit 67 may determine whether the distal end of the insertion unit has reached a predetermined position, based on the calculation result from the positional relationship calculation unit 63 or the captured image from the imaging unit 32, or in addition, You may make it judge according to operation by the operator of a switch. That is, the operator observes the captured image displayed as the captured image display 641 and operates the switch when determining that the distal end of the insertion portion has reached a predetermined position, so that the determination portion 67 has the distal end of the insertion portion. It is determined that a predetermined position has been reached.

Furthermore, the operator may arbitrarily set a predetermined position by operating this switch. That is, the predetermined position can be changed according to the type and size of the inserted body 2. For example, with respect to the entrance / exit 22, if the inserted body 2 is a bladder, it becomes a connection point between the urethra and the bladder as shown in FIG. 8A, but if the inserted body 2 is the stomach, as shown in FIG. As shown in FIG. 8C, when the connecting part and the inserted body 2 are the cecum, the ascending colon, the transverse colon, the descending colon, the sigmoid colon, and the large intestine following the rectum, as shown in FIG. If it is a mouth and piping as shown to 8D, it will become the opening part of a piping, and a branch location.

In addition, in places that have already been observed, or places that need to be observed in the future or again (locations that differ from the surrounding images (except for known patterns), cancer feature patterns, blood outflow locations, etc.) A function that allows the operator to perform marking 646 by a switch operation may be added. For example, in accordance with the switch operation, the control unit 66 controls the storage unit 65 to store the information on the location and causes the output unit 64 to display the marking 646 at the location. In this case, as shown in FIG. 1C, since the marking 646 is displayed on the two-dimensional diagrams 6421 and 6422 showing the opened state by dividing the shape of the inserted body 2 by different planes in the coordinates of the inserted body 2, Even if the position is difficult to recognize in one two-dimensional view (6421 in this example), the display can be easily recognized in the other two-dimensional view (6422 in this example). It is easy for the operator to determine whether the part has been marked 646.

The location of the marking 646 may be fixed to any one of the intersection 72, the imaging region 73, and a partial region 74 in the imaging region, or may be arbitrarily set by the operator. By making such a marking 646 possible, it is possible to confirm an observed part, a part that requires re-observation, or a part that requires some kind of treatment (removal, sampling, repair, etc.). It becomes possible. Furthermore, when performing re-observation of the insertion object 2 at different occasions, it is possible to specify a previous re-observation location or to quickly reach the insertion portion tip at the location. . In addition, regarding the storage, not only the information on the location where the marking 646 was made, but also the insertion direction of the insertion portion 31 and the like can be stored, so that it can be used for confirmation after observation, observation in the same state next time, and the like. it can.

In addition, it is possible to set and store the type information for identifying each of the observed part, the re-observation part, and the necessary treatment part, and symptom information / status information such as cancer, polyp, and crack. In this case, the display form is also changed in color and shape in accordance with the type information, symptom information / status information, and the operator can easily determine the meaning of each marking 646.

Regarding the marking 646, a pointing device or a visual recognition device is connected to the insertion support device 6, and the operator can select any range on the captured image display 641 displayed on the output unit 64 or the two-dimensional diagrams 6421 and 6422. A point may be specified.

In the two-dimensional diagrams 6421 and 6422 shown in FIG. 1C, the area division display 647 is performed. This is one in which two or more areas are divided by a common theory or regulation of an academic society, an area used as a standard, or a predetermined division method. If it does in this way, it will become easy for an operator to determine which part of the to-be-inserted body 2 is.

Note that, as shown in FIG. 11, a curve detection unit display 648 indicating the position of the curve detection unit 51 may be superimposed on the insertion unit shape schematic display 644 and displayed.

Here, the insertion / rotation detection unit 4 and the fiber shape sensor 5 optically detect the shape of the insertion unit 31 with respect to the inserted body 2 and the position and orientation of the imaging opening 34 as described above. It may be detected by other methods. For example, a coil is provided at least in the vicinity of the imaging opening 34 inside the insertion portion 31, and a magnetic field is generated by passing a current through the coil, and this magnetic field is received outside, or a magnetic field distribution generated outside is coiled. , The position and orientation of the coil, that is, the imaging opening 34 can be detected. If a plurality of coils are arranged in the longitudinal direction of the insertion portion 31, the shape of the insertion portion 31 can also be detected.

As described above, according to the present embodiment, the insertion state acquisition unit 61 inserts (at least a part of) the insertion unit 31 inserted into the insertion target body 2 (into the insertion target body 2). Information (for example, the position and orientation of a point (insertion tip)) of the insertion section 31 and the position and orientation of each bending detection section 51 of the insertion section 31 are acquired, and the inserted object shape acquisition section 62 The shape information of the inserted body 2 is acquired, and the insertion state information and the inserted body shape information are input to the positional relationship calculation unit 63, and the positional relationship of the insertion unit 31 with respect to the inserted body 2 (the entire insertion unit 31 and The position and orientation of the distal end of the insertion portion are calculated, and the output unit 64 displays and outputs the calculation result of the positional relationship calculation unit 63. Information can be provided. That is, when the inside of the insertion object that cannot be directly seen by the eyes is observed with the flexible endoscope device that is the insertion tool 3 having the insertion part 31, the captured image displayed by the output unit 64 is the image of the insertion object 2. It is possible to understand at which location and from which direction the observation is made. In addition, it is possible to easily identify an observed part or an unobserved part in the inserted body 2 and prevent oversight.

When the output unit 64 displays and outputs the calculation result of the positional relationship calculation unit 63, that is, the imaging position P, it is always displayed when the control unit 66 is not provided, and is also output when no output is necessary. In this embodiment, however, the control unit 66 controls the display so that it is displayed only when necessary. Therefore, an unnecessary calculation result is not displayed, and an easy-to-understand screen (easy to see, difficult to make, and quick determination can be made. ). In addition, if the operator of the flexible endoscope apparatus that is the insertion tool 3 controls the control unit 66, only the calculation results (current position, already observed part, affected part, required extraction part, etc.) necessary for the operator are surely obtained. Can be displayed and output.

The storage unit 65 further stores at least a part of the calculation result of the positional relationship calculation unit 63, and the storage unit 65 displays the observation range of the inserted object 2 displayed on the output unit 64 (with respect to the inserted object 2). By memorizing the positional relationship of the insertion portion 31, it is possible to distinguish between the location observed or treated at the distal end of the insertion portion with respect to the inner wall of the inserted body 2 and the location that has not been observed or treated. It becomes. For example, if the observation or treatment range displayed as the current position display 643 on the output unit 64 is left as the position locus display 645 without being deleted when moving to another location, the position locus display 645 is displayed. Thus, it is possible to easily determine the observed or treated location and the unobserved or untreated location. With this configuration, the entire inserted body 2 can be observed or treated without oversight.

Moreover, it has the imaging part 32 which has the imaging opening part 34 provided in the insertion part 31, and by displaying the picked-up image obtained from this imaging part 32 on the output part 64, the front-end | tip of an insertion part observes It is possible to directly obtain an image of a place inside the inserted object 2 (the calculation result of the positional relationship calculation unit 63). Therefore, it is possible to obtain the state of the observation location, and to observe the same location again (at the same location) at different times and to specifically detect the change.

In addition, the control unit 66 includes a determination unit 67 that determines whether the distal end of the insertion unit has reached a predetermined position from the calculation result of the positional relationship calculation unit 63, and determines that the distal end of the insertion unit has reached a predetermined position. When the determination unit 67 determines, the control of the output state of the output unit 64, that is, the start / end of the continuous display output of the current position display 643 indicating the imaging position P which is the calculation result of the positional relationship calculation unit 63, the display output content -Switch the display output method (start / end of position locus display 645 and marking 646, type, size, etc.). Here, the predetermined position is a position set in advance on the shape information such as the entrance / exit 22 of the observation location (predetermined organ in the case of an organ) of the insertion body 2 (insertion opening of the insertion body 2, entrance of the observation region, etc.) ), Or a known branch location, or a location where the captured image has a specific pattern (cancer, polyp, crack, etc.). Note that the size of the position trajectory display 645 and the marking 646 may be changed depending on the distance between the distal end of the insertion body and the inserted body 2, or the intersection of the imaging direction 71 and the inserted body 2 as the imaging position P. It is good also as a grade which can be discriminate | determined when 72 is displayed and output (size change is possible). In addition, when there is the imaging unit 32, it is preferable to display and output in an area corresponding to the size of the affected part or crack from the captured image.

Further, the control unit 66 is configured to automatically control the output state of the output unit 64 as described above when the distal end of the insertion unit reaches a predetermined position of the inserted body 2. Only the necessary places and states set in advance can be displayed and output, and the operator of the insertion tool 3 can concentrate on the operation.

Here, by controlling the predetermined position according to the switch operation of the operator, the control unit 66 can perform necessary display output according to the operator's intention, and information necessary for the operator can be obtained. It is possible to output only with certainty. Also, a plurality of results determined by the operator (including those that are difficult to determine automatically by image recognition such as pattern matching) can be distinguished and output. The number of switches may be one or plural (for current position display 643 start / end instruction, position locus taste 646 start / end instruction, marking 646 instruction, another marking instruction, and deletion instruction). In the case of a single switch, a plurality of output states can be switched by switching the number of switches on / off, the pattern, the sequential function switching, and the like.

The control unit 66 also displays a state display range corresponding to the state of the observation (work) target part that is an insertion target part of the inserted body 2 such as cancer, polyp, and crack, and the size and width of the insertion target part. Can be set according to the operator's setting operation, so that the output state and range can be set based on the operator's intention. It is possible to arbitrarily set in accordance with the field standard to which. In other words, it is possible to use properly according to each field such as medical field and industrial field. In the case of automatically controlling the output state, it is sufficient to set a criterion for the control in advance.

In addition, the control unit 66 stores the captured image in association with the calculation result of the positional relationship calculation unit 63 in the storage unit 65, so that the state at a predetermined location is stored as the observation state when stored. Compared with the current observation state, it becomes possible to obtain the difference / change. That is, since the captured image of the observation range and the calculation result of the positional relationship calculation unit 63, that is, the imaging position P, coincide with each other, it is possible to obtain information on which part is the result of imaging, and through multiple diagnosis It is possible to accurately match the changes of the same affected area.

In addition, the control unit 66 causes the storage unit 65 to store the captured image in association with at least the calculation result and the symptom information of the positional relationship calculation unit 63, so that the observation state when storing the state of the predetermined location, Differences and changes from the current observation state can be obtained.

In addition, the control unit 66 displays, for example, distinguishable markings that display two or more different predetermined states in a distinguishable manner on the output unit 64 as the computation result of the positional relationship computation unit 63. So, multiple states (current observation range, trajectory, affected area 1 (cancer, inflammation, defect, wound, corrosion, etc.), affected area 2 (cancer, inflammation, defect, wound, corrosion, etc.), treated, necessary progress , Etc.) can be distinguished visually. If the plurality of states are stored in the storage unit 65, it is possible to observe only a part in a predetermined state when it is desired to observe the same place again at different times, and it is possible to improve the observation efficiency. Moreover, it becomes possible to obtain the degree of change of the part.

It should be noted that the operator of the insertion unit 31 can select the case classification in the predetermined state. In this case, since the case can be classified based on the intention of the operator, it is possible to arbitrarily set a re-observation standard or the like based on a field standard to which the operator or the operator belongs. In other words, it is possible to use properly according to each field such as medical field and industrial field.

Further, the control unit 66 controls the output unit 64 to perform display in which a region division display is performed in a plurality of regions. In this way, if the display screen is divided into areas so that you can see the academic conventions and regulations of the academic society, or the areas that are used as standard, you can observe which part when viewing the observation range. It is possible to make it easier to understand whether

In addition, the control unit 66 provides the output unit 64 with two identical regions of the inserted body 2 so that the observation (/ work) target site and / or the positional relationship of the insertion unit 31 to the target site can be specified. When the inserted object 2 represented in three dimensions is expressed in two dimensions by performing the above different area division display, for example, different two-

dimensional views

6421 and 6422, the portion corresponding to the depth direction becomes invisible. It may be difficult to see, but this can be prevented. Therefore, it is possible to reliably recognize an overlooked part and a marking position (easy to see, difficult to mistake, and can be quickly determined).

In addition, the control unit 66 has a function as a related information calling unit that allows the information stored in the storage unit 65 to be displayed on the output unit 64, so that the output unit 64 stored in the storage unit 65 outputs the information. From the result of the field of view (imaging region 73), it is possible to look back on the observation result at the time of insertion, that is, the place where the insertion object 2 has been observed and the place where the observation has not been completed. Further, since the location of the previous observation is stored at the time of the next insertion, it is possible to easily guide or specify the same location. Furthermore, in the second and subsequent observations, if there is information (captured image, symptom, size, etc.) of the same location up to the previous time, it can be recalled and displayed as related information on the spot, at the same location as the previous time. It is possible to determine the marked part, the difference from the previous time, and the progress.

Further, the insertion amount and the rotation amount of the insertion portion 31 are detected by the insertion / rotation detection portion 4, and the shape of the insertion portion 31 is detected by the fiber shape sensor 5. Since the insertion amount and rotation amount of the insertion portion 31 to the inserted body 2 and the shape of the insertion portion 31 from the reference position can be detected, the shape of the insertion portion 31 relative to the insertion body 2 and the insertion It is possible to detect insertion state information (such as the position and orientation of the imaging opening 34) into the body 2.

In addition, although the example which displays an imaging position was described, in addition to this, you may display the position and direction of the insertion part tip, and also the history of the position and direction of the insertion part tip. This will be described with reference to FIGS. 12A to 12C and FIGS. 13A and 13B. 12A to 12C show the contents displayed on the output unit 64 when the insertion unit 31 is inserted into the inserted body 2 having a branch.

The positional relationship calculation unit 63 calculates the position and orientation of the distal end of the insertion unit and outputs them to the control unit 66. Since the calculation of the position and orientation of the distal end of the insertion portion is the same as the above calculation, the description is omitted here.

FIG. 12A shows an insertion portion shape schematic display 644 showing the current shape of the insertion portion 31 on the two-dimensional view 6421A showing the shape of the insertion object, and the position of the imaging opening 34 which is the tip position of the insertion portion 31. A current position display 643A representing the current position of position) and a position locus display 645A that is a locus of the position of the imaging opening 34 are shown. Note that the position locus display 645, which is the locus of the imaging position, is omitted. By displaying the locus of the distal end position, it is possible to know which position of the inserted body 2 the distal end position (that is, the position of the imaging opening 34) is, and at which position at the present time.

By knowing the tip position (that is, the position of the imaging opening 34), it is possible to know which part of the imaging target has been reached. By accurately knowing the current position, this information can be used for observation and treatment according to the current position and examination of the route from the current position to the target position, without estimating that it is this place. It can be carried out. Therefore, it is not necessary to repeat trial and error to go to the target position, or to check whether the target position has been reached or to observe the observation image by various methods. As a result, the possibility of being able to reach the shortest course from the current position to the target position by one time is increased, the time can be shortened, and the situation regarding the position can be grasped, so that it is calm and confident. Lead to the operation.

In addition to the position trajectory display 645A as the history of the tip position (that is, the position of the imaging opening 34) shown in FIG. 12A, the direction in which the tip of the insertion section (that is, the imaging opening 34) is directed is also displayed. good. In FIG. 12B, the direction of the distal end of the insertion portion, that is, the direction in which the imaging opening 34 faces is indicated by an arrow 649. Not only the current position and orientation of the imaging opening 34 but also the direction information is added by arrows 649 at several positions on the locus of the imaging opening 34. The position locus display 645A of the distal end position and the arrow 649 which is the direction display so that the position information of the imaging opening 34 at the distal end of the insertion portion and the direction of the distal end position and the direction of the position change can be understood. become.

Although depending on the optical system for imaging, in this example, the direction in which the imaging opening 34 at the distal end of the insertion portion faces is the center of the field of view and the center of the captured image.

) By knowing the tip position and orientation, the arrival position and orientation of the imaging target can be known. From the current position and orientation, the viewing field direction and the center of the field of view are known. By accurately knowing the arrival position and orientation, the observation visual field direction and the visual field center, using this information, the observation and treatment to be performed according to the current position and orientation, the path from the current position to the target position, and Examination of the shape and operation method of the insertion portion 31 when moving can be performed without estimating that the current position and orientation are like this. In particular, by knowing the direction of the distal end of the insertion portion, it becomes possible to study operation methods and procedures such as insertion / extraction and bending to reach the target position and orientation.

The direction of the distal end of the insertion section, that is, the direction in which the imaging opening 34 faces may be shown three-dimensionally as representing the orientation of the distal end of the insertion section or rotation.

When the rotation of the coordinate system fixed to the distal end of the insertion portion, that is, the coordinate system in which the position and orientation of the distal end of the insertion portion does not change is defined as the “three-dimensional direction” of the distal end of the insertion portion, the three-dimensional direction of the distal end of the insertion portion The trajectory is shown in FIG. 12C. In FIG. 12C, in order to indicate a three-dimensional direction (posture), the direction of the distal end of the insertion portion, that is, the direction in which the imaging opening 34 is directed is indicated by an arrow 649A in three directions (x direction, y direction, z direction). Show.

Further, information regarding the three-dimensional direction including rotation may be displayed together with the image captured by the imaging unit 32.

Thus, by knowing the position and three-dimensional direction of the distal end of the insertion portion, for example, the imaging direction including rotation at the imaging position of the distal end of the insertion portion can be known. In addition to imaging, the effect of rotation around the tip can be taken into account for treatment and the like.

As for the imaging direction including the rotation at the imaging position, for example, as shown in FIGS. 13A and 13B, even if the direction in which the imaging opening 34 faces is the same, the imaging is performed when the insertion unit 31 rotates around the imaging direction. The imaging opening 34 for the object 81 also rotates. In FIG. 13A and FIG. 13B, since the image is rotated by 180 °, the image is upside down. In such a case, the captured image I captured by the imaging unit 32 is also displayed upside down. It is possible to consider the effect of rotation around the imaging direction during such observation and treatment, and it is possible to accurately grasp the top and bottom of the captured image without making a mistake.

Further, the form of providing information is not limited to the display layout of the output unit 64 as shown in FIG. 1C.

For example, as shown in FIGS. 14A to 14F, the captured image display 641 and the insertion state display 642 can be laid out in various sizes and positions, and in various overlapping states. In addition, the operator may arbitrarily select and change what the operator feels easy to see from the plurality of display layouts.

Further, the insertion state display 642 is not limited to the display as shown in the two-dimensional diagrams 6421 and 6422. For example, it may be displayed as a three-dimensional diagram 6423 as shown in FIG.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

In the insertion system 1 according to the first embodiment, the display unit that displays the captured image is configured as the same device as the output unit 64. However, the insertion system 1 according to the second embodiment is configured as illustrated in FIG. 16A. As a display unit, a display device 9 which is a separate device from the output unit 64 is further provided. In such a configuration, as shown in FIG. 16B, only the insertion state display 642 is displayed on the output unit 64, and only the captured image display 641 is displayed on the display device 9.

Therefore, by arranging the output unit 64 and the display device 9 in the vicinity, the calculation result of the positional relationship calculation unit 63 and the captured image obtained by the imaging unit 32 can be visually observed almost simultaneously. Can be recognized simultaneously, and the calculation result of the positional relationship calculation unit 63 can be recognized without any burden.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.

The insertion system 1 according to the third embodiment is an example in which the insertion tool 3 is a rigid endoscope apparatus as shown in FIG. Such a rigid endoscope apparatus is different from the flexible endoscope apparatus in the first (and second) embodiment described above, and the insertion portion 31 does not have flexibility, and thus the shape is constant. is there.

Therefore, it is not necessary to arrange a plurality of coils in the longitudinal direction of the fiber shape sensor 5 or the insertion portion 31, and it is not necessary to calculate the shape information of the insertion portion 31 in the positional relationship calculation portion 63. The shape information of the insertion unit 31 may be stored in advance in the positional relationship calculation unit 63 or may be simply input.

Others are the same as those of the insertion system according to the first (and second) embodiment.

Also in the insertion system 1 according to the third embodiment, the same effects as those of the insertion system according to the first (and second) embodiment can be obtained.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.

The insertion system 1 according to the fourth embodiment is an example in a case where the insertion tool 3 is a treatment tool that does not have an imaging unit such as a catheter as shown in FIG. Such a treatment instrument includes a flexible insertion portion 31 as in the flexible endoscope apparatus in the first (and second) embodiment.

Therefore, the configuration, operation, and effects other than the portion related to the captured image are the same as those of the insertion system according to the first (and second) embodiment.

The present invention has been described above based on the embodiments. However, the present invention is not limited to the above-described embodiments, and various modifications and applications are possible within the scope of the gist of the present invention. is there.

For example, the above functions can be realized by supplying a software program for realizing the functions shown in the flowchart of FIG. 7 to the computer and executing the programs by the computer.

Claims

An insertion part to be inserted into the inserted body;
An insertion state acquisition unit for acquiring insertion state information of the insertion unit;
An inserted body shape acquisition unit for acquiring shape information of the inserted body;
A positional relationship calculation unit that inputs the insertion state information and the inserted body shape information and calculates a positional relationship of the insertion unit with respect to the inserted body;
An output unit for outputting a calculation result of the positional relationship calculation unit;
A control unit for controlling an output state of the calculation result in the output unit;
An insertion system characterized by comprising:
2. The insertion system according to claim 1, further comprising a storage unit that stores at least a part of a calculation result of the positional relationship calculation unit.
An imaging unit provided in the insertion unit;
A display unit capable of displaying at least a captured image obtained from the imaging unit;
The insertion system according to claim 1, further comprising:
The control unit has a determination unit that determines whether the distal end of the insertion unit has reached a predetermined position from the calculation result of the positional relationship calculation unit, and the determination that the distal end of the insertion unit has reached the predetermined position The insertion system according to any one of claims 1 to 3, wherein when the unit determines, the output state of the calculation result in the output unit is controlled.
The insertion system according to claim 4, wherein the predetermined position is one of an entrance / exit of an observation location of the inserted object, a known branch location, and a location where the captured image is a specific pattern.
The insertion according to claim 4 or 5, wherein the control unit automatically controls an output state of the output unit when the distal end of the insertion unit reaches a predetermined position of the inserted body. system.
The insertion system according to claim 4 or 5, wherein the control unit controls the predetermined position in accordance with an operator's switch operation.
The control unit can set a state display range corresponding to the state of the insertion target part of the inserted body and the size and width of the insertion target part according to the setting operation of the operator of the insertion part. The insertion system according to any one of claims 1 to 7, characterized in that
The insertion system according to claim 3, wherein the control unit causes the storage unit to store the captured image obtained from the imaging unit in association with the calculation result of the positional relationship calculation unit.
The said control part makes the said memory | storage part memorize | store the said captured image obtained from the said imaging part in association with the said calculation result and symptom information of the said positional relationship calculating part at least. Insertion system.
4. The insertion system according to claim 1, wherein the control unit causes the output unit to display the calculation result of the positional relationship calculation unit by two or more distinguishable methods. 5. .
The insertion system according to any one of claims 1 to 3, wherein the control unit causes the output unit to perform display in which a region is divided into a plurality of regions.
The insertion system according to any one of claims 1 to 3, wherein the control unit causes the output unit to display the same region of the inserted object by two or more different region division displays.
The insertion system according to claim 2 or 3, wherein the control unit includes a related information calling unit that allows information stored in the storage unit to be displayed on the output unit.
4. The insertion system according to claim 3, wherein the output of the output unit and the display of the display unit are displayed on the same device or different devices placed in the vicinity.
A detection unit for detecting an insertion state of the insertion unit;
The detector is
A shape sensor mounted inside the insertion portion and detecting the shape of the insertion portion;
An insertion portion sensor that is provided at an insertion port of the insertion portion to the inserted body and detects an insertion amount and a rotation amount when the insertion portion passes;
The insertion system according to claim 1, comprising at least one of the following.
In an insertion support apparatus for supporting insertion of an insertion portion of an insertion tool into an inserted body,
An insertion state acquisition unit for acquiring insertion state information of the insertion unit;
An inserted body shape acquisition unit for acquiring shape information of the inserted body;
A positional relationship calculation unit that inputs the insertion state information and the inserted body shape information and calculates a positional relationship of the insertion unit with respect to the inserted body;
An output unit for outputting the calculation result of the positional relationship calculation unit as display information;
A control unit for controlling an output state of the calculation result in the output unit;
An insertion support apparatus characterized by comprising:
In an insertion support method used for an insertion support device for supporting insertion of an insertion portion of an insertion tool into an inserted body,
An insertion state acquisition step of acquiring insertion state information of the insertion unit;
An inserted object shape obtaining step for obtaining shape information of the inserted object;
A positional relationship calculation step of inputting the insertion state information and the inserted body shape information, and calculating a positional relationship of the insertion portion with respect to the inserted body,
An output step of outputting the calculation result of the positional relationship calculation step as display information;
A control step of controlling an output state of the calculation result in the output step;
An insertion support method characterized by comprising:
On the computer,
An insertion state acquisition procedure for acquiring insertion state information of the insertion part in an insertion support device that supports insertion of the insertion part of the insertion tool into the inserted body;
A to-be-inserted body shape obtaining procedure for obtaining shape information of the to-be-inserted body;
A positional relationship calculation procedure for inputting the insertion state information and the inserted body shape information and calculating a positional relationship of the insertion portion with respect to the inserted body,
An output procedure for outputting the calculation result of the positional relationship calculation procedure as display information;
A control procedure for controlling an output state of the calculation result in the output procedure;
A program for running