US20100121480A1 - Method and apparatus for visual support of commission acts - Google Patents
Method and apparatus for visual support of commission acts Download PDFInfo
- Publication number
- US20100121480A1 US20100121480A1 US12/554,600 US55460009A US2010121480A1 US 20100121480 A1 US20100121480 A1 US 20100121480A1 US 55460009 A US55460009 A US 55460009A US 2010121480 A1 US2010121480 A1 US 2010121480A1
- Authority
- US
- United States
- Prior art keywords
- data
- mobile unit
- goods
- data processing
- optical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 230000000007 visual effect Effects 0.000 title claims abstract description 5
- 230000003287 optical effect Effects 0.000 claims abstract description 59
- 238000001514 detection method Methods 0.000 claims abstract description 52
- 238000012545 processing Methods 0.000 claims abstract description 50
- 230000008569 process Effects 0.000 claims abstract description 9
- 230000005540 biological transmission Effects 0.000 claims description 11
- 230000003190 augmentative effect Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 239000003086 colorant Substances 0.000 claims description 2
- 238000007405 data analysis Methods 0.000 claims description 2
- 239000004973 liquid crystal related substance Substances 0.000 claims description 2
- 230000001960 triggered effect Effects 0.000 claims description 2
- 230000009469 supplementation Effects 0.000 claims 1
- 230000006870 function Effects 0.000 description 5
- 238000009434 installation Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000015556 catabolic process Effects 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 244000144619 Abrus precatorius Species 0.000 description 1
- 241000531116 Blitum bonus-henricus Species 0.000 description 1
- 235000008645 Chenopodium bonus henricus Nutrition 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 238000003703 image analysis method Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005007 materials handling Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012856 packing Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000013439 planning Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012384 transportation and delivery Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/04—Storage devices mechanical
- B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
- B65G1/1373—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed for fulfilling orders in warehouses
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G1/00—Storing articles, individually or in orderly arrangement, in warehouses or magazines
- B65G1/02—Storage devices
- B65G1/04—Storage devices mechanical
- B65G1/137—Storage devices mechanical with arrangements or automatic control means for selecting which articles are to be removed
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65G—TRANSPORT OR STORAGE DEVICES, e.g. CONVEYORS FOR LOADING OR TIPPING, SHOP CONVEYOR SYSTEMS OR PNEUMATIC TUBE CONVEYORS
- B65G2209/00—Indexing codes relating to order picking devices in General
- B65G2209/04—Indication location means
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- the present invention relates to a method for the visual technical support of manual order-picking processes through a device with at least one mobile unit, having an optical sensing detection device, an optical display device, a data processing device and a data interface for wireless connection to a stationary electronic data-processing system, which, in addition to product management software, has a connection device for all active mobile units.
- a plurality of different systems are currently used for order-picking in warehouses.
- static provision man-to-goods systems
- dynamic provision goods-to-man systems
- high-bay storage storage carousel installations
- flow through racks and paternoster installations is being used with increasing frequency.
- the latter has the advantage of a smaller space requirement and the reduction of work for recognition, picking and confirmation.
- the disadvantages are the high expenditure in terms of infrastructure and machinery, the high cost of the overall system and poor access in the event of breakdown.
- a motor breakdown can mean order-picking comes to a standstill.
- These cover data helmets for the display of information superimposed in the field of view, such as optical highlighting of a storage compartment, visually supported route-finding and route information.
- Further known devices such as augmented-reality devices, are used for head-mounted displays, in particular in various applications such as in computer games, in simulators for process steps or inspection or data comparison tasks.
- DE 102 15 885 A1 describes a method for automatic process control with an augmented-reality system with camera, data goggles and logging device. This method and the device therefor are used chiefly for logging and analysis of manipulation operations for correct implementation.
- the primary object of the invention is now to build on this prior art to create a method and a device that is suitable for supporting the basic functions of order pickup through navigation.
- These basic functions are, e.g.: take a predetermined container or a specific transport aid; go to a predetermined article location, remove there the predetermined number of this article and place it in the container or transport aid; go the next article location, etc.; and finally bring the target container to the container target location.
- the user should be able, without special knowledge, to take a support device from a location, e.g., a loading station. It should be possible to carry out the rest of the functions through the device clearly and with effective monitoring quickly and easily in a route-optimized and time-optimized manner.
- Interruptions and continuations by other employees as well as the exchange of container or auxiliary device should be possible without error for order picking at any time. Route optimization and collision avoidance are further aspects of the invention. Likewise, it should be possible to immediately insert sudden priority tasks easily and without time being lost. It should be possible for the different functions to be carried out by one or more employees. It should also be possible for a list to be worked through by several employees or order pickers at the same time without duplications.
- a device is used with at least one mobile unit and a stationary central data-processing system.
- the data-processing system and the mobile unit can communicate via a wireless connection, wherein necessary data are exchanged.
- the mobile unit has an optical sensing detection device for this purpose, in order to detect its surroundings.
- An optical display device in the mobile unit is used to display information; a data processing device is used to process information for the display and to prepare for the data transmission based on the optical sensor detection.
- the stationary data-processing system is equipped with goods management software, which can access the data of all of the active mobile units via the wireless connection.
- each mobile unit cyclically receives navigation information and this is transmitted in the form of directions, in particular (directional) arrows, via the optical display device.
- the method requires that the data for the specific navigation based on a data comparison of the data from the respective optical sensing detection device of each mobile unit are compared to reference data or model data in the data-processing system or also stored in the mobile unit in order to clearly define the location of the clearly identified mobile device.
- the software of the data-processing system or that of the mobile unit can determine the route information or the product identification and display it on the mobile unit addressed.
- the new navigation information for the next object of an assigned list of goods is to occur only after the optical detection of the current object and clear identification of the same.
- the important factor thereby is the clear detection and logging of the order-picking operation of a goods article from the storage location to the target location. If the requested product is not at the target location, a place holder replacement object, e.g., a printed sheet with clear identification, must be placed in the transport aid. This can contain information for the product recipient. The system will receive feedback on a product shortfall.
- a navigation to the transport aid to be currently used in the first case empty or in the second case already partially filled, occurs and if a complete combination of goods is interrupted early, a position of the transport aid is transmitted to the stationary data-processing system and stored for the subsequent continuance and completion of the order, or after successful completion of the order, the navigation of the transport aid containing the complete combination of goods to the common target position occurs.
- a transport aid e.g., a basket or transport cart, is normally used for a combination of goods. It is advantageous to guide a newly registered user by navigation to the transport aid to be currently used. This can be empty or already partially filled.
- a task list is interrupted, e.g., in the case of breaks, the end of a day's work or shift changeover. If a transport aid with all of the goods according to the task list has been assembled according to the goods management program of the data-processing system, it is advantageously navigated to the target position. A target position can thereby be different for each order.
- a detection of unauthorized movements of an object from its storage location or from the transport aid or of the transport aid itself with the aid of the optical sensing detection device and its evaluation with the aid of the software of the stationary data-processing system is advantageous for control and monitoring of the work processes. Measures to prevent errors, such as warnings via the optical display device through corresponding error code transmission are thus possible.
- an acoustic alarm is triggered in the event of optically detected errors.
- inertial sensors for complete detection of a movement and orientation of an order picker are advantageous.
- the inertial sensors can be calibrated by fixed optically detected markers, the position of which is known to the system. Conversely, this makes it possible to check movable optically detected objects with respect to their desired location. If a calibrated inertial sensor is applied to the hand of the order picker and if he is guided to the position of a movable system component or a product, the location of which is not the desired position, the software recognizes this and can likewise apply corrective measures. Thus, for example, a product can have fallen off a shelf; the location of the correct storage position is transmitted to the mobile unit upon contact.
- a device for carrying out the method according to the invention is defined in claim 6 .
- the device has at least one mobile unit.
- Several mobile units of this type can be used in a warehouse simultaneously. They communicate with a central data-processing system.
- the mobile unit has an optical sensing detection device, an optical display device, a data-processing device and software for image data processing and is equipped with a wireless data interface for data transmission.
- the data transmission is always carried out with the central data processing device, e.g., via a wireless local area network (WLAN) or a Bluetooth connection.
- WLAN wireless local area network
- a Bluetooth connection e.g., via a wireless local area network (WLAN) or a Bluetooth connection.
- WLAN wireless local area network
- Space, product and devices must form one unit.
- poster-like attachments can be suitably designed in order to ensure for as many objects as possible a clear determination of the position and the orientation in a warehouse through the optical sensing detection device.
- Geometric similarity algorithms e.g., image analysis methods, are used for this purpose in the central and/or in the mobile data processing device.
- a pattern-scanner with laser in particular a barcode scanner
- the current position and orientation information must thereby be determined in installations on the floor, on walls, the product or shelves by patterns, in particular barcodes, by the data processing device of the mobile unit or after transmission of the pattern information by the central data-processing system.
- the laser of the detection device could theoretically also be used for the optical display device.
- passive transponders radio frequency identification tags or RFID tags
- RFID tags radio frequency identification tags
- a transponder reader device must be provided in the mobile units.
- the code of the transponder permits inferences to be made on the position, orientation and/or designation of the product, based on the product management software.
- the optical sensing detection device is a camera module.
- image data analysis supported by installations on the floor, on walls, shelves, storage locations or on the product, current position and orientation or product information can be determined from colors, shapes and patterns—either already in the mobile unit or after image transmission by the central data processing device.
- the video image detected equipped with the additional information of the navigation can be transmitted to at least one video display.
- the optical display device can have light-emitting diodes, a display, in particular a display of the liquid crystal display (LCD) or organic light emitting diode (OLED) type, or combinations thereof.
- a display in particular a display of the liquid crystal display (LCD) or organic light emitting diode (OLED) type, or combinations thereof.
- LCD liquid crystal display
- OLED organic light emitting diode
- the display device is suitable for showing the direction of travel in coded form or by directions, in particular in the form of directional arrows.
- a laser projector is also suitable as an optical display device. This is suitable for projecting directions on surrounding objects, in particular a floor, or in the case of corresponding identification, directly marking the respective target object by irradiation.
- an inertial sensor in particular a rotation rate sensor
- the correction of the direction in the display device can thereby also be carried out between two optical sensing position and orientation detections.
- a laser scanner is used as an optical sensing detection device, it is particularly advantageous to also use the laser via its deflection devices to display the information or directions, in that it is possible to switch backwards and forwards between display and scan mode. If conversely a laser projector is used, with suitable deflection the laser beam thereof can also serve as a component for a laser scanner.
- An augmented reality representation on the display device is also advantageous.
- the actually detected data in particular video data directly or virtual data constructed from certain characteristic values, with geometric information on the warehouse and its structure are thereby linked to augmented reality data.
- the user in particular of video goggles or a data helmet is thus given a virtual view of the surrounding area with or without integration of the real images. Additional information is embedded in this virtual display.
- the data of the optical sensing detection device are transmitted either by two sensors spaced apart or through image conversion based on the stored geographic data of the warehouse structure into a three-dimensional image for both eyes of the viewer.
- a suitable optical display device is, for example, 3D spectacles; shutter glasses render possible a three-dimensional depth effect for the viewer.
- two calculated or detected viewing angles of the virtual or real image are used with additional information and the reproduction thereof for both eyes of the viewer.
- the movement of the eyes can be detected.
- FIG. 1 An example of the device according to the invention with mobile hand devices
- FIG. 2 A further exemplary embodiment of the device according to the invention with video glasses
- FIG. 3 A data helmet for use as a mobile unit
- FIG. 4 A head-band type head mount for a further embodiment of the mobile unit
- FIG. 5 A helmet with projection device as a display device
- FIGS. 6 through 9 Fields of view of an order picker with a typical order-picking operation.
- FIG. 1 shows the expenditure in terms of equipment for the pick-by-vision method as a first example.
- a data-processing system 100 comprises a computer 101 and a communication interface or connection device 102 for wireless connection to mobile units 200 .
- a keyboard 104 makes it possible to enter data, in particular to select functions of a goods management system. Many things are carried out in an automated manner, for example, customer orders. The inventory can be retrieved constantly updated. Bottlenecks are to be avoided.
- the goods management software can inform a user about all currently active mobile units via a monitor 103 . Further retrievable information includes current users, number of correct goods access operations, number of error messages, order picker start and end times, missing products, order receipts, tracking the order status, determining a possible delivery date, overstaffing or understaffing.
- the mobile units 200 have an optical display device 201 , an optical sensing detection device 202 and a device for data processing and communication via a wireless connection 206 .
- a sequence is, for example, shown briefly, as follows: a recently hired, untrained order picker is asked to take a mobile unit 200 from a charging station for storage batteries. Usually, it is fully charged. If the charge condition is unsuitable, a block can prevent removal until the optimum charge condition has been reached.
- the order picker takes a suitable device and switches on the mobile unit 200 .
- the software powers up and the wireless interface awaits the logon sequence.
- the mobile unit 200 is recognized by the data processing device 100 based on a cyclical scan of new logons. After detection of the new device by the control center, the current equipment level is increased. A user identification is requested on the display device 201 of the mobile unit 200 .
- the new order picker either his face was linked to his data in the system or an identification card with a personal barcode, possibly as a sticker, sewn-on badge or imprint attached to protective clothing or a helmet.
- the order picker holds the optical sensing detection device 202 , e.g., a camera, against his face or the code, and the system transmits the release to the mobile unit 200 for task performance.
- the device number is linked to the user identity, at the same time a time stamp occurs for the start of work.
- the data processing device 100 assigns the next goods list to the current mobile unit 200 according to a priority plan. First the order picker is welcomed by name via the display. There is the option here of ending the work promptly in the event of an identification error.
- the code might be incorrect, the wrong work clothing has been put on or the mobile unit 200 was accidentally pointed at a different order picker.
- the logon can be repeated by restarting (switching on and off). However, the incorrect logon is logged.
- the order picker needs only to follow the instructions of the mobile unit 200 for the route.
- the order picker is guided to a transport aid. Arrows 205 on the display show the way. Prominent objects or intersections in the route can also be displayed in the optical display device 201 .
- the transport aid to be selected is clearly assigned by the control center or data processing system 100 . This also makes it possible to continue a combination of goods that has been started but not completed, even by a different order picker.
- the instruction to take the same is transmitted.
- the transport aid is clearly identified by the detection device, which can also be carried out by a barcode, and moved away from the location, the target of the next element of the task list of the user is transmitted to the mobile unit 200 .
- the directions are given again.
- Location and target are two geographic points, which are used via software to the mobile unit 200 or in the control center or data processing system 100 for an automatic routing process through the warehouse by the shortest route.
- the mobile unit 200 indicates the direction by arrows 205 , the movement of the order picker through the warehouse is detected by optical sensing.
- the camera on the mobile unit 200 renders possible a comparison of image data with stored and geographically assigned warehouse positions and orientations.
- a certain barcode sign can thus precisely define the location.
- the orientation can additionally be detected by rotary sensors, e.g., according to the gyroscope principle, so that a viewing angle defined for the alignment of the camera to the barcode sign is taken into account accordingly in the indication of direction in the event of a tilt.
- the optical sensing detection device 202 recognizes the target object.
- the display indicates the object by suitable emphasis. If the correct object is moved into the transport aid, the detection device recognizes this, e.g., since two image components are made congruent. The operation is completed, the next routing occurs. If the mobile unit 200 is switched off, the current order-picking status with the time log for the user is stored and integrated into the population of all orders.
- the mobile unit 200 is embodied as a hand unit, work is somewhat limited. This can be remedied by a detachable attachment of the device to a transport aid.
- the fixing of the device to the body e.g., by a belt, is advantageous, and ideally the display device 201 is integrated into data goggles 300 , as shown in FIG. 2 . Future goggles render possible very light embodiments, so that freedom of movement is restricted only slightly. The field of view should remain as large as possible.
- FIG. 3 shows a typical data helmet with a video monitor device or optical display device 201 similar to an electronic viewfinder for the display of augmented reality, integrating lines of sight from an optical sensing detection device 202 embodied as a camera.
- a transmission device 203 can be attached to a helmet 400 and is connected to a detection and display device via a wiring 204 .
- a closed unit thus results, which can easily be put on or taken off.
- FIG. 4 shows a headband 600 in side view for attachment to the head.
- Devices for image detection, image reproduction and data processing and communication or an optical sensing detection device 202 , an optical display device 201 and a transmission device 203 are mounted on the forehead here.
- FIG. 5 A special embodiment of the mobile unit 200 is shown in FIG. 5 .
- the headpiece shows here an image detection device 202 in the form of a video camera and a display device 201 in the form of a laser projector.
- the latter projects directional arrows onto the floor in front of the user.
- a correctly recognized article of goods can also be indicated with the aid of a projector, e.g., by a circle.
- the prerequisite for this is that the projection beam is located in the field of view of the camera.
- the laser projector permits a change of the projection direction from obliquely to the ground to straight ahead parallel to the line of sight of the detection device, in order to achieve a clear feedback.
- FIGS. 6 through 9 show possible representations during a product navigation, either through the display or the line of sight of the order picker.
- the shelf labels for example, are used for orientation here.
- the letters A through H give the system the current location.
- the next list product is a white ball or a target object 500 . This is located in the vicinity of a marker G.
- a route planning (central or in the mobile unit 200 ) determines the route information and produces the (directional) arrows 205 . If the order picker follows the arrow 205 , the view of the optical sensing detection device 202 then changes from FIG. 7 to that in FIG. 8 and finally to that in FIG. 9 .
- the product is recognized and marked and can be removed in a controlled manner.
- the predominant but not restricted field of application relates to warehouses of wholesalers or mail-order companies as well as storage facilities or interim storage facilities of manufacturers or suppliers.
- the method or the device according to the invention for this the combination of goods inside a warehouse is thereby possible even by employees with no knowledge of the configuration of the warehouse and no knowledge of the location and position of the goods to be combined, wherein in particular several order pickers can work simultaneously.
Abstract
The invention relates to a method for the visual technical support of manual order-picking processes through a device with at least one mobile unit (200), having an optical sensing detection device (202), an optical display device (201), a data processing device (203) and a data interface for wireless connection (206) to a stationary electronic data-processing system (100), which, in addition to product management software, has a connection device (102) for all active mobile units (200). It is provided according to the invention that each mobile unit (200) cyclically receives navigation information, which is transmitted in the form of directions, in particular arrows (205), via the optical display device (201), wherein data for the specific navigation based on a data comparison of the data from the respective optical sensing detection device (202) with reference data or model data of a warehouse in the data-processing system (100) or the mobile unit (200), on the one hand, and the position of a current target object (500) of an assigned route-optimized list of goods transmitted by the data processing system (100) to the mobile unit (200), on the other hand, are cyclically determined and transmitted addressed to the assigned mobile unit (200) and the new navigation information for the next object of the list of goods does not occur until after the optical detection of the current target object (500) or of a placeholder replacement object by the detection device (202) and clear identification of the same by the data processing device (100) and clear detection and logging of the order-picking process of a goods article from the storage location to the target location.
Furthermore, the invention relates to a device for carrying out this method.
Description
- The present invention relates to a method for the visual technical support of manual order-picking processes through a device with at least one mobile unit, having an optical sensing detection device, an optical display device, a data processing device and a data interface for wireless connection to a stationary electronic data-processing system, which, in addition to product management software, has a connection device for all active mobile units.
- A plurality of different systems are currently used for order-picking in warehouses. In addition to static provision (man-to-goods systems), dynamic provision (goods-to-man systems) by means of high-bay storage, storage carousel installations, flow through racks and paternoster installations is being used with increasing frequency. The latter has the advantage of a smaller space requirement and the reduction of work for recognition, picking and confirmation. The disadvantages are the high expenditure in terms of infrastructure and machinery, the high cost of the overall system and poor access in the event of breakdown. A motor breakdown can mean order-picking comes to a standstill.
- Technologies that became known as pick-to-light or pick-by-voice are often used. In the first case, an order picker at the storage location is notified via a device by display instruments which goods and which quantity he should remove; after removal the user confirms by pressing a button. Errors or unauthorized removal of goods are not avoidable here. The expenditure for the display instruments or devices is also considerable. In addition, stationary screens with position information, type of goods and quantity linked to with an administrator file are used at various points in space for retrieval. Pick-by-voice renders possible hands-free maneuvering via acoustic commands; a microphone makes it possible to report for confirmation. In principle, four elements of technologies of this type have already been disclosed, in particular by research studies by Munich Technical University, Chair for materials handling engineering, material flow and logistics. This also includes pick-by-vision systems in the test phase. These cover data helmets for the display of information superimposed in the field of view, such as optical highlighting of a storage compartment, visually supported route-finding and route information. Further known devices, such as augmented-reality devices, are used for head-mounted displays, in particular in various applications such as in computer games, in simulators for process steps or inspection or data comparison tasks.
- DE 102 15 885 A1 describes a method for automatic process control with an augmented-reality system with camera, data goggles and logging device. This method and the device therefor are used chiefly for logging and analysis of manipulation operations for correct implementation.
- Also cited as prior art is the use of augmented reality as a substitute for an assembly manual, for example in aircraft assembly.
- The primary object of the invention is now to build on this prior art to create a method and a device that is suitable for supporting the basic functions of order pickup through navigation. These basic functions are, e.g.: take a predetermined container or a specific transport aid; go to a predetermined article location, remove there the predetermined number of this article and place it in the container or transport aid; go the next article location, etc.; and finally bring the target container to the container target location. The user should be able, without special knowledge, to take a support device from a location, e.g., a loading station. It should be possible to carry out the rest of the functions through the device clearly and with effective monitoring quickly and easily in a route-optimized and time-optimized manner. Interruptions and continuations by other employees as well as the exchange of container or auxiliary device should be possible without error for order picking at any time. Route optimization and collision avoidance are further aspects of the invention. Likewise, it should be possible to immediately insert sudden priority tasks easily and without time being lost. It should be possible for the different functions to be carried out by one or more employees. It should also be possible for a list to be worked through by several employees or order pickers at the same time without duplications.
- According to the invention, to attain the object a method is proposed for the visual technical support of manual order picking operations according to claim 1. For this purpose a device is used with at least one mobile unit and a stationary central data-processing system. The data-processing system and the mobile unit can communicate via a wireless connection, wherein necessary data are exchanged. The mobile unit has an optical sensing detection device for this purpose, in order to detect its surroundings. An optical display device in the mobile unit is used to display information; a data processing device is used to process information for the display and to prepare for the data transmission based on the optical sensor detection. The stationary data-processing system is equipped with goods management software, which can access the data of all of the active mobile units via the wireless connection. The important factor thereby is that each mobile unit cyclically receives navigation information and this is transmitted in the form of directions, in particular (directional) arrows, via the optical display device. To this end the method requires that the data for the specific navigation based on a data comparison of the data from the respective optical sensing detection device of each mobile unit are compared to reference data or model data in the data-processing system or also stored in the mobile unit in order to clearly define the location of the clearly identified mobile device. With the aid of these data the software of the data-processing system or that of the mobile unit, based on the position of the current target object known to the system, can determine the route information or the product identification and display it on the mobile unit addressed.
- As a further basic feature, the new navigation information for the next object of an assigned list of goods is to occur only after the optical detection of the current object and clear identification of the same. The important factor thereby is the clear detection and logging of the order-picking operation of a goods article from the storage location to the target location. If the requested product is not at the target location, a place holder replacement object, e.g., a printed sheet with clear identification, must be placed in the transport aid. This can contain information for the product recipient. The system will receive feedback on a product shortfall.
- Expediently, before the start of the navigation for a new combination of goods or addition of goods, a navigation to the transport aid to be currently used, in the first case empty or in the second case already partially filled, occurs and if a complete combination of goods is interrupted early, a position of the transport aid is transmitted to the stationary data-processing system and stored for the subsequent continuance and completion of the order, or after successful completion of the order, the navigation of the transport aid containing the complete combination of goods to the common target position occurs. A transport aid, e.g., a basket or transport cart, is normally used for a combination of goods. It is advantageous to guide a newly registered user by navigation to the transport aid to be currently used. This can be empty or already partially filled. The latter is advantageous if a task list is interrupted, e.g., in the case of breaks, the end of a day's work or shift changeover. If a transport aid with all of the goods according to the task list has been assembled according to the goods management program of the data-processing system, it is advantageously navigated to the target position. A target position can thereby be different for each order.
- A detection of unauthorized movements of an object from its storage location or from the transport aid or of the transport aid itself with the aid of the optical sensing detection device and its evaluation with the aid of the software of the stationary data-processing system is advantageous for control and monitoring of the work processes. Measures to prevent errors, such as warnings via the optical display device through corresponding error code transmission are thus possible.
- Ideally and due to its educational effect, an acoustic alarm is triggered in the event of optically detected errors.
- For support or control in the detection of the position and orientation, inertial sensors for complete detection of a movement and orientation of an order picker are advantageous. The inertial sensors can be calibrated by fixed optically detected markers, the position of which is known to the system. Conversely, this makes it possible to check movable optically detected objects with respect to their desired location. If a calibrated inertial sensor is applied to the hand of the order picker and if he is guided to the position of a movable system component or a product, the location of which is not the desired position, the software recognizes this and can likewise apply corrective measures. Thus, for example, a product can have fallen off a shelf; the location of the correct storage position is transmitted to the mobile unit upon contact.
- A device for carrying out the method according to the invention is defined in claim 6. The device has at least one mobile unit. Several mobile units of this type can be used in a warehouse simultaneously. They communicate with a central data-processing system. The mobile unit has an optical sensing detection device, an optical display device, a data-processing device and software for image data processing and is equipped with a wireless data interface for data transmission. The data transmission is always carried out with the central data processing device, e.g., via a wireless local area network (WLAN) or a Bluetooth connection. In addition to these devices known per se, as a third component the geometry of the warehouse and the complete detection of all dimensions and product positions in a virtual model is the decisive feature of the invention. Space, product and devices must form one unit. In addition to geographic arrangements of warehouse facilities and/or optically detectable conditions through shape, color and/or pattern, poster-like attachments can be suitably designed in order to ensure for as many objects as possible a clear determination of the position and the orientation in a warehouse through the optical sensing detection device. Geometric similarity algorithms, e.g., image analysis methods, are used for this purpose in the central and/or in the mobile data processing device.
- Advantageously, a pattern-scanner with laser, in particular a barcode scanner, can be used as an optical sensing detection device. The current position and orientation information must thereby be determined in installations on the floor, on walls, the product or shelves by patterns, in particular barcodes, by the data processing device of the mobile unit or after transmission of the pattern information by the central data-processing system. The laser of the detection device could theoretically also be used for the optical display device.
- For support, passive transponders (radio frequency identification tags or RFID tags) can be attached in the warehouse for position analysis. Then a transponder reader device must be provided in the mobile units. The code of the transponder permits inferences to be made on the position, orientation and/or designation of the product, based on the product management software.
- For augmented reality it is advantageous if the optical sensing detection device is a camera module. With the aid of image data analysis, supported by installations on the floor, on walls, shelves, storage locations or on the product, current position and orientation or product information can be determined from colors, shapes and patterns—either already in the mobile unit or after image transmission by the central data processing device. The video image detected equipped with the additional information of the navigation can be transmitted to at least one video display.
- In principle, the optical display device can have light-emitting diodes, a display, in particular a display of the liquid crystal display (LCD) or organic light emitting diode (OLED) type, or combinations thereof. The important factor thereby is that the display device is suitable for showing the direction of travel in coded form or by directions, in particular in the form of directional arrows.
- A laser projector is also suitable as an optical display device. This is suitable for projecting directions on surrounding objects, in particular a floor, or in the case of corresponding identification, directly marking the respective target object by irradiation.
- The integration of an inertial sensor, in particular a rotation rate sensor, is advantageous. This makes it possible in addition to detect movement or rotational movement. The correction of the direction in the display device can thereby also be carried out between two optical sensing position and orientation detections.
- If a laser scanner is used as an optical sensing detection device, it is particularly advantageous to also use the laser via its deflection devices to display the information or directions, in that it is possible to switch backwards and forwards between display and scan mode. If conversely a laser projector is used, with suitable deflection the laser beam thereof can also serve as a component for a laser scanner.
- An augmented reality representation on the display device is also advantageous. The actually detected data, in particular video data directly or virtual data constructed from certain characteristic values, with geometric information on the warehouse and its structure are thereby linked to augmented reality data. The user in particular of video goggles or a data helmet is thus given a virtual view of the surrounding area with or without integration of the real images. Additional information is embedded in this virtual display.
- For three-dimensional perception, it is advantageous if the data of the optical sensing detection device are transmitted either by two sensors spaced apart or through image conversion based on the stored geographic data of the warehouse structure into a three-dimensional image for both eyes of the viewer. A suitable optical display device is, for example, 3D spectacles; shutter glasses render possible a three-dimensional depth effect for the viewer. To this end two calculated or detected viewing angles of the virtual or real image are used with additional information and the reproduction thereof for both eyes of the viewer. To support focusing and representation that is correct in terms of viewing angle, the movement of the eyes can be detected.
- The present invention is described based on the following practical embodiments. They show:
-
FIG. 1 An example of the device according to the invention with mobile hand devices; -
FIG. 2 A further exemplary embodiment of the device according to the invention with video glasses; -
FIG. 3 A data helmet for use as a mobile unit; -
FIG. 4 A head-band type head mount for a further embodiment of the mobile unit; -
FIG. 5 A helmet with projection device as a display device; -
FIGS. 6 through 9 Fields of view of an order picker with a typical order-picking operation. -
FIG. 1 shows the expenditure in terms of equipment for the pick-by-vision method as a first example. A data-processing system 100 comprises acomputer 101 and a communication interface orconnection device 102 for wireless connection tomobile units 200. Akeyboard 104 makes it possible to enter data, in particular to select functions of a goods management system. Many things are carried out in an automated manner, for example, customer orders. The inventory can be retrieved constantly updated. Bottlenecks are to be avoided. The goods management software can inform a user about all currently active mobile units via amonitor 103. Further retrievable information includes current users, number of correct goods access operations, number of error messages, order picker start and end times, missing products, order receipts, tracking the order status, determining a possible delivery date, overstaffing or understaffing. Themobile units 200 have anoptical display device 201, an opticalsensing detection device 202 and a device for data processing and communication via awireless connection 206. - A sequence is, for example, shown briefly, as follows: a recently hired, untrained order picker is asked to take a
mobile unit 200 from a charging station for storage batteries. Usually, it is fully charged. If the charge condition is unsuitable, a block can prevent removal until the optimum charge condition has been reached. The order picker takes a suitable device and switches on themobile unit 200. The software powers up and the wireless interface awaits the logon sequence. Themobile unit 200 is recognized by thedata processing device 100 based on a cyclical scan of new logons. After detection of the new device by the control center, the current equipment level is increased. A user identification is requested on thedisplay device 201 of themobile unit 200. To this end, for the new order picker either his face was linked to his data in the system or an identification card with a personal barcode, possibly as a sticker, sewn-on badge or imprint attached to protective clothing or a helmet. The order picker holds the opticalsensing detection device 202, e.g., a camera, against his face or the code, and the system transmits the release to themobile unit 200 for task performance. In thedata processing device 100 the device number is linked to the user identity, at the same time a time stamp occurs for the start of work. Thedata processing device 100 assigns the next goods list to the currentmobile unit 200 according to a priority plan. First the order picker is welcomed by name via the display. There is the option here of ending the work promptly in the event of an identification error. The code might be incorrect, the wrong work clothing has been put on or themobile unit 200 was accidentally pointed at a different order picker. The logon can be repeated by restarting (switching on and off). However, the incorrect logon is logged. Once the welcome has been completed, the order picker needs only to follow the instructions of themobile unit 200 for the route. First, the order picker is guided to a transport aid.Arrows 205 on the display show the way. Prominent objects or intersections in the route can also be displayed in theoptical display device 201. The transport aid to be selected is clearly assigned by the control center ordata processing system 100. This also makes it possible to continue a combination of goods that has been started but not completed, even by a different order picker. When the transport aid is reached, the instruction to take the same is transmitted. If the transport aid is clearly identified by the detection device, which can also be carried out by a barcode, and moved away from the location, the target of the next element of the task list of the user is transmitted to themobile unit 200. The directions are given again. Location and target are two geographic points, which are used via software to themobile unit 200 or in the control center ordata processing system 100 for an automatic routing process through the warehouse by the shortest route. As a result, themobile unit 200 indicates the direction byarrows 205, the movement of the order picker through the warehouse is detected by optical sensing. The camera on themobile unit 200 renders possible a comparison of image data with stored and geographically assigned warehouse positions and orientations. A certain barcode sign can thus precisely define the location. The orientation can additionally be detected by rotary sensors, e.g., according to the gyroscope principle, so that a viewing angle defined for the alignment of the camera to the barcode sign is taken into account accordingly in the indication of direction in the event of a tilt. At the target location, the opticalsensing detection device 202 recognizes the target object. The display indicates the object by suitable emphasis. If the correct object is moved into the transport aid, the detection device recognizes this, e.g., since two image components are made congruent. The operation is completed, the next routing occurs. If themobile unit 200 is switched off, the current order-picking status with the time log for the user is stored and integrated into the population of all orders. If all of the elements of a task list have been completed, that is, placed in the transport aid, the guidance of the filled transport aid to the target location occurs. Guidance to another transport aid occurs. Then further actions, such as packing and shipping of the goods can be carried out at the target location for the transport aid. The deletion of all goods is carried out in a similar manner through the detection of the removal from the transport aid by staff authorized to do so. Since the control center or thedata processing system 100 knows the precise number of goods deposited, a packer can here also verify again the correct order picking with the aid of the device presented. The transport aid number is again released in the system for a new list of goods. - If an order picker takes the wrong object in error, a warning is given via the
display device 201 or acoustically. The error is logged, any correction likewise. - If the
mobile unit 200, as shown inFIG. 1 , is embodied as a hand unit, work is somewhat limited. This can be remedied by a detachable attachment of the device to a transport aid. However, the fixing of the device to the body, e.g., by a belt, is advantageous, and ideally thedisplay device 201 is integrated intodata goggles 300, as shown inFIG. 2 . Future goggles render possible very light embodiments, so that freedom of movement is restricted only slightly. The field of view should remain as large as possible. -
FIG. 3 shows a typical data helmet with a video monitor device oroptical display device 201 similar to an electronic viewfinder for the display of augmented reality, integrating lines of sight from an opticalsensing detection device 202 embodied as a camera. Atransmission device 203 can be attached to ahelmet 400 and is connected to a detection and display device via awiring 204. A closed unit thus results, which can easily be put on or taken off. -
FIG. 4 shows aheadband 600 in side view for attachment to the head. Devices for image detection, image reproduction and data processing and communication or an opticalsensing detection device 202, anoptical display device 201 and atransmission device 203 are mounted on the forehead here. - A special embodiment of the
mobile unit 200 is shown inFIG. 5 . The headpiece shows here animage detection device 202 in the form of a video camera and adisplay device 201 in the form of a laser projector. The latter projects directional arrows onto the floor in front of the user. A correctly recognized article of goods can also be indicated with the aid of a projector, e.g., by a circle. However, the prerequisite for this is that the projection beam is located in the field of view of the camera. Preferably the laser projector permits a change of the projection direction from obliquely to the ground to straight ahead parallel to the line of sight of the detection device, in order to achieve a clear feedback. -
FIGS. 6 through 9 show possible representations during a product navigation, either through the display or the line of sight of the order picker. The shelf labels, for example, are used for orientation here. The letters A through H give the system the current location. The next list product is a white ball or atarget object 500. This is located in the vicinity of a marker G. A route planning (central or in the mobile unit 200) determines the route information and produces the (directional)arrows 205. If the order picker follows thearrow 205, the view of the opticalsensing detection device 202 then changes fromFIG. 7 to that inFIG. 8 and finally to that inFIG. 9 . The product is recognized and marked and can be removed in a controlled manner. - The predominant but not restricted field of application relates to warehouses of wholesalers or mail-order companies as well as storage facilities or interim storage facilities of manufacturers or suppliers. With the method or the device according to the invention, for this the combination of goods inside a warehouse is thereby possible even by employees with no knowledge of the configuration of the warehouse and no knowledge of the location and position of the goods to be combined, wherein in particular several order pickers can work simultaneously.
Claims (15)
1. Method for the visual technical support of manual order-picking processes through a device with at least one mobile unit (200), having an optical sensing detection device (202), an optical display device (201), a data processing device (203) and a data interface for wireless connection (206) to a stationary electronic data-processing system (100), which, in addition to product management software, has a connection device (102) for all active mobile units (200), characterized in that each mobile unit (200) cyclically receives navigation information, which is transmitted in the form of directions, in particular arrows (205), via the optical display device (201), wherein data for the specific navigation based on a data comparison of the data from the respective optical sensing detection device (202) with reference data or model data of a warehouse in the data-processing system (100) or the mobile unit (200), on the one hand, and the position of a current target object (500) of an assigned route-optimized list of goods transmitted by the data processing system (100) to the mobile unit (200), on the other hand, are cyclically determined and transmitted addressed to the assigned mobile unit (200) and the new navigation information for the next object of the list of goods does not occur until after the optical detection of the current target object (500) or of a placeholder replacement object by the detection device (202) and clear identification of the same by the data processing device (100) and clear detection and logging of the order-picking process of a goods article from the storage location to the target location.
2. Method according to claim 1 , characterized in that before the start of navigation for a new combination of goods or supplementation of goods, a navigation to the transport aid to be currently used, in the first case empty or in the second case already partially filled, occurs and if a complete combination of goods is interrupted early, a position of the transport aid is transmitted to the stationary data-processing system (100) and stored for the subsequent continuance and completion of the order, or after successful completion of the order, the navigation of the transport aid containing the complete combination of goods to the common target position occurs.
3. Method according to claim 1 , characterized in that a movement not authorized by the stationary data processing system of an object from its storage location or from the transport aid or of the transport aid itself is detected with the optical sensing detection device (202) and likewise transmitted to the data-processing system (100), the software of which recognizes the error and triggers corresponding warning messages to the optical display device (201) of the mobile unit (200) by transmitting an error code.
4. Method according to claim 3 , characterized in that an acoustic alarm is triggered in the case of optically detected errors.
5. Method according to claim 1 , characterized in that inertial sensors with complete detection of a movement and orientation of an order picker are used for support or monitoring in the detection of the position and orientation, wherein the inertial sensors are optionally calibrated by fixed optically detected markers, and conversely, movable optically detected objects are checked with respect to their desired location.
6. Device for carrying out the method according to claim 1 , with at least one mobile unit (200) with optical sensing detection device (202), optical display device (201), data processing device and software for image data processing and data transmission and with wireless data interface to a central electronic data processing device or data processing system (100), characterized in that geographic arrangements of warehouse facilities and/or optical conditions through shape, color and/or pattern, in particular by poster-like attachments are suitably designed and are clearly described with complete geographic precision and stored in the system in order to ensure for as many objects as possible that are detectable in a warehouse by the optical sensing detection device (202) during an order picking, a clear determination and assignment of the position and the orientation with the aid of geometric similarity algorithms in the central and/or in the mobile data processing device.
7. Device according to claim 6 , characterized in that the optical sensing detection device (202) is a pattern scanner with laser, in particular a barcode scanner, and the current position and orientation information in attachments on the floor, on walls, goods or shelves by pattern, in particular barcodes, can be determined by the data processing device of the mobile unit (200) or after transmission of the pattern information by the central data processing system (100).
8. Device according to claim 6 , characterized in that passive transponders (RFID tags) are attached to support position analysis in the warehouse, and transponder reader devices are provided in the mobile unit (200), wherein a code of the transponder permits inferences to be made on the position, orientation and/or designation of the product.
9. Device according to claim 6 , characterized in that the optical sensing detection device (202) is a camera module, through which the current position and orientation or product information can be determined from colors, shapes and patterns with the aid of image data analysis, supported by attachments on the floor, on walls, shelves, storage locations or on the product, by the mobile unit (200), optionally after image transmission by the data processing system (100).
10. Device according to claim 6 , characterized in that the optical display device (201) is formed by light-emitting diodes, a display, in particular a liquid crystal display (LCD) or organic light emitting display (OLED), or combinations thereof, wherein the optical display device (201) is suitable for showing the direction of travel in coded form or by directions, in particular in the form of directional arrows, which always indicate the correct route, regardless of the orientation of the mobile unit (200).
11. Device according to claim 6 , characterized in that the optical display device (201) is formed by a laser projector, which projects directions on surrounding objects, in particular a floor, and upon recognition, marks the respective target object (500).
12. Device according to claim 6 , characterized in that an inertial sensor is provided for additional detection of a movement or rotary movement of the mobile unit (200).
13. Device according to claim 11 , characterized in that the laser device of the laser projector is used additionally as a scanner laser, the reflected light of which an optical sensor captures with code information of code markings, in particular barcode markings.
14. Device according to claim 13 , characterized in that at least one of the data processing devices links actually detected data, in particular video data and construed virtual data, to augmented reality data and processes them via the optical display device (201) for combined display.
15. Device according to claim 13 , characterized in that the data of the optical sensing detection device (202), either by two sensors spaced apart or through image conversion based on the stored geographic data of a warehouse structure, through a suitable optical display device render possible a three-dimensional depth effect for the viewer, in particular by detecting and/or generating offset views for each eye.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/155,804 US11312570B2 (en) | 2008-09-05 | 2014-01-15 | Method and apparatus for visual support of commission acts |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ATGM477/2008 | 2008-09-05 | ||
ATGM477/2008U AT10520U3 (en) | 2008-09-05 | 2008-09-05 | DEVICE AND METHOD FOR THE VISUAL SUPPORT OF PICKING PROCESSES |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/155,804 Continuation US11312570B2 (en) | 2008-09-05 | 2014-01-15 | Method and apparatus for visual support of commission acts |
Publications (1)
Publication Number | Publication Date |
---|---|
US20100121480A1 true US20100121480A1 (en) | 2010-05-13 |
Family
ID=40427732
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/554,600 Abandoned US20100121480A1 (en) | 2008-09-05 | 2009-09-04 | Method and apparatus for visual support of commission acts |
US14/155,804 Active 2030-06-30 US11312570B2 (en) | 2008-09-05 | 2014-01-15 | Method and apparatus for visual support of commission acts |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/155,804 Active 2030-06-30 US11312570B2 (en) | 2008-09-05 | 2014-01-15 | Method and apparatus for visual support of commission acts |
Country Status (6)
Country | Link |
---|---|
US (2) | US20100121480A1 (en) |
EP (1) | EP2161219B1 (en) |
AT (2) | AT10520U3 (en) |
DK (1) | DK2161219T3 (en) |
ES (1) | ES2377537T3 (en) |
PL (1) | PL2161219T3 (en) |
Cited By (65)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090099836A1 (en) * | 2007-07-31 | 2009-04-16 | Kopin Corporation | Mobile wireless display providing speech to speech translation and avatar simulating human attributes |
US20090209205A1 (en) * | 2008-01-04 | 2009-08-20 | Mark Kramer | Method and apparatus for transporting video signal over bluetooth wireless interface |
US20100076592A1 (en) * | 2008-09-23 | 2010-03-25 | Inos Automationssoftware Gmbh | Method for Inserting a Part into a Storage Section of a Storage Container and Insertion Tool Arrangement |
US20110084900A1 (en) * | 2008-03-28 | 2011-04-14 | Jacobsen Jeffrey J | Handheld wireless display device having high-resolution display suitable for use as a mobile internet device |
US20110187640A1 (en) * | 2009-05-08 | 2011-08-04 | Kopin Corporation | Wireless Hands-Free Computing Headset With Detachable Accessories Controllable by Motion, Body Gesture and/or Vocal Commands |
US20110194029A1 (en) * | 2010-02-05 | 2011-08-11 | Kopin Corporation | Touch sensor for controlling eyewear |
JP2012079129A (en) * | 2010-10-01 | 2012-04-19 | Sony Corp | Image processing apparatus, program, and image processing method |
DE102011010956A1 (en) * | 2011-02-10 | 2012-08-16 | Theodor Schuldes | Apparatus for stimulating brain activity of subject e.g. patient during electroencephalography (EEG) measurement, has stimulation unit which is controlled in dependence of measured value of measuring device through computer |
EP2554496A1 (en) * | 2011-08-04 | 2013-02-06 | TriAhead GmbH | Picking management system for a warehouse, method for picking warehouse items located in a warehouse as well as a computer programme for carrying out such a method |
GB2493629A (en) * | 2011-08-09 | 2013-02-13 | Asset Works Ltd | System for auditing assets |
WO2014053436A1 (en) * | 2012-10-01 | 2014-04-10 | Stephan Hammelbacher | Method and device for organising at least one object |
US8706170B2 (en) | 2010-09-20 | 2014-04-22 | Kopin Corporation | Miniature communications gateway for head mounted display |
US20140139654A1 (en) * | 2011-07-06 | 2014-05-22 | Masaki Takahashi | Pickup system and pickup method |
US8736516B2 (en) | 2010-09-20 | 2014-05-27 | Kopin Corporation | Bluetooth or other wireless interface with power management for head mounted display |
US20140214597A1 (en) * | 2013-01-30 | 2014-07-31 | Wal-Mart Stores, Inc. | Method And System For Managing An Electronic Shopping List With Gestures |
USD713406S1 (en) | 2012-11-30 | 2014-09-16 | Kopin Corporation | Headset computer with reversible display |
WO2014159140A1 (en) * | 2013-03-14 | 2014-10-02 | Valve Corporation | Head-mounted display |
US8862186B2 (en) | 2010-09-21 | 2014-10-14 | Kopin Corporation | Lapel microphone micro-display system incorporating mobile information access system |
US8929954B2 (en) | 2012-04-25 | 2015-01-06 | Kopin Corporation | Headset computer (HSC) as auxiliary display with ASR and HT input |
US8970960B2 (en) | 2011-12-22 | 2015-03-03 | Mattel, Inc. | Augmented reality head gear |
US20150062114A1 (en) * | 2012-10-23 | 2015-03-05 | Andrew Ofstad | Displaying textual information related to geolocated images |
US9134793B2 (en) | 2013-01-04 | 2015-09-15 | Kopin Corporation | Headset computer with head tracking input used for inertial control |
US9160064B2 (en) | 2012-12-28 | 2015-10-13 | Kopin Corporation | Spatially diverse antennas for a headset computer |
US20160004306A1 (en) * | 2010-07-23 | 2016-01-07 | Telepatheye Inc. | Eye-wearable device user interface and augmented reality method |
US9301085B2 (en) | 2013-02-20 | 2016-03-29 | Kopin Corporation | Computer headset with detachable 4G radio |
JP2016056024A (en) * | 2014-09-09 | 2016-04-21 | トーヨーカネツソリューションズ株式会社 | Picking supporting system and picking supporting method |
US20160176635A1 (en) * | 2014-12-23 | 2016-06-23 | Symbol Technologies, Inc. | Method, device and system for picking items in a warehouse |
US9378028B2 (en) | 2012-05-31 | 2016-06-28 | Kopin Corporation | Headset computer (HSC) with docking station and dual personality |
US9377862B2 (en) | 2010-09-20 | 2016-06-28 | Kopin Corporation | Searchlight navigation using headtracker to reveal hidden or extra document data |
JP2016128351A (en) * | 2015-01-09 | 2016-07-14 | サトーホールディングス株式会社 | Picking work support system, picking work support method, and picking work support program |
US20160261300A1 (en) * | 2014-10-24 | 2016-09-08 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US9442290B2 (en) | 2012-05-10 | 2016-09-13 | Kopin Corporation | Headset computer operation using vehicle sensor feedback for remote control vehicle |
US9620144B2 (en) | 2013-01-04 | 2017-04-11 | Kopin Corporation | Confirmation of speech commands for control of headset computers |
US9632313B1 (en) * | 2014-03-27 | 2017-04-25 | Amazon Technologies, Inc. | Augmented reality user interface facilitating fulfillment |
US20170228684A1 (en) * | 2016-02-09 | 2017-08-10 | Teletracking Technologies, Inc. | Computerized data processing systems and methods for generating graphical user interfaces |
WO2017135197A1 (en) * | 2016-02-01 | 2017-08-10 | オークラ輸送機株式会社 | Instruction device and sortation system |
CN107222711A (en) * | 2017-05-27 | 2017-09-29 | 北方民族大学 | Monitoring system, method and the client of warehoused cargo |
WO2017179577A1 (en) * | 2016-04-15 | 2017-10-19 | 裕之 本地川 | Picking work management system and program |
US9817232B2 (en) | 2010-09-20 | 2017-11-14 | Kopin Corporation | Head movement controlled navigation among multiple boards for display in a headset computer |
US9858722B2 (en) | 2014-10-24 | 2018-01-02 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
CN107944781A (en) * | 2016-10-12 | 2018-04-20 | 菜鸟智能物流控股有限公司 | Method and device for providing prompt information of stored object |
US20180150903A1 (en) * | 2016-11-30 | 2018-05-31 | Bank Of America Corporation | Geolocation Notifications Using Augmented Reality User Devices |
US10013976B2 (en) | 2010-09-20 | 2018-07-03 | Kopin Corporation | Context sensitive overlays in voice controlled headset computer displays |
WO2018163769A1 (en) * | 2017-03-10 | 2018-09-13 | Ricoh Company, Ltd. | Information processing system, information processing method, and computer-readable recording medium |
US10078916B2 (en) * | 2016-07-01 | 2018-09-18 | Invia Robotics, Inc. | Pick to augmented reality |
US20180341454A1 (en) * | 2015-07-06 | 2018-11-29 | Seiko Epson Corporation | Display system, display apparatus, method for controlling display apparatus, and program |
US20180349837A1 (en) * | 2017-05-19 | 2018-12-06 | Hcl Technologies Limited | System and method for inventory management within a warehouse |
US20190122174A1 (en) * | 2017-08-15 | 2019-04-25 | United Parcel Service Of America, Inc. | Hands-free augmented reality system for picking and/or sorting assets |
US10410170B1 (en) | 2014-06-18 | 2019-09-10 | Amazon Technologies, Inc. | Propagating and expiring presentation information |
US10423866B2 (en) * | 2014-03-26 | 2019-09-24 | Bull Sas | Method for managing the devices of a data centre |
US20190294841A1 (en) * | 2018-03-22 | 2019-09-26 | David R. Hall | Augmented Reality Navigation System |
US10438259B1 (en) * | 2013-12-09 | 2019-10-08 | Amazon Technologies, Inc. | Propagating and presenting user specific information |
US20190340909A1 (en) * | 2018-05-02 | 2019-11-07 | Rockwell Automation Technologies, Inc. | Advanced industrial safety notification systems |
US10558857B2 (en) * | 2018-03-05 | 2020-02-11 | A9.Com, Inc. | Visual feedback of process state |
JP2020504696A (en) * | 2016-10-21 | 2020-02-13 | トルンプフ ヴェルクツォイクマシーネン ゲゼルシャフト ミット ベシュレンクテル ハフツング ウント コンパニー コマンディートゲゼルシャフトTrumpf Werkzeugmaschinen GmbH + Co. KG | Sorting support method and flatbed machine tool |
US10592726B2 (en) | 2018-02-08 | 2020-03-17 | Ford Motor Company | Manufacturing part identification using computer vision and machine learning |
US10614538B2 (en) * | 2016-08-16 | 2020-04-07 | Walmart Apollo, Llc | Object detection using autonomous robot devices |
US10627860B2 (en) | 2011-05-10 | 2020-04-21 | Kopin Corporation | Headset computer that uses motion and voice commands to control information display and remote devices |
US10685324B2 (en) * | 2017-05-19 | 2020-06-16 | Hcl Technologies Limited | Method and system for optimizing storage and retrieval of a stock keeping unit (SKU) |
CN112985431A (en) * | 2019-12-13 | 2021-06-18 | 北京宝沃汽车股份有限公司 | Navigation method and device of vehicle and vehicle |
US11059076B2 (en) | 2016-10-21 | 2021-07-13 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Sorting support methods, sorting systems, and flatbed machine tools |
CN113247519A (en) * | 2021-05-13 | 2021-08-13 | 大捷智能科技(广东)有限公司 | Intelligent loading and unloading device and method for visual control |
US11307411B2 (en) | 2012-06-29 | 2022-04-19 | Toyo Kanetsu Solutions K.K. | Support device and system for article picking or sorting work |
US11580684B2 (en) | 2016-11-02 | 2023-02-14 | United Parcel Service Of America, Inc. | Displaying items of interest in an augmented reality environment |
US11703345B2 (en) | 2017-08-15 | 2023-07-18 | United Parcel Service Of America, Inc. | Hands-free augmented reality system for picking and/or sorting assets |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2378470A1 (en) * | 2010-04-14 | 2011-10-19 | Alcatel Lucent | System for guiding an operator on a storage site |
DE202011107932U1 (en) | 2011-11-16 | 2012-01-18 | Knapp Ag | Device for a semi-automatic test station |
DE102011118611A1 (en) | 2011-11-16 | 2013-05-16 | Knapp Ag | Apparatus and method for a semi-automatic testing station |
DE102012203550B4 (en) * | 2012-03-07 | 2018-01-25 | Siemens Aktiengesellschaft | Generation of trigger events using RFID tags |
US8978263B2 (en) * | 2012-07-31 | 2015-03-17 | Mitutoyo Corporation | Handheld measurement tool with user defined display |
AT513130B1 (en) | 2012-08-24 | 2014-02-15 | Tgw Logistics Group Gmbh | Method and system for assisting a worker in a facility for manipulating goods |
EP2711880B1 (en) | 2012-09-24 | 2021-06-23 | KNAPP Systemintegration GmbH | Method and device for picking goods in a warehouse |
DE102012023535A1 (en) * | 2012-11-30 | 2014-06-05 | Diehl Metering Systems Gmbh | Portable data acquisition device |
WO2016142997A1 (en) * | 2015-03-06 | 2016-09-15 | 株式会社日立物流 | Work supporting system, terminal device, and server device |
US20160300179A1 (en) * | 2015-04-13 | 2016-10-13 | Real Picking, LLC | Holographic picking system and method for picking products utilizing a holographic picking system |
DE102015117554B4 (en) | 2015-10-15 | 2018-03-29 | Peroba Unternehmensberatung Gmbh | Device and method for visual technical support of manual picking operations |
EP3168799A1 (en) * | 2015-11-11 | 2017-05-17 | Berlinger System Engineering GmbH | Picking method |
US10600109B2 (en) | 2016-01-11 | 2020-03-24 | Honeywell International Inc. | Tag for order fulfillment |
US10875713B2 (en) | 2016-03-04 | 2020-12-29 | Ubimax Gmbh | Method for technically supporting a manual order picking process |
US10339497B2 (en) * | 2016-07-21 | 2019-07-02 | Ebay Inc. | System and method for dynamic inventory management |
DE102017107357A1 (en) | 2016-10-21 | 2018-04-26 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Absortierunterstützungsverfahren, Absortiersystem and flatbed machine tool |
EP3324709A1 (en) * | 2016-11-18 | 2018-05-23 | Technische Universität München | Illumination system, method for illuminating an object and vehicle |
WO2018140555A1 (en) | 2017-01-30 | 2018-08-02 | Walmart Apollo, Llc | Systems, methods and apparatus for distribution of products and supply chain management |
WO2018183292A1 (en) | 2017-03-29 | 2018-10-04 | Walmart Apollo, Llc | Retail inventory supply chain management |
DE102018201467A1 (en) | 2018-01-31 | 2019-08-01 | Bayerische Motoren Werke Aktiengesellschaft | Method and device for visualizing work steps in a production process |
CN109472528B (en) * | 2018-10-23 | 2021-07-20 | 佛山欧神诺云商科技有限公司 | Automatic cargo allocation method and device |
DE102019116357A1 (en) * | 2019-06-17 | 2020-12-17 | Ssi Schäfer Automation Gmbh | System for technical support of a manual picking process |
US11488235B2 (en) | 2019-10-07 | 2022-11-01 | Oculogx Inc. | Systems, methods, and devices for utilizing wearable technology to facilitate fulfilling customer orders |
DE102022120389A1 (en) * | 2022-08-12 | 2024-02-15 | Ssi Schäfer Automation Gmbh (At) | Intralogistics system for monitoring location-specific intralogistics actions |
Citations (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5745387A (en) * | 1995-09-28 | 1998-04-28 | General Electric Company | Augmented reality maintenance system employing manipulator arm with archive and comparison device |
US5877962A (en) * | 1993-10-25 | 1999-03-02 | Radcliffe; Frederick W. | Cart |
US6345207B1 (en) * | 1997-07-15 | 2002-02-05 | Honda Giken Kogyo Kabushiki Kaisha | Job aiding apparatus |
US20020191002A1 (en) * | 1999-11-09 | 2002-12-19 | Siemens Ag | System and method for object-oriented marking and associating information with selected technological components |
US6711458B1 (en) * | 1999-07-19 | 2004-03-23 | Apport Systems A/S | Handling system and indication system for same |
US20040138781A1 (en) * | 2002-12-23 | 2004-07-15 | Sacks Jerry Dennis | Method for object selection |
US20040153207A1 (en) * | 2003-01-30 | 2004-08-05 | Peck John C. | Distributed intelligence, wireless, light-directed pick/put system |
US20040164926A1 (en) * | 2003-02-10 | 2004-08-26 | Schonlau William J. | Personal viewer |
US20040183751A1 (en) * | 2001-10-19 | 2004-09-23 | Dempski Kelly L | Industrial augmented reality |
US20050071234A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Radio frequency identification tag on picking container and display of picklist to order filler |
US20050140498A1 (en) * | 2000-12-11 | 2005-06-30 | Bastian William A.Ii | Inventory system with barcode display |
US20060119761A1 (en) * | 2004-11-30 | 2006-06-08 | Tatsumi Okuda | Display and mobile device |
US20060136129A1 (en) * | 2004-12-17 | 2006-06-22 | Seiko Epson Corporation | Guidance information system and portable device |
US7096650B2 (en) * | 2004-10-01 | 2006-08-29 | Blueprint Holding B.V. | Device for filling a carton |
US20060287759A1 (en) * | 2005-06-17 | 2006-12-21 | Epc4Ro1 Limited Partnership | Self-contained RF identification apparatus for pallet conveyances |
US20070035563A1 (en) * | 2005-08-12 | 2007-02-15 | The Board Of Trustees Of Michigan State University | Augmented reality spatial interaction and navigational system |
US20090182499A1 (en) * | 2008-01-11 | 2009-07-16 | Ncr Corporation | Method and apparatus for augmented reality shopping assistant |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3434572A1 (en) * | 1984-09-20 | 1986-03-27 | VVA - Vereinigte Verlagsauslieferung GmbH, 4830 Gütersloh | Method and device for commissioning books placed in readiness in a store |
DE10041104C1 (en) | 2000-08-22 | 2002-03-07 | Siemens Ag | Device and method for communication between a mobile data processing device and a stationary data processing device |
WO2003078112A2 (en) | 2002-03-20 | 2003-09-25 | Volkswagen Aktiengesellschaft | Automatic process control |
DE10215885A1 (en) * | 2002-03-20 | 2003-10-02 | Volkswagen Ag | Automatic process control |
KR100586818B1 (en) | 2004-02-18 | 2006-06-08 | 한국과학기술원 | Head mounted display using augmented reality |
AT500727A3 (en) | 2004-09-14 | 2007-03-15 | Knapp Logistik Automation | picking |
DE102006025934A1 (en) | 2006-06-02 | 2007-12-06 | Dematic Gmbh & Co. Kg | Method for picking articles in a picking system and an intermediate storage device with picking locations |
-
2008
- 2008-09-05 AT ATGM477/2008U patent/AT10520U3/en not_active IP Right Cessation
-
2009
- 2009-09-02 DK DK09169213.7T patent/DK2161219T3/en active
- 2009-09-02 AT AT09169213T patent/ATE533707T1/en active
- 2009-09-02 EP EP09169213A patent/EP2161219B1/en active Active
- 2009-09-02 PL PL09169213T patent/PL2161219T3/en unknown
- 2009-09-02 ES ES09169213T patent/ES2377537T3/en active Active
- 2009-09-04 US US12/554,600 patent/US20100121480A1/en not_active Abandoned
-
2014
- 2014-01-15 US US14/155,804 patent/US11312570B2/en active Active
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5877962A (en) * | 1993-10-25 | 1999-03-02 | Radcliffe; Frederick W. | Cart |
US5745387A (en) * | 1995-09-28 | 1998-04-28 | General Electric Company | Augmented reality maintenance system employing manipulator arm with archive and comparison device |
US6345207B1 (en) * | 1997-07-15 | 2002-02-05 | Honda Giken Kogyo Kabushiki Kaisha | Job aiding apparatus |
US6711458B1 (en) * | 1999-07-19 | 2004-03-23 | Apport Systems A/S | Handling system and indication system for same |
US20020191002A1 (en) * | 1999-11-09 | 2002-12-19 | Siemens Ag | System and method for object-oriented marking and associating information with selected technological components |
US20050140498A1 (en) * | 2000-12-11 | 2005-06-30 | Bastian William A.Ii | Inventory system with barcode display |
US20040183751A1 (en) * | 2001-10-19 | 2004-09-23 | Dempski Kelly L | Industrial augmented reality |
US20040138781A1 (en) * | 2002-12-23 | 2004-07-15 | Sacks Jerry Dennis | Method for object selection |
US7143041B2 (en) * | 2002-12-23 | 2006-11-28 | System Application Engineering, Inc. | Method for object selection |
US20040153207A1 (en) * | 2003-01-30 | 2004-08-05 | Peck John C. | Distributed intelligence, wireless, light-directed pick/put system |
US20040164926A1 (en) * | 2003-02-10 | 2004-08-26 | Schonlau William J. | Personal viewer |
US20050071234A1 (en) * | 2003-09-30 | 2005-03-31 | Microsoft Corporation | Radio frequency identification tag on picking container and display of picklist to order filler |
US7096650B2 (en) * | 2004-10-01 | 2006-08-29 | Blueprint Holding B.V. | Device for filling a carton |
US20060119761A1 (en) * | 2004-11-30 | 2006-06-08 | Tatsumi Okuda | Display and mobile device |
US20060136129A1 (en) * | 2004-12-17 | 2006-06-22 | Seiko Epson Corporation | Guidance information system and portable device |
US20060287759A1 (en) * | 2005-06-17 | 2006-12-21 | Epc4Ro1 Limited Partnership | Self-contained RF identification apparatus for pallet conveyances |
US20070035563A1 (en) * | 2005-08-12 | 2007-02-15 | The Board Of Trustees Of Michigan State University | Augmented reality spatial interaction and navigational system |
US20090182499A1 (en) * | 2008-01-11 | 2009-07-16 | Ncr Corporation | Method and apparatus for augmented reality shopping assistant |
Non-Patent Citations (2)
Title |
---|
Mueck et al. "Augmented Reality appications for Warehouse Logistics" Soft Computing as Transdisciplinary Science and Technology. Advances in Soft Computing Volume 29, 2005, pp 1053-1062 * |
Schwerdtfeger et al. "Mobile Information Presentation Schemes for Supra-adaptive Logistics Applications" Advances in Artificial Reality and Tele-Existence Lecture Notes in Computer Science Volume 4282, 2006, pp 998-1007 * |
Cited By (107)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090099836A1 (en) * | 2007-07-31 | 2009-04-16 | Kopin Corporation | Mobile wireless display providing speech to speech translation and avatar simulating human attributes |
US8825468B2 (en) | 2007-07-31 | 2014-09-02 | Kopin Corporation | Mobile wireless display providing speech to speech translation and avatar simulating human attributes |
US20090209205A1 (en) * | 2008-01-04 | 2009-08-20 | Mark Kramer | Method and apparatus for transporting video signal over bluetooth wireless interface |
US10474418B2 (en) | 2008-01-04 | 2019-11-12 | BlueRadios, Inc. | Head worn wireless computer having high-resolution display suitable for use as a mobile internet device |
US10579324B2 (en) | 2008-01-04 | 2020-03-03 | BlueRadios, Inc. | Head worn wireless computer having high-resolution display suitable for use as a mobile internet device |
US8355671B2 (en) | 2008-01-04 | 2013-01-15 | Kopin Corporation | Method and apparatus for transporting video signal over Bluetooth wireless interface |
US20110084900A1 (en) * | 2008-03-28 | 2011-04-14 | Jacobsen Jeffrey J | Handheld wireless display device having high-resolution display suitable for use as a mobile internet device |
US9886231B2 (en) | 2008-03-28 | 2018-02-06 | Kopin Corporation | Head worn wireless computer having high-resolution display suitable for use as a mobile internet device |
US20100076592A1 (en) * | 2008-09-23 | 2010-03-25 | Inos Automationssoftware Gmbh | Method for Inserting a Part into a Storage Section of a Storage Container and Insertion Tool Arrangement |
US8078312B2 (en) * | 2008-09-23 | 2011-12-13 | Inos Automationssoftware Gmbh | Methods for inserting a part into a storage section of a storage container and insertion tool arrangement |
US20110187640A1 (en) * | 2009-05-08 | 2011-08-04 | Kopin Corporation | Wireless Hands-Free Computing Headset With Detachable Accessories Controllable by Motion, Body Gesture and/or Vocal Commands |
US8855719B2 (en) | 2009-05-08 | 2014-10-07 | Kopin Corporation | Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands |
US8665177B2 (en) | 2010-02-05 | 2014-03-04 | Kopin Corporation | Touch sensor for controlling eyewear |
US20110194029A1 (en) * | 2010-02-05 | 2011-08-11 | Kopin Corporation | Touch sensor for controlling eyewear |
US20160004306A1 (en) * | 2010-07-23 | 2016-01-07 | Telepatheye Inc. | Eye-wearable device user interface and augmented reality method |
US9977496B2 (en) * | 2010-07-23 | 2018-05-22 | Telepatheye Inc. | Eye-wearable device user interface and augmented reality method |
US8706170B2 (en) | 2010-09-20 | 2014-04-22 | Kopin Corporation | Miniature communications gateway for head mounted display |
US9152378B2 (en) | 2010-09-20 | 2015-10-06 | Kopin Corporation | Bluetooth or other wireless interface with power management for head mounted display |
US8736516B2 (en) | 2010-09-20 | 2014-05-27 | Kopin Corporation | Bluetooth or other wireless interface with power management for head mounted display |
US9817232B2 (en) | 2010-09-20 | 2017-11-14 | Kopin Corporation | Head movement controlled navigation among multiple boards for display in a headset computer |
US9377862B2 (en) | 2010-09-20 | 2016-06-28 | Kopin Corporation | Searchlight navigation using headtracker to reveal hidden or extra document data |
US10013976B2 (en) | 2010-09-20 | 2018-07-03 | Kopin Corporation | Context sensitive overlays in voice controlled headset computer displays |
US8862186B2 (en) | 2010-09-21 | 2014-10-14 | Kopin Corporation | Lapel microphone micro-display system incorporating mobile information access system |
JP2012079129A (en) * | 2010-10-01 | 2012-04-19 | Sony Corp | Image processing apparatus, program, and image processing method |
DE102011010956A1 (en) * | 2011-02-10 | 2012-08-16 | Theodor Schuldes | Apparatus for stimulating brain activity of subject e.g. patient during electroencephalography (EEG) measurement, has stimulation unit which is controlled in dependence of measured value of measuring device through computer |
US11237594B2 (en) | 2011-05-10 | 2022-02-01 | Kopin Corporation | Headset computer that uses motion and voice commands to control information display and remote devices |
US10627860B2 (en) | 2011-05-10 | 2020-04-21 | Kopin Corporation | Headset computer that uses motion and voice commands to control information display and remote devices |
US11947387B2 (en) | 2011-05-10 | 2024-04-02 | Kopin Corporation | Headset computer that uses motion and voice commands to control information display and remote devices |
US9544552B2 (en) * | 2011-07-06 | 2017-01-10 | Inspeedia Inc. | Pickup system and pickup method |
US20140139654A1 (en) * | 2011-07-06 | 2014-05-22 | Masaki Takahashi | Pickup system and pickup method |
EP2554496A1 (en) * | 2011-08-04 | 2013-02-06 | TriAhead GmbH | Picking management system for a warehouse, method for picking warehouse items located in a warehouse as well as a computer programme for carrying out such a method |
GB2493629A (en) * | 2011-08-09 | 2013-02-13 | Asset Works Ltd | System for auditing assets |
US8970960B2 (en) | 2011-12-22 | 2015-03-03 | Mattel, Inc. | Augmented reality head gear |
US9294607B2 (en) | 2012-04-25 | 2016-03-22 | Kopin Corporation | Headset computer (HSC) as auxiliary display with ASR and HT input |
US8929954B2 (en) | 2012-04-25 | 2015-01-06 | Kopin Corporation | Headset computer (HSC) as auxiliary display with ASR and HT input |
US9442290B2 (en) | 2012-05-10 | 2016-09-13 | Kopin Corporation | Headset computer operation using vehicle sensor feedback for remote control vehicle |
US9378028B2 (en) | 2012-05-31 | 2016-06-28 | Kopin Corporation | Headset computer (HSC) with docking station and dual personality |
US11307411B2 (en) | 2012-06-29 | 2022-04-19 | Toyo Kanetsu Solutions K.K. | Support device and system for article picking or sorting work |
US10380542B2 (en) | 2012-10-01 | 2019-08-13 | Stephan Hammelbacher | Method and device for process tracking of operations or services relating to at least one object |
WO2014053436A1 (en) * | 2012-10-01 | 2014-04-10 | Stephan Hammelbacher | Method and device for organising at least one object |
US20150062114A1 (en) * | 2012-10-23 | 2015-03-05 | Andrew Ofstad | Displaying textual information related to geolocated images |
USD713406S1 (en) | 2012-11-30 | 2014-09-16 | Kopin Corporation | Headset computer with reversible display |
US9160064B2 (en) | 2012-12-28 | 2015-10-13 | Kopin Corporation | Spatially diverse antennas for a headset computer |
US9620144B2 (en) | 2013-01-04 | 2017-04-11 | Kopin Corporation | Confirmation of speech commands for control of headset computers |
US9134793B2 (en) | 2013-01-04 | 2015-09-15 | Kopin Corporation | Headset computer with head tracking input used for inertial control |
US20140214597A1 (en) * | 2013-01-30 | 2014-07-31 | Wal-Mart Stores, Inc. | Method And System For Managing An Electronic Shopping List With Gestures |
US9449340B2 (en) * | 2013-01-30 | 2016-09-20 | Wal-Mart Stores, Inc. | Method and system for managing an electronic shopping list with gestures |
US9301085B2 (en) | 2013-02-20 | 2016-03-29 | Kopin Corporation | Computer headset with detachable 4G radio |
WO2014159140A1 (en) * | 2013-03-14 | 2014-10-02 | Valve Corporation | Head-mounted display |
US10438259B1 (en) * | 2013-12-09 | 2019-10-08 | Amazon Technologies, Inc. | Propagating and presenting user specific information |
US11501353B1 (en) | 2013-12-09 | 2022-11-15 | Amazon Technologies, Inc. | System and methods for adjusting presentation across devices to account for different processing times |
US10423866B2 (en) * | 2014-03-26 | 2019-09-24 | Bull Sas | Method for managing the devices of a data centre |
US10055645B1 (en) * | 2014-03-27 | 2018-08-21 | Amazon Technologies, Inc. | Augmented reality user interface facilitating fulfillment |
US9632313B1 (en) * | 2014-03-27 | 2017-04-25 | Amazon Technologies, Inc. | Augmented reality user interface facilitating fulfillment |
US10963836B1 (en) | 2014-06-18 | 2021-03-30 | Amazon Technologies, Inc. | Expiring presentation information |
US10410170B1 (en) | 2014-06-18 | 2019-09-10 | Amazon Technologies, Inc. | Propagating and expiring presentation information |
JP2016056024A (en) * | 2014-09-09 | 2016-04-21 | トーヨーカネツソリューションズ株式会社 | Picking supporting system and picking supporting method |
US9858722B2 (en) | 2014-10-24 | 2018-01-02 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US20160261300A1 (en) * | 2014-10-24 | 2016-09-08 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US10320437B2 (en) * | 2014-10-24 | 2019-06-11 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US10256859B2 (en) | 2014-10-24 | 2019-04-09 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US10223834B2 (en) | 2014-10-24 | 2019-03-05 | Usens, Inc. | System and method for immersive and interactive multimedia generation |
US9834379B2 (en) * | 2014-12-23 | 2017-12-05 | Symbol Technologies, Llc | Method, device and system for picking items in a warehouse |
US20160176635A1 (en) * | 2014-12-23 | 2016-06-23 | Symbol Technologies, Inc. | Method, device and system for picking items in a warehouse |
WO2016105744A1 (en) * | 2014-12-23 | 2016-06-30 | Symbol Technologies, Llc | A method, device and system for picking items in a warehouse |
JP2016128351A (en) * | 2015-01-09 | 2016-07-14 | サトーホールディングス株式会社 | Picking work support system, picking work support method, and picking work support program |
US20180341454A1 (en) * | 2015-07-06 | 2018-11-29 | Seiko Epson Corporation | Display system, display apparatus, method for controlling display apparatus, and program |
US10564919B2 (en) * | 2015-07-06 | 2020-02-18 | Seiko Epson Corporation | Display system, display apparatus, method for controlling display apparatus, and program |
KR102105783B1 (en) | 2016-02-01 | 2020-04-28 | 오쿠라 유소키 가부시키가이샤 | Pointing device and sorting system |
TWI701540B (en) * | 2016-02-01 | 2020-08-11 | 日商大庫輸送機股份有限公司 | Instruction device and classification system |
CN108473253A (en) * | 2016-02-01 | 2018-08-31 | 大库输送机株式会社 | Instruction device and categorizing system |
KR20180094998A (en) * | 2016-02-01 | 2018-08-24 | 오쿠라 유소키 가부시키가이샤 | Indicator and classification system |
WO2017135197A1 (en) * | 2016-02-01 | 2017-08-10 | オークラ輸送機株式会社 | Instruction device and sortation system |
US10467566B2 (en) * | 2016-02-09 | 2019-11-05 | Teletracking Technologies, Inc. | Computerized data processing systems and methods for generating graphical user interfaces |
US20170228684A1 (en) * | 2016-02-09 | 2017-08-10 | Teletracking Technologies, Inc. | Computerized data processing systems and methods for generating graphical user interfaces |
US11663537B1 (en) * | 2016-02-09 | 2023-05-30 | Teletracking Technologies, Inc. | Computerized data processing systems and methods for generating graphical user interfaces |
US10977590B2 (en) * | 2016-02-09 | 2021-04-13 | Teletracking Technologies, Inc. | Computerized data processing systems and methods for generating graphical user interfaces |
WO2017179577A1 (en) * | 2016-04-15 | 2017-10-19 | 裕之 本地川 | Picking work management system and program |
US10078916B2 (en) * | 2016-07-01 | 2018-09-18 | Invia Robotics, Inc. | Pick to augmented reality |
US10614538B2 (en) * | 2016-08-16 | 2020-04-07 | Walmart Apollo, Llc | Object detection using autonomous robot devices |
US11361270B2 (en) | 2016-10-12 | 2022-06-14 | Cainiao Smart Logistics Holding Limited | Method and system for providing information of stored object |
CN107944781A (en) * | 2016-10-12 | 2018-04-20 | 菜鸟智能物流控股有限公司 | Method and device for providing prompt information of stored object |
US11059076B2 (en) | 2016-10-21 | 2021-07-13 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Sorting support methods, sorting systems, and flatbed machine tools |
US11358180B2 (en) | 2016-10-21 | 2022-06-14 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Workpiece collecting point units and methods for supporting the processing of workpieces |
JP2020504696A (en) * | 2016-10-21 | 2020-02-13 | トルンプフ ヴェルクツォイクマシーネン ゲゼルシャフト ミット ベシュレンクテル ハフツング ウント コンパニー コマンディートゲゼルシャフトTrumpf Werkzeugmaschinen GmbH + Co. KG | Sorting support method and flatbed machine tool |
JP6993061B2 (en) | 2016-10-21 | 2022-01-13 | トルンプフ ヴェルクツォイクマシーネン ゲゼルシャフト ミット ベシュレンクテル ハフツング ウント コンパニー コマンディートゲゼルシャフト | Sorting support method and flatbed machine tool |
US11009856B2 (en) | 2016-10-21 | 2021-05-18 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Sorting support method and flatbed machine tool |
US11580684B2 (en) | 2016-11-02 | 2023-02-14 | United Parcel Service Of America, Inc. | Displaying items of interest in an augmented reality environment |
US11935169B2 (en) | 2016-11-02 | 2024-03-19 | United Parcel Service Of America, Inc. | Displaying items of interest in an augmented reality environment |
US10600111B2 (en) * | 2016-11-30 | 2020-03-24 | Bank Of America Corporation | Geolocation notifications using augmented reality user devices |
US20180150903A1 (en) * | 2016-11-30 | 2018-05-31 | Bank Of America Corporation | Geolocation Notifications Using Augmented Reality User Devices |
WO2018163769A1 (en) * | 2017-03-10 | 2018-09-13 | Ricoh Company, Ltd. | Information processing system, information processing method, and computer-readable recording medium |
US10685324B2 (en) * | 2017-05-19 | 2020-06-16 | Hcl Technologies Limited | Method and system for optimizing storage and retrieval of a stock keeping unit (SKU) |
US20180349837A1 (en) * | 2017-05-19 | 2018-12-06 | Hcl Technologies Limited | System and method for inventory management within a warehouse |
CN107222711A (en) * | 2017-05-27 | 2017-09-29 | 北方民族大学 | Monitoring system, method and the client of warehoused cargo |
US11703345B2 (en) | 2017-08-15 | 2023-07-18 | United Parcel Service Of America, Inc. | Hands-free augmented reality system for picking and/or sorting assets |
US20190122174A1 (en) * | 2017-08-15 | 2019-04-25 | United Parcel Service Of America, Inc. | Hands-free augmented reality system for picking and/or sorting assets |
US11797910B2 (en) * | 2017-08-15 | 2023-10-24 | United Parcel Service Of America, Inc. | Hands-free augmented reality system for picking and/or sorting assets |
US10592726B2 (en) | 2018-02-08 | 2020-03-17 | Ford Motor Company | Manufacturing part identification using computer vision and machine learning |
US11093748B2 (en) | 2018-03-05 | 2021-08-17 | A9.Com, Inc. | Visual feedback of process state |
US10558857B2 (en) * | 2018-03-05 | 2020-02-11 | A9.Com, Inc. | Visual feedback of process state |
US10546169B2 (en) * | 2018-03-22 | 2020-01-28 | Hall Labs Llc | Augmented reality navigation system |
US20190294841A1 (en) * | 2018-03-22 | 2019-09-26 | David R. Hall | Augmented Reality Navigation System |
US10832548B2 (en) * | 2018-05-02 | 2020-11-10 | Rockwell Automation Technologies, Inc. | Advanced industrial safety notification systems |
US20190340909A1 (en) * | 2018-05-02 | 2019-11-07 | Rockwell Automation Technologies, Inc. | Advanced industrial safety notification systems |
CN112985431A (en) * | 2019-12-13 | 2021-06-18 | 北京宝沃汽车股份有限公司 | Navigation method and device of vehicle and vehicle |
CN113247519A (en) * | 2021-05-13 | 2021-08-13 | 大捷智能科技(广东)有限公司 | Intelligent loading and unloading device and method for visual control |
Also Published As
Publication number | Publication date |
---|---|
EP2161219A1 (en) | 2010-03-10 |
US20140188270A1 (en) | 2014-07-03 |
AT10520U2 (en) | 2009-05-15 |
PL2161219T3 (en) | 2012-04-30 |
EP2161219B1 (en) | 2011-11-16 |
US11312570B2 (en) | 2022-04-26 |
AT10520U3 (en) | 2013-10-15 |
ATE533707T1 (en) | 2011-12-15 |
DK2161219T3 (en) | 2012-03-05 |
ES2377537T3 (en) | 2012-03-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11312570B2 (en) | Method and apparatus for visual support of commission acts | |
US11797910B2 (en) | Hands-free augmented reality system for picking and/or sorting assets | |
US10078916B2 (en) | Pick to augmented reality | |
JP6401611B2 (en) | Support apparatus and system for picking or storing goods | |
US11535451B2 (en) | Autonomous robotic system for automatically monitoring the state of shelves in shops | |
CN100390709C (en) | Item tracking and processing systems and methods | |
EP1436800B1 (en) | Industrial augmented reality | |
EP1709519B1 (en) | A virtual control panel | |
EP3005222B1 (en) | Head-mounted code scanner | |
US20090094140A1 (en) | Methods and Apparatus for Inventory and Price Information Management | |
US10242393B1 (en) | Determine an item and user action in a materials handling facility | |
JP2020106513A (en) | Drift correction for industrial augmented reality applications | |
US20200143315A1 (en) | Inventory Management System With Position Determination of Storage Goods and Associated Storage Regions | |
WO2019035879A1 (en) | Hands-free augmented reality system for picking and/or sorting assets | |
US20220073280A1 (en) | Smart warehouse, conveyor, and pallet management system | |
US20200125872A1 (en) | Micro-Fiducial For Machine Vision | |
JP2021000687A (en) | Robot system, control method for the same, and program | |
US20220144545A1 (en) | Warehouse management system, order picking and warehouse system and order picking method with eyecatching transmitters whose colors are changeable in an automatic manner | |
CN114897455A (en) | Unmanned warehouse management system and method based on display enhancement technology | |
CN115016634A (en) | Auxiliary system and method for a materials handling vehicle | |
US10692041B1 (en) | Inventory holder markers for selective glowing based on received wavelengths | |
JP2021176792A (en) | Storage position management system | |
MXPA06008354A (en) | Item tracking and processing systems and methods | |
GB2544396A (en) | Device and method for reading machine readable codes |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KNAPP SYSTEMINTEGRATION GMBH,AUSTRIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:STELZER, PETER;DAX, JOSEF;GRABLECHNER, MANFRED;REEL/FRAME:023622/0669 Effective date: 20091021 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |