US20070279481A1 - Mobile Communication Device Having Panoramic Imagemaking Capability - Google Patents

Mobile Communication Device Having Panoramic Imagemaking Capability Download PDF

Info

Publication number
US20070279481A1
US20070279481A1 US11/575,856 US57585604D US2007279481A1 US 20070279481 A1 US20070279481 A1 US 20070279481A1 US 57585604 D US57585604 D US 57585604D US 2007279481 A1 US2007279481 A1 US 2007279481A1
Authority
US
United States
Prior art keywords
camera module
mobile communication
communication device
recited
angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US11/575,856
Other versions
US7782375B2 (en
Inventor
Michael Chambers
Michael Kiessling
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bell Northern Research LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Assigned to AGERE SYSTEMS INC. reassignment AGERE SYSTEMS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHAMBERS, MICHAEL J., KIESSLING, MICHAEL
Publication of US20070279481A1 publication Critical patent/US20070279481A1/en
Application granted granted Critical
Publication of US7782375B2 publication Critical patent/US7782375B2/en
Assigned to DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT reassignment DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT PATENT SECURITY AGREEMENT Assignors: AGERE SYSTEMS LLC, LSI CORPORATION
Assigned to AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD. reassignment AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AGERE SYSTEMS LLC
Assigned to AGERE SYSTEMS LLC, LSI CORPORATION reassignment AGERE SYSTEMS LLC TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031) Assignors: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Assigned to BANK OF AMERICA, N.A., AS COLLATERAL AGENT reassignment BANK OF AMERICA, N.A., AS COLLATERAL AGENT PATENT SECURITY AGREEMENT Assignors: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Assigned to AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD. reassignment AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD. TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Assignors: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Assigned to BELL NORTHERN RESEARCH, LLC reassignment BELL NORTHERN RESEARCH, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., BROADCOM CORPORATION
Assigned to CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT reassignment CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BELL NORTHERN RESEARCH, LLC, BELL SEMICONDUCTOR, LLC, HILCO PATENT ACQUISITION 56, LLC
Assigned to HILCO PATENT ACQUISITION 56, LLC, BELL NORTHERN RESEARCH, LLC, BELL SEMICONDUCTOR, LLC reassignment HILCO PATENT ACQUISITION 56, LLC RELEASE BY SECURED PARTY (SEE DOCUMENT FOR DETAILS). Assignors: CORTLAND CAPITAL MARKET SERVICES LLC
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B1/00Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • H04M1/026Details of the structure or mounting of specific components
    • H04M1/0264Details of the structure or mounting of specific components for a camera module assembly
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/20Details of telephonic subscriber devices including a rotatable camera

Definitions

  • the present invention is directed, in general, to mobile communication devices and, more specifically, to a mobile communication device having a panoramic imagemaking capability.
  • panoramic images A dramatic type of photography involves the capturing of panoramic images.
  • mobile communication devices are increasingly used for more than just speech communication.
  • applications such as messaging services, data communication, e-mail or fax services, have become available to the users of mobile communication devices.
  • the present invention provides a mobile communication device, in particular a mobile telephone, a PDA or a MDA.
  • the mobile communication device includes: (1) a main body and (2) a camera module, coupled to the main body and configured for rotation relative to the main body about at least one axis of rotation.
  • the main body has a camera module mechanical interface
  • the camera module has a main body mechanical interface that is complementary to the camera module mechanical interface
  • the camera module is configured to be removably coupled to the main body and further configured for rotation relative to the main body about at least one axis of rotation.
  • the main body and the camera body are unitary in the former embodiment and decouplable from one another in the latter embodiment.
  • the camera module is motor-driven, such that it pans through a given angle at a given rate of angular speed and captures images at a given rate.
  • the resulting images thus relate to one another in a known way and can be automatically composited within the mobile telecommunication device without requiring manual intervention by the user.
  • FIG. 1 illustrates a front view of one embodiment of a mobile communication device having a rotatable camera module and constructed according to the principles of the present invention
  • FIG. 2A illustrates a top view of the mobile communication device of FIG. 1 showing in particular the camera module in progressive positions, in which a series of standard images for a panoramic image is captured;
  • FIG. 2B illustrates an enlarged view of the camera module of FIG. 2A ;
  • FIG. 3 illustrates a side view of a mobile communication device having a camera module that is retractable into the main body of the mobile communication device.
  • FIG. 1 illustrated is a front view of a preferred embodiment of an inventive mobile communication device 100 having a rotatable camera module 200 and constructed according to the principles of the present invention.
  • the camera module 200 is automatically rotatable about an axis of rotation 400 through angles up to and exceeding 360°.
  • the automatic rotation is achieved in the illustrated embodiment by means of a motor 300 , which is connected to the camera module 200 by a drive shaft 310 .
  • the camera module 200 comprises a flash 204 and a self-timer, which is connected to a light-emitting diode (LED) 206 for indicating an elapse of the delay time of the self-timer.
  • LED light-emitting diode
  • the camera module 200 is shown with the lens 202 facing a back side of the mobile communication device 100 , the front side being defined as the side of the mobile communication device 100 on which the display 120 and the keypad 140 are arranged. This is a typical position suitable for taking standard digital photos or video clips.
  • the camera module 200 shown in FIG. 1 is mounted at a top side of the main body 110 .
  • the camera module 200 could also be mounted at the side of the main body 110 or at any position, in which it can be automatically rotated.
  • the invention is not limited to mobile telephones, but can also be used for personal digital assistants (PDA) or mobile digital assistants (MDA) or any other conventional or later-developed mobile communication device.
  • PDA personal digital assistants
  • MDA mobile digital assistants
  • FIG. 2A illustrated is a top view of the mobile communication device of FIG. 1 showing in particular the camera module 200 in progressive positions, in which a series of standard images for a panoramic image are captured.
  • Three of the positions, which are relative to the main body 110 of the mobile communication device ( 100 of FIG. 1 ) are designated 210 , 220 , 230 .
  • a corresponding angle of view ⁇ is shown.
  • the camera module 200 rotates through the user-defined angle ⁇ from the first position 210 through the second position 220 to the third position 230 .
  • a standard digital photograph is taken in each position 210 , 220 and 230 .
  • the automatic rotation of the camera module is performed in two steps, each of angle ⁇ .
  • the number of steps and the value of ⁇ needed for the panoramic image is calculated by a software program integrated in the mobile communication device ( 100 of FIG. 1 ).
  • the user defines a value for the total angle of rotation a before the capturing process is started, for instance by entering the value by means of the keypad 140 .
  • a minimal value for the relative overlap of the view of two consecutive images is defined. This value for instance can be predefined and stored in a memory of the mobile communication device 100 or can also be entered by the user.
  • angle ⁇ has a value of 60°
  • the relative overlap is defined to be 40% and the angle of view ⁇ of the camera module has a value of 50°.
  • Angle ⁇ is made smaller than angle ⁇ for a non-zero overlap.
  • angle ⁇ has a value of 0.6 ⁇ , i.e., 30°, resulting in two steps of angle ⁇ needed for the rotation through angle ⁇ and therefore three standard images needed to generate the panoramic image.
  • more steps are performed and more standard images are captured.
  • the actual step of generating the panoramic image from the captured standard images is performed by means of an image-stitching software program stored in a memory of the mobile communication device.
  • the resulting panoramic image is stored in a memory of the mobile communication device and can then be displayed on the display 120 or sent via email or MMS (Multimedia Messaging Service) to another mobile communication device, as the user may desire.
  • MMS Multimedia Messaging Service
  • FIG. 2E illustrated is an enlarged view of the camera module of FIG. 2A .
  • FIG. 2B shows the positions of the optical lens of the camera module for the positions shown in FIG. 2A . If the camera module 200 is in one of the positions 210 , 220 or 230 , the optical lens 202 is in one of the respective positions 212 , 222 or 232 . In the embodiment of FIG. 2B , the optical center of the lens 202 is located essentially on the axis of rotation 400 in each of the positions 212 , 222 and 232 . That way it is achieved that the optical center of the lens is fixed in space during rotation, thereby reducing possible perspective distortions in a panoramic image.
  • FIG. 3 illustrated is a side view of a mobile communication device having a camera module 200 that is configured to be coupled to and decoupled from the main body 110 of a mobile communication device 100 .
  • the camera module 200 has a main body mechanical interface complementary to a camera module mechanical interface (both interfaces are schematically represented by a double-headed arrow spanning the main body 110 and the camera module 200 .
  • the camera module 200 is retractable from an exposed position into a retracted position 210 .
  • the camera module 200 is protected against external influences.
  • the camera module 200 can include a spring mechanism, by which the camera module 200 can be automatically ejected and brought into the exposed position.
  • retaining means can be provided, which hold back the spring until released by the user.
  • the camera module 200 further comprises a flash 204 and a self-timer, which is connected to a LED 206 for indicating the elapsing of the delay time of the self-timer.

Abstract

A mobile communication device, in particular a mobile telephone, a PDA or a MDA. In one embodiment, the mobile communication device includes: (1) a main body and (2) a camera module, coupled to the main body and configured for rotation relative to the main body about at least one axis of rotation. In another embodiment, the main body has a camera module mechanical interface, the camera module has a main body mechanical interface that is complementary to the camera module mechanical interface and the camera module is configured to be removably coupled to the main body and further configured for rotation relative to the main body about at least one axis of rotation.

Description

    CROSS-REFERENCE TO FOREIGN APPLICATION
  • This application is the National Stage of, and therefore claims the benefit of, International Application No. PCT/US2004/031193 filed on Sep. 23, 2004, entitled “MOBILE COMMUNICATION DEVICE HAVING PANORAMIC IMAGEMAKING CAPABILITY,” which was published in English under International Publication Number WO 2006/041443 A1 on Apr. 20, 2006 and is incorporated herein by reference in its entirety.
  • TECHNICAL FIELD OF THE INVENTION
  • The present invention is directed, in general, to mobile communication devices and, more specifically, to a mobile communication device having a panoramic imagemaking capability.
  • BACKGROUND OF THE INVENTION
  • A dramatic type of photography involves the capturing of panoramic images. The first panoramic pictures, taken in the 1840s, were composed by joining a series of separate daguerrotype images. By and large, panoramic images continued to be made this way for over a hundred and fifty years. While special panoramic cameras exist, they are purpose-built and therefore not suitable for making nonpanoramic, “standard,” images. Special panoramic cameras are therefore considered novelties of limited use.
  • Assuming one has only a nonpanoramic camera to create a panoramic image, digital photography and photograph manipulation computer software (e.g., Adobe Photoshop) have come together to make the task of joining separate pictures together easier, resulting in more “seamless” panoramic images. However, it is still necessary to capture a series of digital images while rotating the camera around a single axis of rotation, to transfer these images to a personal computer (PC) and to join the separate images into a panoramic image by means of a suitable software. The user therefore needs to be familiar with the PC and the photograph manipulation software.
  • Because a single axis of rotation is required, a tripod is indispensable for all but the steadiest and most experienced hands. In fact, a standard tripod is generally not sufficient for such purposes, but instead a tripod equipped with a specialized turntable is needed. A exemplary turntable that can be used for this purpose is described in U.S. Patent Application Number 20030128975 A1, entitled “Multi-purpose Turntable for Creation of Three Dimensional Pictures.”
  • One of the greatest benefits of digital photography is the possibility to see the image almost immediately after it has been captured. Thus, multiple images of the same object can be taken and only the best kept. However, in the case of panoramic images, it being necessary to process the captured images by means of a PC, the final result cannot be judged at the time when taking the photographs. Therefore, the benefit of image immediacy does not apply when capturing panoramic images. Further, since the required apparatus includes a PC, portability is difficult and spontaneity is probably impossible.
  • At the same time mobile communication devices are increasingly used for more than just speech communication. A variety of applications, such as messaging services, data communication, e-mail or fax services, have become available to the users of mobile communication devices.
  • The ongoing development in digital imaging devices furthermore makes it possible today to equip mobile communication devices with digital cameras at affordable prices, whereby new multimedia services become available. So it is possible to take digital photographs and send them to a friend by means of the Multimedia Message System (MMS). It is even possible to record video clips and send them by means of an MMS.
  • Accordingly, what is needed in the art is a better way to create panoramic images. More particularly, what is needed in the art is a way to make panoramic images that substantially preserves the flexibility, portability and spontaneity of standard cameras.
  • SUMMARY OF THE INVENTION
  • To address the above-discussed deficiencies of the prior art, the present invention provides a mobile communication device, in particular a mobile telephone, a PDA or a MDA. In one embodiment, the mobile communication device includes: (1) a main body and (2) a camera module, coupled to the main body and configured for rotation relative to the main body about at least one axis of rotation. In another embodiment, the main body has a camera module mechanical interface, the camera module has a main body mechanical interface that is complementary to the camera module mechanical interface and the camera module is configured to be removably coupled to the main body and further configured for rotation relative to the main body about at least one axis of rotation. Thus, the main body and the camera body are unitary in the former embodiment and decouplable from one another in the latter embodiment.
  • In more specific embodiments, the camera module is motor-driven, such that it pans through a given angle at a given rate of angular speed and captures images at a given rate. The resulting images thus relate to one another in a known way and can be automatically composited within the mobile telecommunication device without requiring manual intervention by the user.
  • The foregoing has outlined, rather broadly, preferred and alternative features of the present invention so that those skilled in the art may better understand the detailed description of the invention that follows. Additional features of the invention will be described hereinafter that form the subject of the claims of the invention. Those skilled in the art should appreciate that they can readily use the disclosed conception and specific embodiment as a basis for designing or modifying other structures for carrying out the same purposes of the present invention. Those skilled in the art should also realize that such equivalent constructions do not depart from the spirit and scope of the invention in its broadest form.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • For a more complete understanding of the present invention, reference is now made to the following descriptions taken in conjunction with the accompanying drawings, in which:
  • FIG. 1 illustrates a front view of one embodiment of a mobile communication device having a rotatable camera module and constructed according to the principles of the present invention;
  • FIG. 2A illustrates a top view of the mobile communication device of FIG. 1 showing in particular the camera module in progressive positions, in which a series of standard images for a panoramic image is captured;
  • FIG. 2B illustrates an enlarged view of the camera module of FIG. 2A; and
  • FIG. 3 illustrates a side view of a mobile communication device having a camera module that is retractable into the main body of the mobile communication device.
  • DETAILED DESCRIPTION
  • Referring initially to FIG. 1, illustrated is a front view of a preferred embodiment of an inventive mobile communication device 100 having a rotatable camera module 200 and constructed according to the principles of the present invention. In the illustrated embodiment, the camera module 200 is automatically rotatable about an axis of rotation 400 through angles up to and exceeding 360°. However, those skilled in the pertinent art will understand that angular excursions less than 360° fall within the broad scope of the present invention. The automatic rotation is achieved in the illustrated embodiment by means of a motor 300, which is connected to the camera module 200 by a drive shaft 310.
  • In the illustrated embodiment, the camera module 200 comprises a flash 204 and a self-timer, which is connected to a light-emitting diode (LED) 206 for indicating an elapse of the delay time of the self-timer.
  • The camera module 200 is shown with the lens 202 facing a back side of the mobile communication device 100, the front side being defined as the side of the mobile communication device 100 on which the display 120 and the keypad 140 are arranged. This is a typical position suitable for taking standard digital photos or video clips.
  • The camera module 200 shown in FIG. 1 is mounted at a top side of the main body 110. Of course, the camera module 200 could also be mounted at the side of the main body 110 or at any position, in which it can be automatically rotated.
  • Certainly, the invention is not limited to mobile telephones, but can also be used for personal digital assistants (PDA) or mobile digital assistants (MDA) or any other conventional or later-developed mobile communication device.
  • Turning now to FIG. 2A, illustrated is a top view of the mobile communication device of FIG. 1 showing in particular the camera module 200 in progressive positions, in which a series of standard images for a panoramic image are captured. Three of the positions, which are relative to the main body 110 of the mobile communication device (100 of FIG. 1) are designated 210, 220, 230. For each position, a corresponding angle of view γ is shown.
  • To generate a panoramic image, the camera module 200 rotates through the user-defined angle α from the first position 210 through the second position 220 to the third position 230. In each position 210, 220 and 230 a standard digital photograph is taken. In this example, the automatic rotation of the camera module is performed in two steps, each of angle β.
  • The number of steps and the value of β needed for the panoramic image is calculated by a software program integrated in the mobile communication device (100 of FIG. 1). For this purpose, the user defines a value for the total angle of rotation a before the capturing process is started, for instance by entering the value by means of the keypad 140. Furthermore, a minimal value for the relative overlap of the view of two consecutive images is defined. This value for instance can be predefined and stored in a memory of the mobile communication device 100 or can also be entered by the user.
  • In the example shown in FIG. 2A the angle α has a value of 60°, the relative overlap is defined to be 40% and the angle of view γ of the camera module has a value of 50°. Angle β is made smaller than angle γ for a non-zero overlap. The relative overlap is given by δ/γ with δ being the difference between angles γ and β, i.e., δ=γ−β. Thus, in this example angle β has a value of 0.6 γ, i.e., 30°, resulting in two steps of angle β needed for the rotation through angle α and therefore three standard images needed to generate the panoramic image. For larger angles α, more steps are performed and more standard images are captured. The actual step of generating the panoramic image from the captured standard images is performed by means of an image-stitching software program stored in a memory of the mobile communication device.
  • The resulting panoramic image is stored in a memory of the mobile communication device and can then be displayed on the display 120 or sent via email or MMS (Multimedia Messaging Service) to another mobile communication device, as the user may desire.
  • Turning now to FIG. 2E, illustrated is an enlarged view of the camera module of FIG. 2A. FIG. 2B shows the positions of the optical lens of the camera module for the positions shown in FIG. 2A. If the camera module 200 is in one of the positions 210, 220 or 230, the optical lens 202 is in one of the respective positions 212, 222 or 232. In the embodiment of FIG. 2B, the optical center of the lens 202 is located essentially on the axis of rotation 400 in each of the positions 212, 222 and 232. That way it is achieved that the optical center of the lens is fixed in space during rotation, thereby reducing possible perspective distortions in a panoramic image.
  • Turning now to FIG. 3, illustrated is a side view of a mobile communication device having a camera module 200 that is configured to be coupled to and decoupled from the main body 110 of a mobile communication device 100. The camera module 200 has a main body mechanical interface complementary to a camera module mechanical interface (both interfaces are schematically represented by a double-headed arrow spanning the main body 110 and the camera module 200.
  • In the illustrated embodiment, the camera module 200 is retractable from an exposed position into a retracted position 210. In the retracted position 240, the camera module 200 is protected against external influences. For user convenience, the camera module 200 can include a spring mechanism, by which the camera module 200 can be automatically ejected and brought into the exposed position. For this purpose also retaining means can be provided, which hold back the spring until released by the user.
  • In the illustrated embodiment, the camera module 200 further comprises a flash 204 and a self-timer, which is connected to a LED 206 for indicating the elapsing of the delay time of the self-timer.
  • Although the present invention has been described in detail, those skilled in the art should understand that they can make various changes, substitutions and alterations herein without departing from the spirit and scope of the invention in its broadest form.

Claims (20)

1. A mobile communication device, comprising:
a main body; and
a camera module, coupled to said main body and configured for rotation relative to said main body about at least one axis of rotation.
2. The mobile communication device as recited in claim 1 further comprising means for automatically rotating said camera module about said at least one axis of rotation.
3. The mobile communication device as recited in claim 1 wherein said camera module is rotatable about at least 360°.
4. The mobile communication device as recited in claim 2 wherein said means for automatically rotating said camera module is adapted to rotate said camera module through a user-definable first angle α.
5. The mobile communication device as recited in claim 4 further comprising means for capturing a video sequence with said camera module during rotation of said camera module through said first angle α by capturing a plurality of images with a given frequency.
6. The mobile communication device as recited in claim 4 wherein said means for automatically rotating said camera module is adapted to perform said rotation through said first angle α in at least two steps, each step comprising an angular displacement of essentially a second angle β.
7. The mobile communication device as recited in claim 6 wherein said second angle β is smaller than said angle of view γ of said camera module.
8. The mobile communication device as recited in claim 7 wherein said difference between said angle of view γ and angle β has a value between 10% and 90% of angle γ, in particular between 25% and 75% of angle γ, in particular of 50% of angle γ.
9. The mobile communication device as recited in claim 6 further comprising means for capturing a series of images with said camera module by capturing one image before rotating said camera module, capturing one image between each two consecutive steps of rotation and capturing one image after rotating said camera module.
10. The mobile communication device as recited in claim 9 further comprising a memory with a stored image-stitching software program for generating a panoramic image from said series of images and a microprocessor by which said image-stitching software program can be executed.
11. The mobile communication device as recited in claim 1 wherein said camera module is movable with respect to said main body between a retracted and an exposed position, in particular by means of a translatory movement.
12. The mobile communication device as recited in claim 11 further comprising user-releasable retaining means for holding said camera module in said retracted position and transporting means to automatically transport said camera module from said retracted position to said exposed position.
13. A mobile communication device, comprising:
a main body having a camera module mechanical interface; and
a camera module having a main body mechanical interface complementary to said camera module mechanical interface and configured to be coupled to said main body and further configured for rotation relative to said main body about at least one axis of rotation.
14. The mobile communication device as recited in claim 13 further comprising means for automatically rotating said camera module about said at least one axis of rotation.
15. The mobile communication device as recited in claim 13 wherein said camera module is rotatable about at least 360°.
16. The mobile communication device as recited in claim 13 further comprising a memory with a stored image-stitching software program for generating a panoramic image from a series of images captured by said camera module and a microprocessor by which said image-stitching software program can be executed.
17. The mobile communication device as recited in claim 14 wherein said means for automatically rotating said camera module is adapted to rotate said camera module through a user-definable first angle α.
18. The mobile communication device as recited in claim 14 further comprising means for capturing a video sequence with said camera module during rotation of said camera module through said first angle α by capturing a plurality of images with a given frequency.
19. The mobile communication device as recited in claim 14 wherein said means for automatically rotating said camera module is adapted to perform said rotation through said first angle α in at least two steps, each step comprising an angular displacement of essentially a second angle β.
20. The mobile communication device as recited in claim 16 wherein said second angle β is smaller than said angle of view γ of said camera module.
US11/575,856 2004-09-23 2004-09-23 Mobile communication device having panoramic imagemaking capability Active 2026-08-03 US7782375B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2004/031193 WO2006041443A1 (en) 2004-09-23 2004-09-23 Mobile communication device having panoramic imagemaking capability

Publications (2)

Publication Number Publication Date
US20070279481A1 true US20070279481A1 (en) 2007-12-06
US7782375B2 US7782375B2 (en) 2010-08-24

Family

ID=34958802

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/575,856 Active 2026-08-03 US7782375B2 (en) 2004-09-23 2004-09-23 Mobile communication device having panoramic imagemaking capability

Country Status (5)

Country Link
US (1) US7782375B2 (en)
EP (1) EP1800475A1 (en)
JP (1) JP4618651B2 (en)
KR (1) KR101074284B1 (en)
WO (1) WO2006041443A1 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070223915A1 (en) * 2006-03-27 2007-09-27 Samsung Electronics Co., Ltd. External camera and image photographing apparatus
US20070273752A1 (en) * 2004-04-15 2007-11-29 Agere Systems Incorporated Retractable rotatable camera module for mobile communication device and method of operation thereof
US20090256955A1 (en) * 2008-04-11 2009-10-15 Kuo Hung-Sheng Portable electronic device with rotatable image-capturing module
US20130002715A1 (en) * 2011-06-28 2013-01-03 Tidman James M Image Sequence Reconstruction based on Overlapping Measurement Subsets
US20130303105A1 (en) * 2010-09-30 2013-11-14 Thinkwaresystem Vorp. Mobile communication terminal, and system and method for safety service using same
US20140320987A1 (en) * 2011-03-18 2014-10-30 Premier Systems Usa, Inc. Lenses for communication devices
US20140362287A1 (en) * 2013-06-10 2014-12-11 Chien Fu CHUNG Multi-directional positioning apparatus for mobile-phone camera shooting
US20150109475A1 (en) * 2013-04-09 2015-04-23 Huawei Technologies Co., Ltd. Mobile electronic device with a rotatable camera
US20150111601A1 (en) * 2013-10-18 2015-04-23 Logos Technologies, Llc Systems and methods for displaying distant images at mobile computing devices
CN104965567A (en) * 2015-06-19 2015-10-07 联想(北京)有限公司 Electronic device
US20160205293A1 (en) * 2013-09-09 2016-07-14 Lg Electronics Inc. Display device including camera module
US20180041692A1 (en) * 2015-02-28 2018-02-08 Huawei Technologies Co., Ltd. Automatic Camera Adjustment Method and Electronic Device
US9936111B1 (en) * 2015-06-10 2018-04-03 Google Llc Articulating imaging module for electronic devices
CN109788171A (en) * 2018-12-25 2019-05-21 维沃移动通信有限公司 Terminal device
US20190166310A1 (en) * 2017-11-27 2019-05-30 Acer Incorporated Electronic device
US10601969B2 (en) * 2017-04-28 2020-03-24 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Mobile electronic device and mobile phone
WO2021042854A1 (en) * 2019-09-02 2021-03-11 中兴通讯股份有限公司 Pop-up three-dimensional recognition device and mobile terminal
WO2021086636A1 (en) * 2019-11-01 2021-05-06 Qualcomm Incorporated Retractable panoramic camera module
US11368568B2 (en) * 2018-11-30 2022-06-21 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Mobile terminal and image acquisition module

Families Citing this family (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1800475A1 (en) 2004-09-23 2007-06-27 Agere System Inc. Mobile communication device having panoramic imagemaking capability
DE102006025651A1 (en) * 2006-05-29 2007-12-06 Thomas Brenner Processing method for data sets of imaging sensors, involves reading multiple data sets of imaging sensor in part, and data of multiple successive data sets are combined to panoramic image during output via data output medium
EP2030433B1 (en) * 2006-05-29 2018-06-20 HERE Global B.V. Method and arrangement for processing records of imaging sensors, corresponding computer program, and corresponding computer-readable storage medium
US20130027521A1 (en) * 2011-07-26 2013-01-31 Research In Motion Corporation Stereoscopic image capturing system
JP5910485B2 (en) 2012-03-16 2016-04-27 株式会社リコー Imaging system
US9195023B2 (en) 2012-09-12 2015-11-24 Olloclip, Llc Removable optical devices for mobile electronic devices
US9294660B2 (en) 2013-03-13 2016-03-22 Olloclip, Llc Removable lenses for mobile electronic devices
US9661200B2 (en) 2013-08-07 2017-05-23 Olloclip, Llc Auxiliary optical components for mobile devices
WO2015048143A1 (en) 2013-09-26 2015-04-02 Olloclip, Llc Selectively attachable and removable optical systems for mobile devices
US10021296B2 (en) * 2013-12-31 2018-07-10 Futurewei Technologies, Inc. Automatic rotatable camera for panorama taking in mobile terminals
USD754228S1 (en) 2014-02-19 2016-04-19 olioclip, LLC Optical component
US20150281525A1 (en) * 2014-03-28 2015-10-01 Anshuman Thakur Extendable camera
USD761896S1 (en) 2014-04-11 2016-07-19 Olloclip, Llc Optical component
US10088738B2 (en) 2014-04-11 2018-10-02 Portero Holdings, Llc Auxiliary optical devices
WO2015195879A1 (en) 2014-06-19 2015-12-23 Olloclip, Llc Auxiliary optical components for mobile devices
US20160139495A1 (en) * 2014-09-18 2016-05-19 Olloclip, Llc Adapters for attaching accessories to mobile electronic devices
USD763340S1 (en) 2014-10-02 2016-08-09 Olloclip, Llc Optical component
TWI587061B (en) * 2014-11-19 2017-06-11 曦威科技股份有限公司 Extension flash module and camera system using the same
CN104539830A (en) * 2014-12-16 2015-04-22 广东欧珀移动通信有限公司 Camera shooting device capable of rotating by full angles
KR102155895B1 (en) * 2015-11-26 2020-09-14 삼성전자주식회사 Device and method to receive image by tracking object
CN113206933B (en) * 2017-11-30 2023-04-18 Oppo广东移动通信有限公司 Camera assembly, mobile terminal and control method of camera assembly
CN109981834B (en) * 2017-12-28 2021-05-04 Oppo广东移动通信有限公司 Functional assembly, electronic device and control method thereof
CN110072038B (en) 2018-01-24 2020-06-12 Oppo广东移动通信有限公司 Camera assembly and electronic equipment
CN209572070U (en) * 2018-11-30 2019-11-01 Oppo广东移动通信有限公司 It is driven mould group, transmission mechanism, camera sub-assembly and mobile terminal
CN209330169U (en) * 2018-11-30 2019-08-30 Oppo广东移动通信有限公司 Mobile terminal
KR102619948B1 (en) * 2019-04-09 2024-01-03 삼성전자주식회사 Electronic device including rotational type optical module
US11546451B2 (en) 2019-05-15 2023-01-03 Asustek Computer Inc. Electronic device
US11375125B2 (en) 2019-05-15 2022-06-28 Asustek Computer Inc. Electronic device
US10911593B2 (en) * 2019-05-15 2021-02-02 Asustek Computer Inc. Electronic device having a rotatable camera module
US11477385B2 (en) 2019-05-15 2022-10-18 Asustek Computer Inc. Electronic device with rotatable camera for protecting privacy
US11240357B2 (en) 2019-05-15 2022-02-01 Asustek Computer Inc. Electronic device
CN110430295A (en) * 2019-07-10 2019-11-08 华为技术有限公司 A kind of electronic equipment

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6532035B1 (en) * 2000-06-29 2003-03-11 Nokia Mobile Phones Ltd. Method and apparatus for implementation of close-up imaging capability in a mobile imaging system
US6714249B2 (en) * 1998-12-31 2004-03-30 Eastman Kodak Company Producing panoramic digital images by digital camera systems
US20040095500A1 (en) * 2001-03-19 2004-05-20 Takeshi Sato Mobile terminal device having camera function
US6795715B1 (en) * 1999-03-25 2004-09-21 Sony Corporation Portable communication device with camera interface for image transmission and reception
US20050014527A1 (en) * 2003-07-18 2005-01-20 Agere Systems Incorporated Retractable rotatable camera module for mobile communication device and method of operation thereof
US6947076B1 (en) * 1999-10-27 2005-09-20 Ricoh Company, Ltd. Image pickup apparatus and image processing method for picking up an image of a target object in divisions
US7010158B2 (en) * 2001-11-13 2006-03-07 Eastman Kodak Company Method and apparatus for three-dimensional scene modeling and reconstruction
US20060105806A1 (en) * 2004-11-15 2006-05-18 Vance Scott L Mobile device with selectable camera position
US20080095526A1 (en) * 2006-10-18 2008-04-24 Teng-Lung Chang Structure of photographic apparatus
US7724286B2 (en) * 2004-05-19 2010-05-25 Sony Corporation Image pickup apparatus and image pickup method

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05100335A (en) 1991-10-04 1993-04-23 Canon Inc Panoramic photographing device
US5550754A (en) 1994-05-13 1996-08-27 Videoptic Research Teleconferencing camcorder
JPH1075287A (en) * 1996-08-30 1998-03-17 Kokusai Electric Co Ltd Portable video telephone
JP2000324380A (en) 1999-05-11 2000-11-24 Canon Inc Image pickup device and its method
JP3187026B2 (en) * 1999-11-10 2001-07-11 島根県 Panoramic photography device
JP2001245267A (en) 2000-02-28 2001-09-07 Matsushita Electric Ind Co Ltd Portable information communication terminal unit with video camera
JP2002057919A (en) 2000-08-07 2002-02-22 Olympus Optical Co Ltd Panorama photographing device
JP2002094635A (en) * 2000-09-11 2002-03-29 Advanex Inc Portable electronic apparatus
JP2003051872A (en) 2001-08-07 2003-02-21 Minolta Co Ltd Portable communication equipment
JP2004222051A (en) * 2003-01-16 2004-08-05 Ntt Infranet Co Ltd Small automatic motion control photographing device
JP2005275126A (en) * 2004-03-25 2005-10-06 Nec Saitama Ltd Multi-directional photographing system and method of mobile terminal equipment with camera
EP1800475A1 (en) 2004-09-23 2007-06-27 Agere System Inc. Mobile communication device having panoramic imagemaking capability

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714249B2 (en) * 1998-12-31 2004-03-30 Eastman Kodak Company Producing panoramic digital images by digital camera systems
US6795715B1 (en) * 1999-03-25 2004-09-21 Sony Corporation Portable communication device with camera interface for image transmission and reception
US6947076B1 (en) * 1999-10-27 2005-09-20 Ricoh Company, Ltd. Image pickup apparatus and image processing method for picking up an image of a target object in divisions
US6532035B1 (en) * 2000-06-29 2003-03-11 Nokia Mobile Phones Ltd. Method and apparatus for implementation of close-up imaging capability in a mobile imaging system
US20040095500A1 (en) * 2001-03-19 2004-05-20 Takeshi Sato Mobile terminal device having camera function
US7010158B2 (en) * 2001-11-13 2006-03-07 Eastman Kodak Company Method and apparatus for three-dimensional scene modeling and reconstruction
US20050014527A1 (en) * 2003-07-18 2005-01-20 Agere Systems Incorporated Retractable rotatable camera module for mobile communication device and method of operation thereof
US7724286B2 (en) * 2004-05-19 2010-05-25 Sony Corporation Image pickup apparatus and image pickup method
US20060105806A1 (en) * 2004-11-15 2006-05-18 Vance Scott L Mobile device with selectable camera position
US20080095526A1 (en) * 2006-10-18 2008-04-24 Teng-Lung Chang Structure of photographic apparatus

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070273752A1 (en) * 2004-04-15 2007-11-29 Agere Systems Incorporated Retractable rotatable camera module for mobile communication device and method of operation thereof
US8010154B2 (en) * 2004-04-15 2011-08-30 Agere Systems Inc. Retractable rotatable camera module for mobile communication device and method of operation thereof
US20070223915A1 (en) * 2006-03-27 2007-09-27 Samsung Electronics Co., Ltd. External camera and image photographing apparatus
US20090256955A1 (en) * 2008-04-11 2009-10-15 Kuo Hung-Sheng Portable electronic device with rotatable image-capturing module
US9462445B2 (en) * 2010-09-30 2016-10-04 Thinkware Corporation Mobile communication terminal, and system and method for safety service using same
US20130303105A1 (en) * 2010-09-30 2013-11-14 Thinkwaresystem Vorp. Mobile communication terminal, and system and method for safety service using same
US20140320987A1 (en) * 2011-03-18 2014-10-30 Premier Systems Usa, Inc. Lenses for communication devices
US10203474B2 (en) 2011-03-18 2019-02-12 Portero Holdings, Llc Method of attaching an auxiliary lens to a mobile telephone
US9651756B2 (en) 2011-03-18 2017-05-16 Olloclip, Llc Lenses for communication devices
US9335509B2 (en) * 2011-03-18 2016-05-10 Olloclip, Llc Lenses for communication devices
US20130002715A1 (en) * 2011-06-28 2013-01-03 Tidman James M Image Sequence Reconstruction based on Overlapping Measurement Subsets
US20150109475A1 (en) * 2013-04-09 2015-04-23 Huawei Technologies Co., Ltd. Mobile electronic device with a rotatable camera
US20140362287A1 (en) * 2013-06-10 2014-12-11 Chien Fu CHUNG Multi-directional positioning apparatus for mobile-phone camera shooting
US20160205293A1 (en) * 2013-09-09 2016-07-14 Lg Electronics Inc. Display device including camera module
US9762780B2 (en) * 2013-09-09 2017-09-12 Lg Electronics Inc. Display device including camera module
US20150111601A1 (en) * 2013-10-18 2015-04-23 Logos Technologies, Llc Systems and methods for displaying distant images at mobile computing devices
US20180041692A1 (en) * 2015-02-28 2018-02-08 Huawei Technologies Co., Ltd. Automatic Camera Adjustment Method and Electronic Device
US10171729B2 (en) * 2015-02-28 2019-01-01 Huawei Technologies Co., Ltd. Directional adjustment for a camera based on exposure quality information
US9936111B1 (en) * 2015-06-10 2018-04-03 Google Llc Articulating imaging module for electronic devices
CN104965567A (en) * 2015-06-19 2015-10-07 联想(北京)有限公司 Electronic device
US10601969B2 (en) * 2017-04-28 2020-03-24 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Mobile electronic device and mobile phone
US20190166310A1 (en) * 2017-11-27 2019-05-30 Acer Incorporated Electronic device
US10645285B2 (en) * 2017-11-27 2020-05-05 Acer Incorporated Electronic device having panoramic camera
US11368568B2 (en) * 2018-11-30 2022-06-21 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Mobile terminal and image acquisition module
CN109788171A (en) * 2018-12-25 2019-05-21 维沃移动通信有限公司 Terminal device
WO2021042854A1 (en) * 2019-09-02 2021-03-11 中兴通讯股份有限公司 Pop-up three-dimensional recognition device and mobile terminal
WO2021086636A1 (en) * 2019-11-01 2021-05-06 Qualcomm Incorporated Retractable panoramic camera module
US11218632B2 (en) * 2019-11-01 2022-01-04 Qualcomm Incorporated Retractable panoramic camera module

Also Published As

Publication number Publication date
KR101074284B1 (en) 2011-10-17
US7782375B2 (en) 2010-08-24
KR20070064332A (en) 2007-06-20
WO2006041443A1 (en) 2006-04-20
EP1800475A1 (en) 2007-06-27
JP2008514157A (en) 2008-05-01
JP4618651B2 (en) 2011-01-26

Similar Documents

Publication Publication Date Title
US7782375B2 (en) Mobile communication device having panoramic imagemaking capability
US8010154B2 (en) Retractable rotatable camera module for mobile communication device and method of operation thereof
JP4938894B2 (en) Camera system with mirror array for creating self-portrait panoramic photos
US7581893B2 (en) U-cover camera phone
CN105049569A (en) Panoramic photo composition method based on front and back cameras of cellphone
US20160028955A1 (en) Camera and camera control method
US20090128644A1 (en) System and method for generating a photograph
WO2006036145A1 (en) Mobile communication device having stereoscopic imagemaking capability
JP5088077B2 (en) Mobile communication terminal with camera
JP2001275094A (en) Information communication device
CN101742048A (en) Image generating method for portable electronic device
CN103841326A (en) Video recording method and device
KR20110021817A (en) System and method for generating a photograph
KR20100069844A (en) Mobile terminal and method for taking image
US9344630B2 (en) Imaging apparatus, imaging method and recording medium
JP2009171064A (en) Photographing device, cellular phone
JP4562789B2 (en) Shooting system
JP4195349B2 (en) Imaging device
JP2005101729A (en) Digital camera with zooming function
JP2005123930A (en) Portable terminal
JP2004325931A (en) Portable terminal device with camera
JP2005167337A (en) Portable terminal device
JP2005278036A (en) Information terminal unit
JP2005165115A (en) Lens device
JP2005109825A (en) Image pickup device

Legal Events

Date Code Title Description
AS Assignment

Owner name: AGERE SYSTEMS INC., PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHAMBERS, MICHAEL J.;KIESSLING, MICHAEL;SIGNING DATES FROM 20070327 TO 20070407;REEL/FRAME:019555/0587

Owner name: AGERE SYSTEMS INC., PENNSYLVANIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHAMBERS, MICHAEL J.;KIESSLING, MICHAEL;REEL/FRAME:019555/0587;SIGNING DATES FROM 20070327 TO 20070407

STCF Information on status: patent grant

Free format text: PATENTED CASE

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AG

Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:LSI CORPORATION;AGERE SYSTEMS LLC;REEL/FRAME:032856/0031

Effective date: 20140506

AS Assignment

Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AGERE SYSTEMS LLC;REEL/FRAME:035365/0634

Effective date: 20140804

AS Assignment

Owner name: AGERE SYSTEMS LLC, PENNSYLVANIA

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031);ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:037684/0039

Effective date: 20160201

Owner name: LSI CORPORATION, CALIFORNIA

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031);ASSIGNOR:DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT;REEL/FRAME:037684/0039

Effective date: 20160201

AS Assignment

Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA

Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:037808/0001

Effective date: 20160201

Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH

Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;REEL/FRAME:037808/0001

Effective date: 20160201

AS Assignment

Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041710/0001

Effective date: 20170119

Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD

Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041710/0001

Effective date: 20170119

AS Assignment

Owner name: BELL NORTHERN RESEARCH, LLC, ILLINOIS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.;BROADCOM CORPORATION;REEL/FRAME:044886/0331

Effective date: 20171208

AS Assignment

Owner name: CORTLAND CAPITAL MARKET SERVICES LLC, AS COLLATERA

Free format text: SECURITY INTEREST;ASSIGNORS:HILCO PATENT ACQUISITION 56, LLC;BELL SEMICONDUCTOR, LLC;BELL NORTHERN RESEARCH, LLC;REEL/FRAME:045216/0020

Effective date: 20180124

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552)

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12

AS Assignment

Owner name: BELL NORTHERN RESEARCH, LLC, ILLINOIS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CORTLAND CAPITAL MARKET SERVICES LLC;REEL/FRAME:059721/0014

Effective date: 20220401

Owner name: BELL SEMICONDUCTOR, LLC, ILLINOIS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CORTLAND CAPITAL MARKET SERVICES LLC;REEL/FRAME:059721/0014

Effective date: 20220401

Owner name: HILCO PATENT ACQUISITION 56, LLC, ILLINOIS

Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:CORTLAND CAPITAL MARKET SERVICES LLC;REEL/FRAME:059721/0014

Effective date: 20220401