公开(公告)号：US12094072B2

公开(公告)日：2024-09-17

申请号：US17202124

申请日：2021-03-15

申请人： MAGIC LEAP, INC.

发明人： Brennan Lee Chapman ,  Michel Ian Marrache ,  Richard Silliker ,  Carlos Roque

IPC分类号： G06T9/20 ,  G06F3/04815 ,  G06T15/20 ,  G06T19/00 ,  G06T19/20 ,  H04N13/279

CPC分类号： G06T19/20 ,  G06F3/04815 ,  G06T15/20 ,  G06T19/006 ,  H04N13/279 ,  G06T2219/2016

摘要： Controllable three-dimensional (3D) virtual dioramas in a rendered 3D environment such as a virtual reality or augmented reality environment including one or more rendered objects. 3D diorama is associated with a spatial computing content item such as a downloadable application executable by a computing device. 3D diorama assets may include visual and/or audio content and are presented with rendered 3D environment objects in a composite view, which is presented to a user through a display of computing device. 3D diorama is rotatable in composite view, and at least one 3D diorama asset at least partially occludes, or is at least partially occluded by, at least one rendered 3D environment object. 3D diorama may depict or provide a preview of a spatial computing user experience generated by the downloadable application.

公开(公告)号：US20240296619A1

公开(公告)日：2024-09-05

申请号：US18584239

申请日：2024-02-22

申请人： CANON KABUSHIKI KAISHA

发明人： SATORU KOBAYASHI ,  GOU YAMASHITA ,  TOSHIMASA SUZUKI ,  AYAKO FURESAWA

IPC分类号： G06T15/60 ,  G06V10/141 ,  G06V10/60 ,  H04N13/279

CPC分类号： G06T15/60 ,  G06V10/141 ,  G06V10/60 ,  H04N13/279

摘要： An image processing apparatus capable of causing the influence of a light source that is in a captured scene to affect a background image of in-camera VFX video, is disclosed. The apparatus acquires information relating to a light source existing in real space captured by an image capture apparatus and generates, based on a three-dimensional model of a virtual space, an image to be displayed on a display apparatus disposed in the real space. The apparatus generates the image in which an influence exerted by light from the light source on the virtual space has been affected.

公开(公告)号：US20240259544A1

公开(公告)日：2024-08-01

申请号：US18633081

申请日：2024-04-11

申请人： FUJIFILM CORPORATION

发明人： Masahiko MIYATA ,  Takashi AOKI ,  Kazunori TAMURA ,  Fuminori IRIE

IPC分类号： H04N13/279 ,  G06T7/73 ,  H04N13/282

CPC分类号： H04N13/279 ,  G06T7/73 ,  H04N13/282

摘要： An information processing apparatus includes a detection unit that detects a three-dimensional position and a posture of an object in an instruction three-dimensional region having an enlarged or reduced relationship with an observation three-dimensional region in which a virtual viewpoint and a virtual visual line are defined, a derivation unit that derives the viewpoint and the visual line corresponding to detection results of the detection unit depending on positional relationship information indicating a relative positional relationship between the observation three-dimensional region and the instruction three-dimensional region, and an acquisition unit that acquires a virtual viewpoint image showing a subject in a case in which the subject is observed with the viewpoint and the visual line derived by the derivation unit, the virtual viewpoint image being based on a plurality of images obtained by imaging an imaging region included in the observation three-dimensional region by a plurality of imaging apparatuses.

公开(公告)号：US20240249419A1

公开(公告)日：2024-07-25

申请号：US18561541

申请日：2022-02-14

申请人： SONY GROUP CORPORATION

发明人： YUKO SAKAI

IPC分类号： G06T7/20 ,  G06F3/01 ,  G06T7/70 ,  G06T17/00 ,  H04N13/279 ,  H04N13/351 ,  H04N23/61

CPC分类号： G06T7/20 ,  G06F3/013 ,  G06T7/70 ,  G06T17/00 ,  H04N13/279 ,  H04N13/351 ,  H04N23/61

摘要： A video processing apparatus (information processing apparatus) includes: a tracking processing unit (tracking unit) that performs tracking of a region having a similar pixel pattern among a plurality of frame images included in a reference video (first video) in which a subject (first subject) is captured; and a camerawork estimation unit (first estimation unit) that estimates camerawork for the reference video on the basis of a result of the tracking by the tracking processing unit.

公开(公告)号：US20240244174A1

公开(公告)日：2024-07-18

申请号：US18544512

申请日：2023-12-19

申请人： CANON KABUSHIKI KAISHA

发明人： Michio AIZAWA

IPC分类号： H04N13/279 ,  G06T19/20 ,  G06V10/25

CPC分类号： H04N13/279 ,  G06T19/20 ,  G06V10/25 ,  G06T2219/2016

摘要： An image processing apparatus: obtain information on a virtual viewpoint to generate a virtual viewpoint image, the virtual viewpoint image being an image of an object viewed from the virtual viewpoint, the object included in an image capturing region of an image capturing apparatus; obtain enlarged three-dimensional shape data representing the object in which at least a part of regions is greater than that of normal three-dimensional shape data generated based on images obtained by image capturing by the image capturing apparatus; and generate the virtual viewpoint image based on the enlarged three-dimensional shape data in a case where a visual field represented by the information is a panoramic visual field.

公开(公告)号：US20240203021A1

公开(公告)日：2024-06-20

申请号：US18555727

申请日：2022-02-01

申请人： SONY GROUP CORPORATION

发明人： AKIRA UMAYABARA

IPC分类号： G06T15/00 ,  G06T5/50 ,  G06T7/70 ,  G06V10/74 ,  H04N13/279

CPC分类号： G06T15/00 ,  G06T5/50 ,  G06T7/70 ,  G06V10/761 ,  H04N13/279 ,  G06T2207/20221

摘要： The present technology relates to an image processing device, an image processing method, and a program that enable work using a predetermined machine to be performed easily and safely. An image acquirer acquires a plurality of captured images acquired by a plurality of imaging devices installed in a construction machine. A distance acquirer acquires distance information indicating a distance from a distance measurement device that measures a distance between the distance measurement device and an object imaged by the imaging devices. A display controller controls display of a 3D model image so as to display action point information indicating an action point of a 3D model of the construction machine on a 3D space on the 3D model image that is an image captured when the 3D space including the object and the 3D model of at least a part of the construction machine is imaged from a virtual viewpoint, the 3D model image being generated by using the plurality of captured images and the distance information. The present technology can be applied to, for example, a work support device or the like that supports construction work.

公开(公告)号：US12013537B2

公开(公告)日：2024-06-18

申请号：US17370882

申请日：2021-07-08

申请人： Magic Leap, Inc.

发明人： Ravi Kumar Komanduri ,  Lionel Ernest Edwin ,  Chulwoo Oh

IPC分类号： G09G5/00 ,  G02B5/30 ,  G02B27/01 ,  G02B27/42 ,  G06T19/00 ,  H04N13/279 ,  H04N13/344

CPC分类号： G02B27/0172 ,  G02B5/3083 ,  G02B27/4261 ,  G02B27/4272 ,  G06T19/006 ,  H04N13/279 ,  H04N13/344 ,  G02B2027/0118 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014

摘要： Techniques for operating an optical system are disclosed. World light may be linearly polarized along a first axis. When the optical system is operating in accordance with a first state, a polarization of the world light may be rotated by 90 degrees, the world light may be linearly polarized along a second axis perpendicular to the first axis, and zero net optical power may be applied to the world light. When the optical system is operating in accordance with a second state, virtual image light may be projected onto an eyepiece of the optical system, the world light and the virtual image light may be linearly polarized along the second axis, a polarization of the virtual image light may be rotated by 90 degrees, and non-zero net optical power may be applied to the virtual image light.

公开(公告)号：US11995244B2

公开(公告)日：2024-05-28

申请号：US18046219

申请日：2022-10-13

申请人： MAGIC LEAP, INC.

发明人： Gary R. Bradski ,  Samuel A. Miller ,  Rony Abovitz

IPC分类号： G06K9/00 ,  A63F13/00 ,  G02B27/00 ,  G02B27/01 ,  G02B30/52 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  G06F3/0482 ,  G06V20/20 ,  G06V40/16 ,  G10L19/00 ,  H04N13/117 ,  H04N13/139 ,  H04N13/189 ,  H04N13/204 ,  H04N13/239 ,  H04N13/271 ,  H04N13/279 ,  H04N13/344 ,  H04N13/366 ,  H04N13/383 ,  H04N21/414 ,  G06V10/50 ,  G06V10/56 ,  G06V40/10 ,  H04N7/18 ,  H04N13/00 ,  H04N13/371

CPC分类号： G06F3/017 ,  A63F13/00 ,  G02B27/0093 ,  G02B27/0172 ,  G02B30/52 ,  G06F3/011 ,  G06F3/012 ,  G06F3/013 ,  G06F3/014 ,  G06F3/016 ,  G06F3/0304 ,  G06F3/0346 ,  G06F3/0482 ,  G06V20/20 ,  G06V40/168 ,  G10L19/00 ,  H04N13/117 ,  H04N13/139 ,  H04N13/189 ,  H04N13/204 ,  H04N13/239 ,  H04N13/271 ,  H04N13/279 ,  H04N13/344 ,  H04N13/366 ,  H04N13/383 ,  H04N21/414 ,  G02B2027/014 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06V10/50 ,  G06V10/56 ,  G06V40/113 ,  H04N7/185 ,  H04N2013/0081 ,  H04N13/371

摘要： Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise an image capturing device to capture one or more images, the one or more images corresponding to a field of the view of a user of a head-mounted augmented reality device, and a processor communicatively coupled to the image capturing device to extract a set of map points from the set of images, to identify a set of sparse points and a set of dense points from the extracted set of map points, and to perform a normalization on the set of map points.

公开(公告)号：US20240148444A1

公开(公告)日：2024-05-09

申请号：US18414082

申请日：2024-01-16

申请人： Vicarious Surgical Inc.

发明人： Eric Kline ,  Sammy Khalifa ,  Marshall Wentworth ,  Eric VAn Albert

IPC分类号： A61B34/20 ,  A61B17/34 ,  A61B34/00 ,  A61B90/00 ,  G02B7/00 ,  G02B27/01 ,  H04N13/239 ,  H04N13/279 ,  H04N13/344 ,  H04N13/366

CPC分类号： A61B34/20 ,  A61B17/34 ,  A61B17/3415 ,  A61B34/71 ,  A61B34/76 ,  A61B90/36 ,  A61B90/37 ,  G02B7/002 ,  G02B27/017 ,  H04N13/239 ,  H04N13/279 ,  H04N13/344 ,  H04N13/366 ,  A61B2034/2072 ,  H04N13/327

摘要： A system includes a console assembly, a trocar assembly operably coupled to the console assembly, a camera assembly operably coupled to the console assembly having a stereoscopic camera assembly, and at least one rotational positional sensor configured to detect rotation of the stereoscopic camera assembly about at least one of a pitch axis or a yaw axis. The console assembly includes a first actuator and a first actuator pulley operable coupled to the first actuator. The trocar assembly includes a trocar having an inner and outer diameter, and a seal sub-assembly comprising at least one seal and the seal sub-assembly operably coupled to the trocar. The camera assembly includes a camera support tube having a distal and a proximal end, the stereoscopic camera operably coupled to the distal end of the support tube and a first and second camera module having a first and second optical axis.

公开(公告)号：US11924394B2

公开(公告)日：2024-03-05

申请号：US17654667

申请日：2022-03-14

申请人： Nevermind Capital LLC

发明人： David Cole ,  Alan McKay Moss ,  Hector M. Medina

IPC分类号： H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/2343 ,  H04N21/2387 ,  H04N21/426 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44 ,  H04N21/472 ,  H04N21/81 ,  H04N23/698 ,  H04N13/00

CPC分类号： H04N13/189 ,  G06T15/04 ,  G06T17/20 ,  H04N13/106 ,  H04N13/139 ,  H04N13/161 ,  H04N13/194 ,  H04N13/243 ,  H04N13/275 ,  H04N13/279 ,  H04N19/136 ,  H04N19/172 ,  H04N19/44 ,  H04N19/597 ,  H04N21/234363 ,  H04N21/2387 ,  H04N21/42653 ,  H04N21/435 ,  H04N21/437 ,  H04N21/44016 ,  H04N21/472 ,  H04N21/8146 ,  H04N21/816 ,  H04N23/698 ,  G06T2215/12 ,  H04N2013/0088

摘要： Methods and apparatus for using selective resolution reduction on images to be transmitted and/or used by a playback device are described. Prior to transmission one or more images of an environment are captured. Based on image content, motion detection and/or user input a resolution reduction operation is selected and performed. The reduced resolution image is communicated to a playback device along with information indicating a UV map corresponding to the selected resolution allocation that should be used by the playback device for rendering the communicated image. By changing the resolution allocation used and which UV map is used by the playback device different resolution allocations can be made with respect to different portions of the environment while allowing the number of pixels in transmitted images to remain constant. The playback device renders the individual images with the UV map corresponding to the resolution allocation used to generate the individual images.