-
公开(公告)号：US11430181B1
公开(公告)日：2022-08-30
申请号：US17158208
申请日：2021-01-26
Applicant: Apple Inc.
Inventor： Payal Jotwani
Abstract: In one implementation, a method of enriching a three-dimensional scene model with a three-dimensional object model based on a semantic label is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space, wherein a subset of the plurality of points is associated with a particular cluster identifier and a particular semantic label. The method includes retrieving a three-dimensional object model based on the particular semantic label, the three-dimensional object model including at least a plurality of points. The method includes updating the three-dimensional scene model by replacing the subset of the plurality of points with the three-dimensional object model.
-
公开(公告)号：US20220254102A1
公开(公告)日：2022-08-11
申请号：US17729481
申请日：2022-04-26
Applicant: Apple Inc.
Inventor： Payal Jotwani
Abstract: In one implementation, a method of semantically labeling a point cloud cluster is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a point cloud of a physical environment including a plurality of points, each of the plurality of points associated with coordinates in a three-dimensional space. The method includes spatially disambiguating portions of the plurality of points into a plurality of clusters. The method includes determining a semantic label based on a volumetric arrangement of the points of a particular cluster of the plurality of clusters. The method includes generating a characterization vector of a particular point of the points of the particular cluster, wherein the characterization vector includes the coordinates of the particular point, a cluster identifier of the particular cluster, and the semantic label.
-
公开(公告)号：US20210272305A1
公开(公告)日：2021-09-02
申请号：US17158232
申请日：2021-01-26
Applicant: Apple Inc.
Inventor： Payal Jotwani
Abstract: In one implementation, a method of determining spatial relationships of point cloud clusters is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a point cloud including a plurality of points, wherein the plurality of points includes a first cluster of points and a second cluster of points, wherein a particular point of the first cluster of points is associated with a characterization vector that includes a set of coordinates of the particular point in a three-dimensional space and a cluster identifier of the first cluster of points. The method includes determining a spatial relationship vector based on the volumetric arrangement of the first cluster of points and the second cluster of points, wherein the spatial relationship vector characterizes the spatial relationship between the first cluster of points and the second cluster of points. The method includes adding the spatial relationship vector to characterization vector.
-
公开(公告)号：US12175783B2
公开(公告)日：2024-12-24
申请号：US18411138
申请日：2024-01-12
Applicant: Apple Inc.
Inventor： Payal Jotwani
IPC: G06V30/262 , G06F18/24 , G06T7/10 , G06T7/70 , G06T7/80
Abstract: A device obtains a point cloud of a scene including a plurality of points. Each point has three-dimensional coordinates in a three-dimensional coordinate system. A first cluster of points has a first semantic label. The device obtains a two-dimensional image of the scene with a camera with an intrinsic parameter. The device detects, in the two-dimensional image, a representation of a first object corresponding to the first semantic label. The device determines two-dimensional coordinates in a two-dimensional coordinate system of the two-dimensional image corresponding to the first object. The device determines, from the first cluster of points, three-dimensional coordinates in the three-dimensional coordinate system of the scene corresponding to the two-dimensional coordinates in the two-dimensional coordinate system of the two-dimensional image of the scene. The device estimates the intrinsic parameter based on the two-dimensional and the three-dimensional coordinates.
-
公开(公告)号：US12169902B2
公开(公告)日：2024-12-17
申请号：US17853557
申请日：2022-06-29
Applicant: Apple Inc.
Inventor： Mark E. Drummond , Daniel L Kovacs , Shaun D. Budhram , Edward Ahn , Behrooz Mahasseni , Aashi Manglik , Payal Jotwani , Mu Qiao , Bo Morgan , Noah Gamboa , Michael J. Gutensohn , Dan Feng , Siva Chandra Mouli Sivapurapu
IPC: G06T19/00
Abstract: In one implementation, a method of displaying content is performed at a device including a display, one or more processors, and non-transitory memory. The method includes scanning a first physical environment to detect a first physical object in the first physical environment and a second physical object in the first physical environment, wherein the first physical object meets at least one first object criterion and the second physical object meets at least one second object criterion. The method includes displaying, in association with the first physical environment, a virtual object moving along a first path from the first physical object to the second physical object. The method includes scanning a second physical environment to detect a third physical object in the second physical environment and a fourth physical object in the second physical environment, wherein the third physical object meets the at least one first object criterion and the fourth physical object meets the at least one second object criterion. The method includes displaying, in association with the second physical environment, the virtual object moving along a second path from the third physical object to the fourth physical object, wherein the second path is different than the first path.
-
Patent Agency Ranking
公开(公告)号：US12026962B2
公开(公告)日：2024-07-02
申请号：US17729481
申请日：2022-04-26
Applicant: Apple Inc.
Inventor： Payal Jotwani
CPC classification number: G06V20/64 , G06F18/214 , G06F18/23 , G06N20/00 , G06T17/00 , G06V20/20 , G06T19/006
Abstract: In one implementation, a method of semantically labeling a point cloud cluster is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a point cloud of a physical environment including a plurality of points, each of the plurality of points associated with coordinates in a three-dimensional space. The method includes spatially disambiguating portions of the plurality of points into a plurality of clusters. The method includes determining a semantic label based on a volumetric arrangement of the points of a particular cluster of the plurality of clusters. The method includes generating a characterization vector of a particular point of the points of the particular cluster, wherein the characterization vector includes the coordinates of the particular point, a cluster identifier of the particular cluster, and the semantic label.
-
公开(公告)号：US11954909B2
公开(公告)日：2024-04-09
申请号：US18209582
申请日：2023-06-14
Applicant: Apple Inc.
Inventor： Mark Drummond , Payal Jotwani
CPC classification number: G06V20/20 , G06T19/006
Abstract: In one implementation, a method of defining a negative space in a three-dimensional scene model is performed at a device including a processor and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space. The method includes defining a subspace in the three-dimensional space with less than a threshold number of the plurality of points. The method includes determining a semantic label for the subspace. The method includes generating a characterization vector of the subspace, wherein the characterization vector includes the spatial extent of the subspace and the semantic label.
-
公开(公告)号：US20240094815A1
公开(公告)日：2024-03-21
申请号：US18523324
申请日：2023-11-29
Applicant: Apple Inc.
Inventor： Michael J. Gutensohn , Payal Jotwani , Mark E. Drummond , Daniel L. Kovacs
IPC: G06F3/01
CPC classification number: G06F3/013
Abstract: In one implementation, a method for recording an XR environment. The method includes: presenting, via the display device, a graphical environment with one or more virtual agents, wherein the graphical environment corresponds to a composition of extended reality (XR) content, including the one or more virtual agents, and an image stream of a physical environment captured from a first point-of-view (POV) of the physical environment; detecting, via the one or more input devices, a user input selecting a first virtual agent from among the one or more virtual agents; and in response to detecting the user input, recording a plurality of data streams associated with the graphical environment including a first image stream of the graphical environment from the first POV and one or more data streams of the graphical environment from a current POV of the first virtual agent.
-
公开(公告)号：US11715299B1
公开(公告)日：2023-08-01
申请号：US17222577
申请日：2021-04-05
Applicant: Apple Inc.
Inventor： Mark Drummond , Payal Jotwani
CPC classification number: G06V20/20 , G06T19/006
Abstract: In one implementation, a method of defining a negative space in a three-dimensional scene model is performed at a device including a processor and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space. The method includes defining a subspace in the three-dimensional space with less than a threshold number of the plurality of points. The method includes determining a semantic label for the subspace. The method includes generating a characterization vector of the subspace, wherein the characterization vector includes the spatial extent of the subspace and the semantic label.
-
公开(公告)号：US20220358721A1
公开(公告)日：2022-11-10
申请号：US17869183
申请日：2022-07-20
Applicant: Apple Inc.
Inventor： Payal Jotwani
Abstract: In one implementation, a method of enriching a three-dimensional scene model with a three-dimensional object model based on a semantic label is performed at a device including one or more processors and non-transitory memory. The method includes obtaining a three-dimensional scene model of a physical environment including a plurality of points, wherein each of the plurality of points is associated with a set of coordinates in a three-dimensional space, wherein a subset of the plurality of points is associated with a particular cluster identifier and a particular semantic label. The method includes retrieving a three-dimensional object model based on the particular semantic label, the three-dimensional object model including at least a plurality of points. The method includes updating the three-dimensional scene model by replacing the subset of the plurality of points with the three-dimensional object model.
-
-
-
-
-
-
-
-
-
Search Results
32
records
(took 0.018 seconds)
