-
1.
公开(公告)号:US20240249443A1
公开(公告)日:2024-07-25
申请号:US18124060
申请日:2023-03-21
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.
-
公开(公告)号:US20240249442A1
公开(公告)日:2024-07-25
申请号:US18124059
申请日:2023-03-21
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
Abstract: To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. However, issues such as the AR content and the proxy object not being aligned, or occlusion of the proxy object leading to glitching of the AR content, may decrease user enjoyment. In some embodiments, an AR system for the overlay of AR content may be implemented. The system may anchor a virtual model to the proxy object based on detected features on the proxy object. The anchoring may include aligning elements of the virtual model and proxy object. In response to an occluding object occluding some features on the proxy object, the system may anchor the virtual model to the occluding object, or to both the proxy object and the occluding object, based on detected features on the occluding object.
-
公开(公告)号:US20240233286A1
公开(公告)日:2024-07-11
申请号:US18444437
申请日:2024-02-16
Applicant: Shopify Inc.
Inventor: Daniel Beauchamp , Byron Leonel Delgado , Jonathan Wade
IPC: G06T19/00 , G06F3/16 , G06Q30/0601
CPC classification number: G06T19/006 , G06F3/167 , G06Q30/0643
Abstract: Systems and methods described herein allow a customer to employ AR/VR software to generate virtual representations of physical spaces (e.g., house) and sub-spaces (e.g., living room) to preview virtual objects situated in AR/VR virtual environments. A commerce system (or mobile app associated with the commerce system) may generate virtualized environments representing a physical space (e.g., house, apartment) and regions (e.g., living room, kitchen) based on source images uploaded to or otherwise captured by the commerce system. The end-user may operate the software on a client device and interacts with VR or AR presentations of the virtual environment using a voice-based interface recognized by the software. For example, the end-user may say the name of room (region) or an object and the system retrieves data of the identified room or an appropriate room, such as virtual representations of furniture or objects situated in the room.
-
公开(公告)号:US11995232B1
公开(公告)日:2024-05-28
申请号:US18108334
申请日:2023-02-10
Applicant: SHOPIFY INC.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06F3/01 , G06F3/04845
CPC classification number: G06F3/013 , G06F3/04845 , G06F2203/04804
Abstract: In virtual reality (VR) and augmented reality (AR), eye tracking may be performed to determine the user's gaze direction. The gaze direction may be used to enhance user interaction. However, when a user gazes in a particular direction, it could sometimes be the case that there are multiple items located in that gaze direction, each at a different depth. The gaze of direction alone might not be indicative of the item at which the user is looking. Therefore, in some embodiments, to try to further enhance user interaction, a gaze depth of the gaze may be determined. Some embodiments are directed to performing eye tracking to detect a gaze depth of a human's gaze and modifying a user interface (UI) responsive to a change in the gaze depth.
-
公开(公告)号:US11887173B2
公开(公告)日:2024-01-30
申请号:US17110665
申请日:2020-12-03
Applicant: SHOPIFY INC.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06Q30/0601 , H04L67/306 , H04L67/50 , G06N20/00
CPC classification number: G06Q30/0631 , G06N20/00 , H04L67/306 , H04L67/535
Abstract: When a person visits a physical retail store, the merchant often does not have enough information about the person to make meaningful product recommendations. Also, a physical retail store typically has products physically distributed throughout the store. It may be desirable to have some sort of relationship between where the customer is and the location of the product being recommended. In some embodiments, when a person visits the store, a computer determines an identity of the person and generates a product recommendation based on user-specific information for that person. In some embodiments, generating the product recommendation includes detecting that a field of view of a camera of the device has changed, and in response determining a plurality of products within or proximate to a current field of view of the camera. At least one of the plurality of products is then identified as the recommended product.
-
公开(公告)号:US11847736B2
公开(公告)日:2023-12-19
申请号:US17237372
申请日:2021-04-22
Applicant: SHOPIFY INC.
Inventor: Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
CPC classification number: G06T15/506 , G06T15/04 , G06T17/205
Abstract: The consistent use of lighting in different instances of digital media may help ensure that objects are depicted in a similar manner in the digital media. However, in some cases, a three-dimensional (3D) model may depict an object under lighting conditions that differ from the lighting conditions depicted in other digital media. The present disclosure provides systems and methods for generating 3D models to include lighting that is consistent with the lighting used in other digital media. According to an embodiment, a lighting template is determined based on digital media depicting a first physical object. A modified 3D model of a second physical object is then generated based on the lighting template to light the second physical object according to the lighting template.
-
公开(公告)号:US11836877B2
公开(公告)日:2023-12-05
申请号:US17845387
申请日:2022-06-21
Applicant: SHOPIFY INC.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp , Maas Mansoor Ali Lalani
IPC: G06T19/00 , G06N20/00 , G06Q30/0601 , G06T15/20
CPC classification number: G06T19/006 , G06N20/00 , G06Q30/0643 , G06T15/20 , G06T2207/20081 , G06T2207/30204
Abstract: Systems and methods for generating AR content to virtually alter a real-world item are provided. The real-world item may be a deformable item including one or more flexible surfaces. According to an embodiment, a method includes determining the relative positions of a plurality of points on the real-world item. Based on the relative positions of the plurality of points, a 3D model of a virtual item is distorted to produce a distorted 3D model of the virtual item. The distorted 3D model may have substantially the same shape as the real-world item. AR content is then generated based on the distorted three-dimensional model.
-
公开(公告)号:US11810218B2
公开(公告)日:2023-11-07
申请号:US16939280
申请日:2020-07-27
Applicant: SHOPIFY INC.
Inventor: Juho Mikko Haapoja , Byron Leonel Delgado , Stephan Leroux , Daniel Beauchamp
IPC: G06T7/73 , G06Q30/0601 , G06T19/00
CPC classification number: G06T7/73 , G06Q30/0633 , G06Q30/0643 , G06T19/006 , G06T2219/024
Abstract: Systems and methods are provided for the generation of augmented reality (AR) content that provides a shared AR experience involving multiple users. Shared AR experiences can improve the communication and collaboration between multiple simultaneous users. According to an embodiment, AR content is generated for a first user in a shared AR experience. The AR content includes at least one of a render of a model, a virtual representation of a second user in the shared AR experience, a virtual representation of a user interaction in the shared AR experience, and spatial audio content. Modifications to a shared AR experience are also provided. These modifications may be initiated based on instructions from one user and be reflected in the AR content generated for multiple users.
-
公开(公告)号:US20250166037A1
公开(公告)日:2025-05-22
申请号:US18515913
申请日:2023-11-21
Applicant: Shopify Inc.
Inventor: Russ Maschmeyer , Eric Andrew Florenzano , Brennan Letkeman , Diego Macario Bello , Daniel Beauchamp
IPC: G06Q30/0601
Abstract: A computer system obtains a first embedding in an embedding space, where the first embedding represents a first item in an item store. The computer system identifies, based on at least a second embedding representing a second item in the item store, an item from the item store, wherein the second embedding is in the embedding space, and the identified item is identified based on a position of the second embedding in the embedding space relative to a position of the first embedding in the embedding space. The computer system outputs an identification of the identified item.
-
公开(公告)号:US20250078436A1
公开(公告)日:2025-03-06
申请号:US18950895
申请日:2024-11-18
Applicant: SHOPIFY INC.
Inventor: Daniel Beauchamp , Stephan Leroux , Byron Leonel Delgado
IPC: G06T19/20 , G06F16/9538 , G06Q30/0601 , G06T19/00 , G06V20/20
Abstract: The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.
-
-
-
-
-
-
-
-
-