PERCEIVING SCENE FEATURES USING EVENT SENSORS AND IMAGE SENSORS

    公开(公告)号:US20250056133A1

    公开(公告)日:2025-02-13

    申请号:US18618909

    申请日:2024-03-27

    Abstract: Embodiments are directed to perceiving scene features using event sensors and image sensors. Paths may be scanned across objects in a scene with one or more beams. Images of the scene may be captured with frame cameras. Events may be generated based on detection of beam reflections that correspond to the objects. Trajectories may be based on the paths and the events. A distribution of intensity associated with the trajectories may be determined based on the energy associated with the traces in the images. Centroids for the trajectories may be determined based on the distribution of the intensity of energy, a resolution of the frame cameras, or timestamps associated with the events. Enhanced trajectories may be generated based on the centroids such that the enhanced trajectories may be provided to a modeling engine that executes actions based on the enhanced trajectories and the objects.

    Dynamic calibration of 3D acquisition systems

    公开(公告)号:US11887340B2

    公开(公告)日:2024-01-30

    申请号:US18222780

    申请日:2023-07-17

    CPC classification number: G06T7/80

    Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

    DYNAMIC CALIBRATION OF 3D ACQUISITION SYSTEMS

    公开(公告)号:US20230360268A1

    公开(公告)日:2023-11-09

    申请号:US18222780

    申请日:2023-07-17

    CPC classification number: G06T7/80

    Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

    Stage studio for immersive 3-D video capture

    公开(公告)号:US11785200B1

    公开(公告)日:2023-10-10

    申请号:US18121486

    申请日:2023-03-14

    CPC classification number: H04N13/282 H04N23/51 H04N23/90

    Abstract: Embodiments are directed providing a stage studio for immersive 3-D video capture. A two-dimensional video of a scene may be captured with frame cameras oriented towards a center of the scene. Paths may be scanned across objects in the scene with signal beams oriented towards the center of the scene. Events may be generated based on signal beams that are reflected by the objects and detected by event cameras oriented towards the center of the scene. Trajectories may be generated based on the paths and the events. A scene that includes a representation of the objects based on the captured two-dimensional video and the trajectories may be generated such that a position and an orientation of the represented objects in the scene are based on the trajectories.

    AUXILIARY DEVICE FOR AUGMENTED REALITY
    15.
    发明公开

    公开(公告)号:US20230316657A1

    公开(公告)日:2023-10-05

    申请号:US18130080

    申请日:2023-04-03

    Abstract: Embodiments are directed providing auxiliary devices for augmented reality. Images or video of a scene may be captured with frame cameras included in a mobile computer. A plurality of paths may be scanned across objects in the scene with beams provided by scanning devices that may be separate from the mobile computer. A plurality of events may be determined based on detection of beam reflections corresponding to the objects such that the beam reflections may be detected the scanning devices. A plurality of trajectories may be determined based on the plurality of paths and the plurality of events such that each trajectory may be a parametric representation of a one-dimensional curve segment in a three-dimensional space. The images or video of the scene may be augmented based on the plurality of trajectories.

    DYNAMIC CALIBRATION OF 3D ACQUISITION SYSTEMS

    公开(公告)号:US20230034733A1

    公开(公告)日:2023-02-02

    申请号:US17876333

    申请日:2022-07-28

    Abstract: Embodiments are directed to a sensing system that employs beams to scan paths across an object such that sensors may the beams reflected by the scanned object. Events may be provided based on the detected signals and the paths such that each event may be associated with a sensor and event metrics. Crossing points for each sensor may be determined based on where the paths intersect the scanned object such that events associated with each sensor are associated with the crossing points for each sensor. Each crossing point of each sensor may be compared to each correspondent crossing point of each other sensor. Actual crossing points may be determined based on the comparison and the crossing points for each sensor. Position information for each sensor may be determined based on the actual crossing points.

    PERCEIVING SCENE FEATURES USING EVENT SENSORS AND IMAGE SENSORS

    公开(公告)号:US20240129645A1

    公开(公告)日:2024-04-18

    申请号:US18488123

    申请日:2023-10-17

    CPC classification number: H04N25/47 G06T7/246

    Abstract: Embodiments are directed to perceiving scene features using event sensors and image sensors. Paths may be scanned across objects in a scene with one or more beams. Images of the scene may be captured with frame cameras. Events may be generated based on detection of beam reflections that correspond to the objects. Trajectories may be based on the paths and the events. A distribution of intensity associated with the trajectories may be determined based on the energy associated with the traces in the images. Centroids for the trajectories may be determined based on the distribution of the intensity of energy, a resolution of the frame cameras, or timestamps associated with the events. Enhanced trajectories may be generated based on the centroids such that the enhanced trajectories may be provided to a modeling engine that executes actions based on the enhanced trajectories and the objects.

    FOVEATED ROBOTIC VISION SYSTEM
    18.
    发明公开

    公开(公告)号:US20240022819A1

    公开(公告)日:2024-01-18

    申请号:US18221816

    申请日:2023-07-13

    CPC classification number: H04N23/695 H04N25/702 H04N23/56 G06T7/13 G06T7/20

    Abstract: Embodiments are directed to vision systems. Enclosures that each include event scanners, beam generators, or frame cameras may be provided such that the event cameras or the frame cameras may be arranged to provide foveated resolution and such that the enclosures each may include an aperture that enables beams from the beam generators to scan a scene that may be in a field-of-view (FOV) of the aperture. Paths may be scanned across objects in the scene with the beams. Events may be determined based on detection of beam reflections corresponding to objects in the scene. The enclosures may be rotated to orient the apertures into a physical position for continued scanning of the objects within the FOV based on directions of travel for the objects such that the directions of travel for the objects is based on scanned trajectories.

    ASSOCIATION OF CONCURRENT TRACKS USING GRAPH CROSSINGS

    公开(公告)号:US20230274523A1

    公开(公告)日:2023-08-31

    申请号:US18113283

    申请日:2023-02-23

    CPC classification number: G06V10/421 G06T7/73 G06V2201/07

    Abstract: Embodiments are directed to the association of concurrent tracks using graph crossings. Signal beams may be employed to scan paths across an object such that sensors separately detect signals from the signal beams reflected by the object. Crossing points may be determined based on a plurality of trajectories that intersect each other during the scan of the object. Graphs may be generated based on the portion of trajectories and the crossing points such that each edge in the graphs corresponds to a crossing point and such that each node in the one or more graphs corresponds to a trajectory. The graphs may be compared to determine one or more matched graphs that may share a common topology. Common trajectories may be determined based on the matched graphs such that each common trajectory may be associated with a same path across the object and a separate sensor.

    MULTI-SENSOR SUPERRESOLUTION SCANNING AND CAPTURE SYSTEM

    公开(公告)号:US20230060421A1

    公开(公告)日:2023-03-02

    申请号:US17895489

    申请日:2022-08-25

    Abstract: Embodiments are directed to multi-sensor superresolution scanning and capture system. A sensing system may be employed to scan a plurality of paths across objects using beams such that the sensing system includes event sensors and image sensors and such that the image sensors are a higher resolution than the event sensors. The event sensors may be employed to provide events based on detection of the beams that are reflected by the objects. The image sensors may be employed to provide images based on the reflected the beams. Enhanced trajectories may be generated based on a plurality of first trajectories and a plurality of second trajectories such that the plurality of the first trajectories are based on the events and the plurality of paths and such that the plurality of second trajectories are based on the images and the plurality of paths.

Patent Agency Ranking