-
公开(公告)号:US12175764B1
公开(公告)日:2024-12-24
申请号:US17537843
申请日:2021-11-30
Applicant: Zoox, Inc.
Inventor: Qian Song , Benjamin Isaac Zwiebel
Abstract: Techniques for performing deconvolution operations on data structures representing condensed sensor data are disclosed herein. Autonomous vehicle sensors can capture data in an environment that may include one or more objects. The sensor data may be processed by a convolutional neural network to generate condensed sensor data. The condensed sensor data may be processed by one or more deconvolution layers using a machine-learned upsampling transformation to generate an output data structure for improved object detection, classification, and/or other processing operations.
-
公开(公告)号:US12080074B2
公开(公告)日:2024-09-03
申请号:US17537920
申请日:2021-11-30
Applicant: Zoox, Inc.
Inventor: Qian Song , Benjamin Isaac Zwiebel
CPC classification number: G06V20/58 , B60W60/001 , G06N20/00 , G06T7/20 , G06T7/70 , G06V10/25 , G06V10/751 , G06T2207/20081 , G06T2207/30252
Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.
-
公开(公告)号:US20210181758A1
公开(公告)日:2021-06-17
申请号:US16779576
申请日:2020-01-31
Applicant: Zoox, Inc.
Inventor: Subhasis Das , Benjamin Isaac Zwiebel , Kai Yu , James William Vaisey Philbin
IPC: G05D1/02 , G01S17/89 , G06T7/215 , G06T7/246 , G06T7/292 , G01S17/931 , G01S13/89 , G01S13/931
Abstract: Tracking a current and/or previous position, velocity, acceleration, and/or heading of an object using sensor data may comprise determining whether to associate a current object detection generated from recently received (e.g., current) sensor data with a previous object detection generated from formerly received sensor data. In other words, a track may identify that an object detected in former sensor data is the same object detected in current sensor data. However, multiple types of sensor data may be used to detect objects and some objects may not be detected by different sensor types or may be detected differently, which may confound attempts to track an object. An ML model may be trained to receive outputs associated with different sensor types and/or a track associated with an object, and determine a data structure comprising a region of interest, object classification, and/or a pose associated with the object.
-
公开(公告)号:US20230177804A1
公开(公告)日:2023-06-08
申请号:US17542354
申请日:2021-12-03
Applicant: Zoox, Inc.
Inventor: Cheng-Hsin Wuu , Subhasis Das , Po-Jen Lai , Qian Song , Benjamin Isaac Zwiebel
CPC classification number: G06V10/70 , G06V20/582 , G06V20/584 , G06V20/588 , G06V20/41
Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
-
公开(公告)号:US11663726B2
公开(公告)日:2023-05-30
申请号:US16866865
申请日:2020-05-05
Applicant: Zoox, Inc.
Inventor: Subhasis Das , Kai Yu , Benjamin Isaac Zwiebel
IPC: G06T7/246 , G06T7/20 , G05D1/02 , G05D1/00 , G06V20/56 , G06F18/25 , G06V10/25 , B60W60/00 , G06T7/70
CPC classification number: G06T7/248 , B60W60/001 , G05D1/0088 , G05D1/0219 , G05D1/0246 , G06F18/25 , G06T7/20 , G06T7/70 , G06V10/25 , G06V20/56 , B60W2420/42 , G05D2201/0213 , G06T2207/10028 , G06T2207/10044 , G06T2207/20081 , G06T2207/30241 , G06T2207/30252
Abstract: Tracking a current and/or previous position, velocity, acceleration, and/or heading of an object using sensor data may comprise determining whether to associate a current object detection generated from recently received (e.g., current) sensor data with a previous object detection generated from formerly received sensor data. In other words, a track may identify that an object detected in former sensor data is the same object detected in current sensor data. However, multiple types of sensor data may be used to detect objects and some objects may not be detected by different sensor types or may be detected differently, which may confound attempts to track an object. An ML model may be trained to receive outputs associated with different sensor types and/or a track associated with an object, and determine a data structure comprising a region of interest, object classification, and/or a pose associated with the object.
-
公开(公告)号:US20200225672A1
公开(公告)日:2020-07-16
申请号:US16831581
申请日:2020-03-26
Applicant: Zoox, Inc.
Inventor: William Anthony Silva , Dragomir Dimitrov Anguelov , Benjamin Isaac Zwiebel , Juhana Kangaspunta
Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.
-
公开(公告)号:US20190384302A1
公开(公告)日:2019-12-19
申请号:US16011468
申请日:2018-06-18
Applicant: Zoox, Inc.
Inventor: William Anthony Silva , Dragomir Dimitrov Anguelov , Benjamin Isaac Zwiebel , Juhana Kangaspunta
Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.
-
公开(公告)号:US20250005935A1
公开(公告)日:2025-01-02
申请号:US18821385
申请日:2024-08-30
Applicant: Zoox, Inc.
Inventor: Qian Song , Benjamin Isaac Zwiebel
Abstract: Techniques for detecting and tracking objects in an environment are discussed herein. For example, techniques can include detecting a center point of a block of pixels associated with an object. Unimodal (e.g., Gaussian) confidence values may be determined for a group of pixels associated with an object. Proposed detection box center points may be determined based on the Gaussian confidence values of the pixels and an output detection box may be determined using filtering and/or suppression techniques. Further, a machine-learned model can be trained by determining parameters of a center pixel of the detection box and a focal loss based on the unimodal confidence value which can then be backpropagated to the other pixels of the detection.
-
公开(公告)号:US12030528B2
公开(公告)日:2024-07-09
申请号:US17542352
申请日:2021-12-03
Applicant: Zoox, Inc.
Inventor: Cheng-Hsin Wuu , Subhasis Das , Po-Jen Lai , Qian Song , Benjamin Isaac Zwiebel
IPC: B60W60/00 , G06N20/00 , G06V10/764 , G06V20/58
CPC classification number: B60W60/0027 , G06N20/00 , G06V10/764 , G06V20/58 , B60W2554/404 , B60W2554/80
Abstract: Techniques for a perception system of a vehicle that can detect and track objects in an environment are described herein. The perception system may include a machine-learned model that includes one or more different portions, such as different components, subprocesses, or the like. In some instances, the techniques may include training the machine-learned model end-to-end such that outputs of a first portion of the machine-learned model are tailored for use as inputs to another portion of the machine-learned model. Additionally, or alternatively, the perception system described herein may utilize temporal data to track objects in the environment of the vehicle and associate tracking data with specific objects in the environment detected by the machine-learned model. That is, the architecture of the machine-learned model may include both a detection portion and a tracking portion in the same loop.
-
公开(公告)号:US11802969B2
公开(公告)日:2023-10-31
申请号:US17825347
申请日:2022-05-26
Applicant: Zoox, Inc.
Inventor: William Anthony Silva , Dragomir Dimitrov Anguelov , Benjamin Isaac Zwiebel , Juhana Kangaspunta
IPC: G05D1/02 , G05D1/00 , G06K9/00 , G06T7/246 , B60W50/04 , B60W30/09 , B60W50/00 , G08G1/16 , G06T7/10 , G06F16/29 , G01S17/931 , G06V20/58 , G01S17/89 , G06V10/764
CPC classification number: G01S17/89 , G01S17/931 , G05D1/0088 , G05D1/024 , G05D1/0214 , G05D1/0248 , G05D1/0274 , G06F16/29 , G06T7/10 , G06V10/764 , G06V20/58 , G08G1/166 , G05D2201/0213 , G06T2207/30241 , G06T2207/30261
Abstract: Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object. An occlusion grid representing the occluded area can be stored as map data or can be dynamically generated. An occlusion grid can include occlusion fields, which represent discrete two- or three-dimensional areas of driveable environment. An occlusion field can indicate an occlusion state and an occupancy state, determined using LIDAR data and/or image data captured by the vehicle. An occupancy state of an occlusion field can be determined by ray casting LIDAR data or by projecting an occlusion field into segmented image data. The vehicle can be controlled to traverse the environment when a sufficient portion of the occlusion grid is visible and unoccupied.
-
-
-
-
-
-
-
-
-