-
公开(公告)号:US12025983B2
公开(公告)日:2024-07-02
申请号:US18222786
申请日:2023-07-17
Applicant: SKYDIO, INC.
Inventor: Peter Henry , Jack Zhu , Brian Richman , Harrison Zheng , Hayk Martirosyan , Matthew Donahoe , Abraham Bachrach , Adam Bry , Ryan David Kennedy , Himel Mondal , Quentin Allen Wah Yen Delepine
IPC: G06T17/00 , B64C39/02 , B64D31/06 , B64D47/08 , G05B13/02 , G05B17/02 , G05D1/00 , G06T7/55 , G06T7/73 , G06T19/20 , G06V20/13 , G06V20/64 , H04N23/60 , H04N23/695 , H04N23/90 , B64U10/13 , B64U101/30
CPC classification number: G05D1/0094 , B64C39/024 , B64D31/06 , B64D47/08 , G05B13/0265 , G05B17/02 , G05D1/0088 , G05D1/101 , G06T7/55 , G06T7/74 , G06T17/00 , G06T19/20 , G06V20/13 , G06V20/64 , H04N23/64 , H04N23/695 , H04N23/90 , B64U10/13 , B64U2101/30 , G06T2207/10032 , G06T2207/20221 , G06T2219/2004
Abstract: In some examples, an image of a scan target is presented in a user interface on a display associated with a computing device. The user interface receives at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target. A graphical representation of the volume in relation to the image of the scan target is generated in the user interface. Information for defining a location of at least a portion of the volume in three-dimensional space is sent to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.
-
公开(公告)号:US20190332127A1
公开(公告)日:2019-10-31
申请号:US16452978
申请日:2019-06-26
Applicant: Skydio, Inc.
Inventor: Ryan Kennedy , Peter Henry , Abraham Bachrach
IPC: G05D1/10 , H04N17/00 , B64C39/02 , H04N5/217 , H04N5/225 , H04N5/235 , H04N13/00 , G06T5/00 , G06T7/11 , H04N5/232 , G06K9/00 , B64D47/08 , G06T7/00
Abstract: Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).
-
公开(公告)号:US10379545B2
公开(公告)日:2019-08-13
申请号:US15641021
申请日:2017-07-03
Applicant: Skydio, Inc.
Inventor: Ryan Kennedy , Peter Henry , Abraham Bachrach
IPC: B64C39/02 , B64D47/08 , G05D1/10 , G06K9/00 , G06T5/00 , G06T7/11 , H04N17/00 , H04N5/232 , H04N5/247
Abstract: Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).
-
公开(公告)号:US11829141B2
公开(公告)日:2023-11-28
申请号:US18120643
申请日:2023-03-13
Applicant: SKYDIO, INC.
Inventor: Peter Henry , Jack Zhu , Brian Richman , Harrison Zheng , Hayk Martirosyan , Matthew Donahoe , Abraham Bachrach , Adam Bry , Ryan David Kennedy , Himel Mondal , Quentin Allen Wah Yen Delepine
IPC: G06V20/13 , G05D1/00 , G05B17/02 , B64C39/02 , B64D47/08 , B64D31/06 , G05D1/10 , G06T17/00 , G06T7/55 , G06T7/73 , G05B13/02 , G06T19/20 , H04N23/60 , H04N23/90 , H04N23/695 , G06V20/64 , B64U10/13 , B64U101/30
CPC classification number: G05D1/0094 , B64C39/024 , B64D31/06 , B64D47/08 , G05B13/0265 , G05B17/02 , G05D1/0088 , G05D1/101 , G06T7/55 , G06T7/74 , G06T17/00 , G06T19/20 , G06V20/13 , G06V20/64 , H04N23/64 , H04N23/695 , H04N23/90 , B64U10/13 , B64U2101/30 , G06T2207/10032 , G06T2207/20221 , G06T2219/2004
Abstract: In some examples, an unmanned aerial vehicle (UAV) may identify a scan target. The UAV may navigate to two or more positions in relation to the scan target. The UAV may capture, using one or more image sensors of the UAV, two or more images of the scan target from different respective positions in relation to the scan target. For instance, the two or more respective positions may be selected by controlling a spacing between the two or more respective positions to enable determination of parallax disparity between a first image captured at a first position and a second image captured at a second position of the two or more positions. The UAV may determine a three-dimensional model corresponding to the scan target based in part on the determined parallax disparity of the two or more images including the first image and the second image.
-
公开(公告)号:US11755041B2
公开(公告)日:2023-09-12
申请号:US17360495
申请日:2021-06-28
Applicant: Skydio, Inc.
Inventor: Jack Louis Zhu , Hayk Martirosyan , Abraham Bachrach , Matthew Donahoe , Patrick Lowe , Kristen Marie Holtz , Adam Bry
IPC: G05D1/12 , G05D1/00 , B64C39/02 , G06T7/20 , G05D1/10 , H04N5/272 , H04N23/695 , B64U101/30
CPC classification number: G05D1/12 , B64C39/024 , G05D1/0094 , G05D1/101 , G06T7/20 , H04N5/272 , H04N23/695 , B64U2101/30 , B64U2201/10 , G06T2207/30241 , G06T2207/30261
Abstract: Techniques are described for controlling an autonomous vehicle such as an unmanned aerial vehicle (UAV) using objective-based inputs. In an embodiment, the underlying functionality of an autonomous navigation system is exposed via an application programming interface (API) allowing the UAV to be controlled through specifying a behavioral objective, for example, using a call to the API to set parameters for the behavioral objective. The autonomous navigation system can then incorporate perception inputs such as sensor data from sensors mounted to the UAV and the set parameters using a multi-objective motion planning process to generate a proposed trajectory that most closely satisfies the behavioral objective in view of certain constraints. In some embodiments, developers can utilize the API to build customized applications for the UAV. Such applications, also referred to as “skills,” can be developed, shared, and executed to control behavior of an autonomous UAV and aid in overall system improvement.
-
公开(公告)号:US20230244234A1
公开(公告)日:2023-08-03
申请号:US18120669
申请日:2023-03-13
Applicant: SKYDIO, INC.
Inventor: Peter HENRY , Jack Zhu , Brian Richman , Harrison Zheng , Hayk Martirosyan , Matthew Donahoe , Abraham Bachrach , Adam Bry , Ryan David Kennedy , Himel Mondal , Quentin Allen Wah Yen Delepine
IPC: G05D1/00 , G05B17/02 , B64C39/02 , B64D47/08 , B64D31/06 , G05D1/10 , G06T17/00 , G06T7/55 , G06T7/73 , G05B13/02 , G06T19/20 , H04N23/60 , H04N23/90 , H04N23/695 , G06V20/13 , G06V20/64
CPC classification number: G05D1/0094 , G05B17/02 , B64C39/024 , B64D47/08 , B64D31/06 , G05D1/101 , G06T17/00 , G06T7/55 , G06T7/74 , G05B13/0265 , G05D1/0088 , G06T19/20 , H04N23/64 , H04N23/90 , H04N23/695 , G06V20/13 , G06V20/64 , G06T2207/20221 , G06T2207/10032 , G06T2219/2004 , B64U10/13
Abstract: In some examples, an unmanned aerial vehicle (UAV) may access a scan plan that includes a sequence of poses for the UAV to assume to capture images of a scan target using one or more image sensors. The UAV may check a next pose of the scan plan for obstructions. Responsive to detection of an obstruction, the UAV may determine a backup pose based at least on a field of view of the next pose. The UAV may control a propulsion mechanism to cause the UAV to fly to assume the backup pose. The UAV may capture, based on the backup pose and using the one or more image sensors, one or more images of the scan target.
-
公开(公告)号:US20230185301A1
公开(公告)日:2023-06-15
申请号:US17899459
申请日:2022-08-30
Applicant: Skydio, Inc.
Inventor: Hayk Martirosyan , Adam Bry , Matthew Donahoe , Abraham Bachrach , Justin Michael Sadowski
CPC classification number: G05D1/0094 , B64C39/024 , B64D47/08 , G06T7/292 , G05D1/106 , G06T2207/30252 , G06T2207/10032 , G06T2207/10021 , B64U10/13
Abstract: Methods and systems are disclosed for an unmanned aerial vehicle (UAV) configured to autonomously navigate a physical environment while capturing images of the physical environment. In some embodiments, the motion of the UAV and a subject in the physical environment may be estimated based in part on images of the physical environment captured by the UAV. In response to estimating the motions, image capture by the UAV may be dynamically adjusted to satisfy a specified criterion related to a quality of the image capture.
-
公开(公告)号:US20210109514A1
公开(公告)日:2021-04-15
申请号:US17077565
申请日:2020-10-22
Applicant: Skydio, Inc.
Inventor: Abraham Bachrach , Adam Bry , Matthew Donahoe
Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.
-
公开(公告)号:US10466695B2
公开(公告)日:2019-11-05
申请号:US15791230
申请日:2017-10-23
Applicant: Skydio, Inc.
Inventor: Abraham Bachrach , Adam Bry , Matthew Donahoe
Abstract: Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a user may control image capture from an FDA by adjusting the position and orientation of a PMD. In other embodiments, a user may input a touch gesture via a touch display of a PMD that corresponds with a flight path to be autonomously flown by the FDA.
-
公开(公告)号:US20190004543A1
公开(公告)日:2019-01-03
申请号:US15641021
申请日:2017-07-03
Applicant: Skydio, Inc.
Inventor: Ryan Kennedy , Peter Henry , Abraham Bachrach
IPC: G05D1/10 , H04N5/247 , G06K9/00 , H04N5/232 , G06T7/11 , H04N17/00 , G06T5/00 , B64C39/02 , B64D47/08
CPC classification number: G05D1/101 , B64C39/024 , B64C2201/141 , B64D47/08 , G06K9/0063 , G06T5/002 , G06T7/0002 , G06T7/11 , G06T2207/10012 , G06T2207/10032 , G06T2207/30168 , H04N5/2171 , H04N5/2258 , H04N5/23296 , H04N5/2351 , H04N5/247 , H04N13/00 , H04N13/239 , H04N17/002
Abstract: Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).
-
-
-
-
-
-
-
-
-