-
公开(公告)号：US10529074B2
公开(公告)日：2020-01-07
申请号：US15962841
申请日：2018-04-25
Applicant: Samsung Electronics Co., Ltd.
Inventor： Fannie Fontanel , Ankur Gupta , Michael Sapienza , Abhijit Z. Bendale , Pranav Mistry
Abstract: A method of camera pose and plane estimation may include detecting a marker within a 3-dimensional (3D) environment by detecting, using a Dynamic Vision Sensor (DVS), a first plurality of light sources arranged in a known shape and blinking at a first frequency, wherein the known shape corresponds to the marker, determining an orientation and an identity of the marker based upon detecting, using the DVS, a second plurality of light sources corresponding to the marker and blinking at a second frequency different from the first frequency. A camera pose for the DVS may be determined based upon the known shape, the orientation, and the identity of the marker using the processor.
-
公开(公告)号：US11558551B2
公开(公告)日：2023-01-17
申请号：US17012005
申请日：2020-09-03
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
IPC: G06T7/11 , G06T15/00 , G06T15/10 , G06T19/00 , H04N5/232 , H04N5/343 , G02B27/01 , H04N5/357 , H04N5/374 , G06K9/62
Abstract: A system and method for a master platform includes receiving first pose data associated with an image sensor of a first device, and a first semantic map generated by the first device, the first semantic map including a simplified object representation in a coordinate space of the first device. The master platform also receives second pose data associated with an image sensor of a second device, and a second semantic map generated by the second device, the second semantic map including a simplified object representation in a coordinate space of the second device. A shared simplified object representation common to the first and semantic maps is identified. The master platform further combines the first semantic and second semantic maps based on the first and second pose data. The first pose data, first semantic map, second pose data, and second semantic map are associated with a common time interval.
-
公开(公告)号：US20190355169A1
公开(公告)日：2019-11-21
申请号：US16415860
申请日：2019-05-17
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, a CMOS image sensor configured to output frames of image data, an inertial measurement unit (IMU), a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to generate a semantic segmentation of a time-stamped frame, which is based on one or more of an output of the CMOS image sensor, or a synthesized event frame based on an output from the DVS and an output from the IMU over a time interval. The semantic segmentation includes a semantic label associated with a region of the time-stamped frame. When executed, the instructions further cause the apparatus to determine, based on the semantic segmentation, a simplified object representation in a coordinate space, and update a stable semantic map based on the simplified object representation.
-
公开(公告)号：US11202006B2
公开(公告)日：2021-12-14
申请号：US16415813
申请日：2019-05-17
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
IPC: H04N5/232 , G02B27/01 , H04N5/343 , H04N5/357 , H04N5/374 , G06T7/11 , G06K9/62 , G06T15/00 , G06T15/10 , G06T19/00
Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, and a complementary metal-oxide-semiconductor (CMOS) image sensor configured to output frames of image data. The apparatus further includes a hybrid feature handler configured to receive, as an input, one or more of a DVS output or a CMOS image sensor output, and provide tracked features to a visual-inertial simultaneous location and mapping (SLAM) pipeline performing inside-out device tracking, and a sensor scheduler configured to switch off the CMOS image sensor based on a current value of one or more CMOS control factors.
-
公开(公告)号：US11381741B2
公开(公告)日：2022-07-05
申请号：US16953111
申请日：2020-11-19
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
IPC: H04N5/232 , G02B27/01 , H04N5/343 , H04N5/357 , H04N5/374 , G06T7/11 , G06K9/62 , G06T15/00 , G06T15/10 , G06T19/00
Abstract: An untethered apparatus for performing inside-out device tracking based on visual-inertial simultaneous location and mapping (SLAM) includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, an inertial measurement unit (IMU) sensor configured to collect IMU data associated with motion of the apparatus at a predetermined interval, a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to accumulate DVS sensor output over a sliding time window, the sliding time window including the predetermined interval, apply a motion correction to the accumulated DVS sensor output, the motion correction based on the IMU data collected over the predetermined interval, generate an event-frame histogram of DVS sensor events based on the motion correction, and provide the event-frame histogram of the DVS sensor events and the IMU data to a visual inertial SLAM pipeline.
-
Patent Agency Ranking
公开(公告)号：US10812711B2
公开(公告)日：2020-10-20
申请号：US16415860
申请日：2019-05-17
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
IPC: H04N5/232 , H04N5/343 , G02B27/01 , H04N5/357 , H04N5/374 , G06T7/11 , G06K9/62 , G06T15/00 , G06T15/10 , G06T19/00
Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, a CMOS image sensor configured to output frames of image data, an inertial measurement unit (IMU), a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to generate a semantic segmentation of a time-stamped frame, which is based on one or more of an output of the CMOS image sensor, or a synthesized event frame based on an output from the DVS and an output from the IMU over a time interval. The semantic segmentation includes a semantic label associated with a region of the time-stamped frame. When executed, the instructions further cause the apparatus to determine, based on the semantic segmentation, a simplified object representation in a coordinate space, and update a stable semantic map based on the simplified object representation.
-
公开(公告)号：US20200026349A1
公开(公告)日：2020-01-23
申请号：US16216849
申请日：2018-12-11
Applicant: Samsung Electronics Co., Ltd
Inventor： Fannie Fontanel , Sajid Sadi
Abstract: A system and method enable an electronic device to perform gaze tracking operations. The electronic device includes one or more cameras and at least one processor. The one or more cameras include a Dynamic Vision Sensor (DVS) camera. The one or more cameras are configured to capture features of an eye of a wearer of the electronic device The processor is configured to receive, from the one or more cameras, an image or pixel stream associated with the eye, determine an initial pose of the eye based on the image or pixel stream, receive DVS pixel data from the DVS camera, track one or more changes to the initial pose of the eye based on the DVS pixel data, and based on the one or more changes to the initial pose of the eye, determine a gaze of the wearer.
-
公开(公告)号：US20210075964A1
公开(公告)日：2021-03-11
申请号：US16953111
申请日：2020-11-19
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
IPC: H04N5/232 , H04N5/343 , G02B27/01 , H04N5/357 , H04N5/374 , G06T7/11 , G06K9/62 , G06T15/00 , G06T15/10 , G06T19/00
Abstract: An untethered apparatus for performing inside-out device tracking based on visual-inertial simultaneous location and mapping (SLAM) includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, an inertial measurement unit (IMU) sensor configured to collect IMU data associated with motion of the apparatus at a predetermined interval, a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to accumulate DVS sensor output over a sliding time window, the sliding time window including the predetermined interval, apply a motion correction to the accumulated DVS sensor output, the motion correction based on the IMU data collected over the predetermined interval, generate an event-frame histogram of DVS sensor events based on the motion correction, and provide the event-frame histogram of the DVS sensor events and the IMU data to a visual inertial SLAM pipeline.
-
公开(公告)号：US10795435B2
公开(公告)日：2020-10-06
申请号：US16216849
申请日：2018-12-11
Applicant: Samsung Electronics Co., Ltd
Inventor： Fannie Fontanel , Sajid Sadi
IPC: G06F3/01 , A61B3/113 , G06F3/0484
Abstract: A system and method enable an electronic device to perform gaze tracking operations. The electronic device includes one or more cameras and at least one processor. The one or more cameras include a Dynamic Vision Sensor (DVS) camera. The one or more cameras are configured to capture features of an eye of a wearer of the electronic device The processor is configured to receive, from the one or more cameras, an image or pixel stream associated with the eye, determine an initial pose of the eye based on the image or pixel stream, receive DVS pixel data from the DVS camera, track one or more changes to the initial pose of the eye based on the DVS pixel data, and based on the one or more changes to the initial pose of the eye, determine a gaze of the wearer.
-
10.发明申请公开(公告)号：US20190356849A1
公开(公告)日：2019-11-21
申请号：US16415813
申请日：2019-05-17
Applicant: Samsung Electronics Co., Ltd.
Inventor： Michael Sapienza , Ankur Gupta , Abhijit Bendale , Fannie Fontanel
Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, and a complementary metal-oxide-semiconductor (CMOS) image sensor configured to output frames of image data. The apparatus further includes a hybrid feature handler configured to receive, as an input, one or more of a DVS output or a CMOS image sensor output, and provide tracked features to a visual-inertial simultaneous location and mapping (SLAM) pipeline performing inside-out device tracking, and a sensor scheduler configured to switch off the CMOS image sensor based on a current value of one or more CMOS control factors.
-
-
-
-
-
-
-
-
-
Search Results
12
records
(took 0.015 seconds)
