公开(公告)号：US12065051B2

公开(公告)日：2024-08-20

申请号：US17308184

申请日：2021-05-05

Applicant: ABB E-mobility B.V.

Inventor： Matthew Hetrich

IPC: H01M10/44 ,  B60L53/10 ,  B60L53/16 ,  B60L53/37 ,  G06N20/00 ,  H01M10/46

CPC classification number: B60L53/37 ,  B60L53/11 ,  B60L53/16 ,  G06N20/00

Abstract: A plug connection system that autonomously charges an electric vehicle (EV) is provided. The method includes: obtaining a trained machine learning (ML) model from a back-end server; capturing an image using an image capturing device of the charging system, wherein a portion of the image comprises the EV charging portal; inputting the image into the trained ML model to determine one or more regions of interest associated with the EV charging portal within the image; determining a location of the EV charging portal based on the one or more determined regions of interest and one or more image processing techniques; and providing information to maneuver the robotic arm of the charging system to a physical position based on the determined location of the EV charging portal.

公开(公告)号：US12062208B2

公开(公告)日：2024-08-13

申请号：US17331222

申请日：2021-05-26

Applicant: ABB E-mobility B.V.

Inventor： Matthew Hetrich ,  Gregory A. Cole

IPC: B60L53/37 ,  G06T7/70 ,  G06T7/73 ,  G06V10/75 ,  G06V10/82 ,  H04N23/695

CPC classification number: G06T7/74 ,  B60L53/37 ,  G06T7/70 ,  G06T7/73 ,  G06V10/757 ,  G06V10/82 ,  H04N23/695 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30244 ,  G06T2207/30252

Abstract: An automated charging system for an electric vehicle is disclosed that includes a plug with a built-in camera assembly. The camera assembly captures images of a charging port of the electric vehicle, which are processed by one or more processors to estimate the location of the charging port relative to the plug. A multi-stage localization architecture is described that includes a gross localization procedure and a fine localization procedure. The gross localization procedure can implement a first convolutional neural network (CNN) to estimate a position of an object in the image. The fine localization procedure can implement a second CNN to estimate a position and orientation of the object. Actuators for moving the plug in a three-dimensional space can be controlled by the multi-stage localization architecture.

公开(公告)号：US20240244332A1

公开(公告)日：2024-07-18

申请号：US18155807

申请日：2023-01-18

Applicant: ABB E-mobility B.V.

Inventor： Matthew Hetrich

IPC: H04N23/74 ,  B25J9/16 ,  G06T7/70 ,  H04N23/56 ,  H04N23/71

CPC classification number: H04N23/74 ,  B25J9/1664 ,  B25J9/1697 ,  G06T7/70 ,  H04N23/56 ,  H04N23/71 ,  G06T2207/10152 ,  G06T2207/20212 ,  G06T2207/30204

Abstract: An apparatus for directing a connection element is provided. The apparatus includes a robotic element for manipulating the connection element and a computer vision system communicatively coupled to the robotic element. The computer vision system includes one or more processors configured to: receive a first frame representing an environment at a first time, the environment at the first time comprising marker light of a first mode and other light; receive a second frame of the environment at a second time, the environment at the second time comprising marker light of a second mode and the other light; compare the first frame to the second frame to determine a difference in lighting in the environment between the first time and the second time; and differentiate the marker light of the first mode and the marker light of the second mode from the other light based on the determined difference.