公开(公告)号：US20240202940A1

公开(公告)日：2024-06-20

申请号：US18084606

申请日：2022-12-20

Applicant: Adobe Inc.

Inventor： Chang Xiao ,  Ryan Rossi ,  Enyu Cai

IPC: G06T7/246 ,  G06T7/215 ,  G06T7/73 ,  G06T15/20

CPC classification number: G06T7/248 ,  G06T7/215 ,  G06T7/74 ,  G06T15/205 ,  G06T2207/10016 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30244 ,  G06T2210/56

Abstract: Certain aspects and features of this disclosure relate to providing a hybrid approach for camera pose estimation using a deep learning-based image matcher and a match refinement procedure. The image matcher takes an image pair as an input and estimates coarse point-to-point feature matches between the two images. The coarse point-to-point feature matches can be filtered based on a stability threshold to produce high-stability point-to-point matches. A perspective-n-point (PnP) camera pose for each frame of video, including one or more added digital visual elements can be computed using the high-stability matches and video frames can be rendered, each using its computed camera pose.