公开(公告)号：US20230075004A1

公开(公告)日：2023-03-09

申请号：US17461301

申请日：2021-08-30

Applicant: MICRO FOCUS LLC

Inventor： Yun-Sheng Liu ,  Peng-Ji Yin ,  Er-Xin Shang ,  Gil Nakache ,  Tsachi Ben Zur ,  Anton Kaminsky ,  Shuhui Fu ,  Amos Nesher ,  Eyal Luzon

IPC: G06F11/36 ,  G06N20/00 ,  G06F9/54

Abstract: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.

公开(公告)号：US12079108B2

公开(公告)日：2024-09-03

申请号：US17461301

申请日：2021-08-30

Applicant: MICRO FOCUS LLC

Inventor： Yun-Sheng Liu ,  Peng-Ji Yin ,  Er-Xin Shang ,  Gil Nakache ,  Tsachi Ben Zur ,  Anton Kaminsky ,  Shuhui Fu ,  Amos Nesher ,  Eyal Luzon

IPC: G06F11/36 ,  G06F9/54 ,  G06N20/00

CPC classification number: G06F11/3664 ,  G06F9/543 ,  G06N20/00

Abstract: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.