-
公开(公告)号：US20230078782A1
公开(公告)日：2023-03-16
申请号：US17471633
申请日：2021-09-10
Applicant: MICRO FOCUS LLC
Inventor： Er-Xin Shang , Shuhui Fu , Yi-Bin Guo , Niv Lederer
IPC: G06K9/20 , G06N3/02 , G06F3/0484
Abstract: Systems and methods of associating text with a graphical user interface (GUI) object are disclosed. Disclosed systems and methods include identifying a GUI object and a text string. A positional relationship between the GUI object and the text string is determined. Based on the positional relationship between the GUI object and the text string, a map with an indication associating the GUI object with the text string is updated.
-
公开(公告)号：US20230075004A1
公开(公告)日：2023-03-09
申请号：US17461301
申请日：2021-08-30
Applicant: MICRO FOCUS LLC
Inventor： Yun-Sheng Liu , Peng-Ji Yin , Er-Xin Shang , Gil Nakache , Tsachi Ben Zur , Anton Kaminsky , Shuhui Fu , Amos Nesher , Eyal Luzon
Abstract: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.
-
公开(公告)号：US20220391313A1
公开(公告)日：2022-12-08
申请号：US17341933
申请日：2021-06-08
Applicant: MICRO FOCUS LLC
Inventor： Er-Xin Shang , Yun-Sheng Liu , Shuhui Fu , Yi-Bin Guo , Yun Yuan , Hua-Ming Zhai
IPC: G06F11/36
Abstract: Embodiments provide for automated testing of an Application Under Test (AUT) that utilizes an infinite scroll element. Automated testing of the AUT can comprise executing one or more test scripts on the AUT which can present a user interface including a plurality of elements and the test scripts can perform one or more functional tests on the AUT through the plurality of elements of the user interface. During performance of the one or more functional tests, a scroll event associated with an element of the user interface can be detected and a determination can be made as to whether the element associated with the scroll event is an infinite scroll element. In response to determining the element is an infinite scroll element, a set of test results for the functional test can be recorded including results for the infinite scroll element and an interaction with the infinite scroll element.
-
Patent Agency Ranking
公开(公告)号：US12079108B2
公开(公告)日：2024-09-03
申请号：US17461301
申请日：2021-08-30
Applicant: MICRO FOCUS LLC
Inventor： Yun-Sheng Liu , Peng-Ji Yin , Er-Xin Shang , Gil Nakache , Tsachi Ben Zur , Anton Kaminsky , Shuhui Fu , Amos Nesher , Eyal Luzon
CPC classification number: G06F11/3664 , G06F9/543 , G06N20/00
Abstract: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.
-
公开(公告)号：US11698849B2
公开(公告)日：2023-07-11
申请号：US17201320
申请日：2021-03-15
Applicant: MICRO FOCUS LLC
Inventor： Peng-Ji Yin , Xiao-Fei Yu , Shuhui Fu , Yi-Bin Guo
CPC classification number: G06F11/3664 , G06F3/0487 , G06F8/65 , G06F11/3688 , G06F18/22 , G06T7/11 , G06V10/40 , G06T2200/24
Abstract: Applications under test (AUT) may be tested by automated testing systems utilizing machine vision to recognize visual elements presented by the AUT and apply inputs to graphical elements, just as a human would. By utilizing the smallest image patch available, processing demands of the testing system are minimized. However, the image patch used to identify a portion of an AUT must be identifiable to the automated system. By selecting image patches that comprise the smallest size, but can be identified in an AUT by an automated system using machine vision, even as the AUT display is resized, reproportioned, noisy, or otherwise altered from the testing platform that was utilized for training.
-
公开(公告)号：US11650911B2
公开(公告)日：2023-05-16
申请号：US17341933
申请日：2021-06-08
Applicant: MICRO FOCUS LLC
Inventor： Er-Xin Shang , Yun-Sheng Liu , Shuhui Fu , Yi-Bin Guo , Yun Yuan , Hua-Ming Zhai
IPC: G06F11/36
CPC classification number: G06F11/3688 , G06F11/3664 , G06F11/3692
Abstract: Embodiments provide for automated testing of an Application Under Test (AUT) that utilizes an infinite scroll element. Automated testing of the AUT can comprise executing one or more test scripts on the AUT which can present a user interface including a plurality of elements and the test scripts can perform one or more functional tests on the AUT through the plurality of elements of the user interface. During performance of the one or more functional tests, a scroll event associated with an element of the user interface can be detected and a determination can be made as to whether the element associated with the scroll event is an infinite scroll element. In response to determining the element is an infinite scroll element, a set of test results for the functional test can be recorded including results for the infinite scroll element and an interaction with the infinite scroll element.
-
公开(公告)号：US11561678B1
公开(公告)日：2023-01-24
申请号：US17513718
申请日：2021-10-28
Applicant: MICRO FOCUS LLC
Inventor： Er-Xin Shang , Shuhui Fu , Yun Yuan
IPC: G06F3/0482 , G06N20/00 , G06F40/232
Abstract: An image of a user interface of a device is captured. A graphical object is identified in the image of the user interface. For example, a menu item or a text object is identified in the image of the user interface. An Artificial Intelligence (AI) process is used to determine a confidence score for the graphical object; the confidence score identifies a confidence of how likely a type of the graphical object can be identified. In response to the first confidence score not meeting a threshold, a zoomed in image of the graphical object is taken or a zoomed-out image of the graphical object is taken. The zoomed in image or the zoomed-out image is used to increase the confidence score to better identify the type of the graphical object.
-
公开(公告)号：US20220292011A1
公开(公告)日：2022-09-15
申请号：US17201320
申请日：2021-03-15
Applicant: MICRO FOCUS LLC
Inventor： Peng-Ji Yin , Xiao-Fei Yu , Shuhui Fu , Yi-Bin Guo
Abstract: Applications under test (AUT) may be tested by automated testing systems utilizing machine vision to recognize visual elements presented by the AUT and apply inputs to graphical elements, just as a human would. By utilizing the smallest image patch available, processing demands of the testing system are minimized. However, the image patch used to identify a portion of an AUT must be identifiable to the automated system. By selecting image patches that comprise the smallest size, but can be identified in an AUT by an automated system using machine vision, even as the AUT display is resized, reproportioned, noisy, or otherwise altered from the testing platform that was utilized for training.
-
-
-
-
-
-
-
Search Results
8
records
(took 0.018 seconds)
