-
公开(公告)号：US10949174B2
公开(公告)日：2021-03-16
申请号：US16177065
申请日：2018-10-31
Applicant: salesforce.com, inc.
Inventor： Kevin C. Hou
Abstract: Techniques are disclosed relating to classifying user interface elements of existing user interfaces. This may include for example, storing information specifying known metadata values for a plurality of metadata fields and indications of relationships between ones of the known metadata values and a plurality of types of visible user interface elements. The techniques also include determining respective metadata values for a plurality of visible elements of a graphical user interface, where the metadata values are included in user interface code that specifies the plurality of visible elements. The disclosed techniques also include, based on the stored indications of relationships and the determined metadata values, scoring ones of the plurality of visible elements to generate score values for each of the plurality of types of visible elements. Finally, the disclosed techniques include, based on the scoring, classifying the plurality of visible elements according to the plurality of types of visible elements and storing information specifying the classified elements.
-
公开(公告)号：US10928982B2
公开(公告)日：2021-02-23
申请号：US16177092
申请日：2018-10-31
Applicant: salesforce.com, inc.
Inventor： Kevin C. Hou , Brian J. Lonsdorf
IPC: G06F16/906 , G06F3/0482 , G06F3/0481 , G06F3/0484
Abstract: Techniques are disclosed relating to grouping user interface elements into components. The disclosed techniques may include, for example, determining, based on hierarchical user interface code, a plurality of visible elements of a graphical user interface. In addition, the disclosed techniques include determining coordinates for bounding boxes for ones of the plurality of visible elements and determining depths within the hierarchical user interface code for the plurality of visible elements. The disclosed techniques include generating groupings for the plurality of visible elements using unsupervised clustering and the determined coordinates and depths and storing information specifying the generated groupings.
-
公开(公告)号：US10761818B2
公开(公告)日：2020-09-01
申请号：US16177050
申请日：2018-10-31
Applicant: salesforce.com, inc.
Inventor： Kevin C. Hou
Abstract: Techniques are disclosed relating to identifying types of user interface components based on one or more existing user interfaces. The disclosed techniques may include, for example, determining a plurality of visible elements of a graphical user interface, based on user interface code. Additionally, techniques include determining coordinates for bounding boxes for ones of the plurality of visible elements, based on the user interface code. Disclosed techniques may also include grouping the visible elements into at least first and second groups and determining types of elements within the first and second groups. The techniques also include, in response to detecting a match between the types of elements within the first and second groups, determining a similarity metric for the first and second groups based on the coordinates of determined bounding boxes within the first and second groups. In response to the similarity metric meeting a threshold value, the techniques include storing information defining a component type that corresponds to the first and second groups.
-
公开(公告)号：US20200133643A1
公开(公告)日：2020-04-30
申请号：US16177050
申请日：2018-10-31
Applicant: salesforce.com, inc.
Inventor： Kevin C. Hou
Abstract: Techniques are disclosed relating to identifying types of user interface components based on one or more existing user interfaces. The disclosed techniques may include, for example, determining a plurality of visible elements of a graphical user interface, based on user interface code. Additionally, techniques include determining coordinates for bounding boxes for ones of the plurality of visible elements, based on the user interface code. Disclosed techniques may also include grouping the visible elements into at least first and second groups and determining types of elements within the first and second groups. The techniques also include, in response to detecting a match between the types of elements within the first and second groups, determining a similarity metric for the first and second groups based on the coordinates of determined bounding boxes within the first and second groups. In response to the similarity metric meeting a threshold value, the techniques include storing information defining a component type that corresponds to the first and second groups.
-
-
-
Search Results
4
records
(took 0.017 seconds)
