公开(公告)号：US11137985B2

公开(公告)日：2021-10-05

申请号：US16779215

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Alan Martin Ross ,  Sönke Rohde ,  David James Woodward ,  Jessica Lundin

IPC: G06F8/38 ,  G06T11/20 ,  G06T7/11 ,  G06F16/957

Abstract: Techniques are disclosed for automatically generating stencils for content of a user interface (UI) to be rendered. A computer system receives information specifying content of a user interface (UI) to be rendered. Based on this information, the computer system identifies one or more bounding regions of content within the UI, including analyzing metadata and a rendered version of the UI. The computer system then automatically generates, one or more UI stencils based on the identified bounding regions, that are displayable as progress indicators prior to rendering corresponding UI content. Once it has generated the stencils, the computer system stores information specifying the one or more UI stencils for use in the UI. Automatically generating stencils for UIs may advantageously reduce the time gap from development to deployment of these UIs while improving their perceived performance and, by extension, improving user experience.

公开(公告)号：US20200341781A1

公开(公告)日：2020-10-29

申请号：US16393235

申请日：2019-04-24

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Sönke Rohde

IPC: G06F9/451 ,  H04L29/08 ,  G06Q30/02 ,  G06Q30/06 ,  G06F3/0481

Abstract: Techniques are disclosed relating to custom user interface design based on user interaction metrics from another communication channel. In disclosed embodiments, a computing system generates one or more interaction metrics, based on a first set of user input characteristics for user interaction with multiple different user interface formats via a first communication channel. In some embodiments, the first communication channel supports tracking of the first set of user input characteristics and a second communication channel supports tracking of a second, different set of user input characteristics. In some embodiments, the computing system determines, based on the one or more interaction metrics from the first communication channel, a set of design parameters for formatting a user interface to be displayed via the second communication channel.

公开(公告)号：US20200341602A1

公开(公告)日：2020-10-29

申请号：US16393180

申请日：2019-04-24

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Sönke Rohde

IPC: G06F3/0484 ,  G06F3/0481

Abstract: Disclosed techniques relate to scoring input elements independently, based on user comparison inputs for training data. In some embodiments, for a set of training elements, a system displays subsets to users and receives user input indicating ones of the subsets that more strongly exhibit a specified user interface design parameter relative to other user interface elements in that subset. In some embodiments, a ranking technique such as Bradley-Terry techniques generate a ranking of the user interface elements according to the design parameter based on the user input. In some embodiments, the system trains a machine learning engine to score a subsequently presented input user interface element according to the design parameter, using outputs of the ranking as labels.

公开(公告)号：US10789066B1

公开(公告)日：2020-09-29

申请号：US16399524

申请日：2019-04-30

Applicant: salesforce.com, inc.

Inventor： Sönke Rohde ,  Brian J. Lonsdorf

IPC: G06F9/445 ,  G06F9/44 ,  G06F8/71 ,  G06K9/46 ,  G06F8/65 ,  G06F16/958 ,  G06F16/957

Abstract: Disclosed herein are system, method, and computer program product embodiments for automatically upgrading and finding components similar to legacy versions. In an embodiment, an automatic upgrading system may determine a first pattern for a first graphical component of a computing platform, identify a first attribute for the first pattern. A second graphical component may be searched by similar attribute as the first graphical component to replace the first graphical component for the computing platform.

公开(公告)号：US10783405B2

公开(公告)日：2020-09-22

申请号：US16176760

申请日：2018-10-31

Applicant: salesforce.com, inc.

Inventor： Sonke Rohde ,  Brian J. Lonsdorf

IPC: G06F3/00 ,  G06K9/62 ,  G06N20/00 ,  G06F40/14 ,  G06F8/38

Abstract: Techniques are disclosed relating to refining, based on user feedback, one or more machine learning engines for automatically generating component-based user interfaces. In various embodiments, a computer system stores template information that defines a plurality of component types and one or more display parameters identified for one or more user interfaces. The computer system may receive a request to generate a user interface, where the request specifies a data set to be displayed. Further, the computer system may automatically generate a user interface, where the generating is performed by one or more machine learning engines that use the template information and the data set as inputs. The computer system may then provide the user interface to one or more users, receive user feedback associated with the user interface, and train at least one of the one or more machine learning engines based on the user feedback.

公开(公告)号：US11868790B2

公开(公告)日：2024-01-09

申请号：US17649016

申请日：2022-01-26

Applicant: salesforce.com, inc.

Inventor： Michael Sollami ,  Sönke Rohde ,  Alan Martin Ross ,  David James Woodward ,  Jessica Lundin ,  Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Aashish Jain

IPC: G06F9/451 ,  G06N3/08 ,  G06F9/54 ,  G06N3/045 ,  G06V10/762 ,  G06V10/771 ,  G06V10/82 ,  G06F3/04845 ,  G06N3/088 ,  G06F8/38 ,  G06N3/047 ,  G06N3/044 ,  G06N7/01 ,  G06V30/19 ,  G06F17/00

CPC classification number: G06F9/451 ,  G06F3/04845 ,  G06F9/547 ,  G06N3/045 ,  G06N3/08 ,  G06V10/763 ,  G06V10/771 ,  G06V10/82 ,  G06F8/38 ,  G06N3/044 ,  G06N3/047 ,  G06N3/088 ,  G06N7/01 ,  G06V30/19173

Abstract: Techniques are disclosed for automatically generating new content using a trained 1-to-N generative adversarial network (GAN) model. In disclosed techniques, a computer system receives, from a computing device, a request for newly-generated content, where the request includes current content. The computer system automatically generates, using the trained 1-to-N GAN model, N different versions of new content, where a given version of new content is automatically generated based on the current content and one of N different style codes, where the value of N is at least two. After generating the N different versions of new content, the computer system transmits them to the computing device. The disclosed techniques may advantageously automate a content generation process, thereby saving time and computing resources via execution of the 1-to-N GAN machine learning model.

公开(公告)号：US11610138B2

公开(公告)日：2023-03-21

申请号：US16854913

申请日：2020-04-22

Applicant: salesforce.com, inc.

Inventor： Jessica Lundin ,  Owen Winne Schoppe ,  Alan Martin Ross ,  Brian J. Lonsdorf ,  David James Woodward ,  Sönke Rohde ,  Michael Reynolds Sollami ,  Chetan Ramaiah

IPC: G06V30/244 ,  G06N5/02 ,  G06F17/16 ,  G06F40/109 ,  G06N20/00 ,  G06N5/04 ,  G06T7/00

Abstract: A textual properties model is used to infer values for certain font properties of interest given certain text-related data, such as rendered text images. The model may be used for numerous purposes, such as aiding with document layout, identifying font families that are similar to a given font families, and generating new font families with specific desired properties. In some embodiments, the model is trained from a combination of synthetic data that is labeled with values for the font properties of interest, and partially-labeled data from existing “real-world” documents.

公开(公告)号：US11531557B2

公开(公告)日：2022-12-20

申请号：US16941094

申请日：2020-07-28

Applicant: salesforce.com, inc.

Inventor： David James Woodward ,  Brian J. Lonsdorf ,  Owen Winne Schoppe ,  Alan Martin Ross ,  Jessica Lundin ,  Sönke Rohde

IPC: G06F9/451 ,  G06N20/00

Abstract: Disclosed herein are system, method, and computer program product embodiments for determining the minimum set of user interface (UI) elements for a task. One embodiment operates by transmitting UI elements associated with an application to a first computing device operated by a first user and a second computing device operated by a second user. Further, the embodiment includes obtaining data structures corresponding to a first task and a second task and then grouping, using a machine learning model, the data structures into a first cluster corresponding to the first task and a second cluster corresponding to the second task. Further still, the embodiment also includes determining a minimum set of UI elements required for the first task based on the first cluster.

公开(公告)号：US11475205B2

公开(公告)日：2022-10-18

申请号：US16779390

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Jessica Lundin ,  David James Woodward ,  Alan Martin Ross ,  Brian J. Lonsdorf ,  Owen Winne Schoppe ,  Sönke Rohde

IPC: G06F40/106 ,  G06N20/00 ,  G06F9/451 ,  G06F40/151

Abstract: Techniques are disclosed relating to determining locations of child elements in a user interface (UI), automatically updating the locations of the child elements in the UI, and generating an updated UI with the updated locations. A computer system may receive information specifying content of the UI and render an image of the UI based on the received information. Computer vision algorithms may be applied to the rendered of the UI to determine locations of elements in the UI. The locations of the elements may be updated to position the elements in selected locations relative to each other. The updated locations of the elements as determined by the computer vision algorithms may be implemented to generate updating information specifying content for the updated UI.

公开(公告)号：US11474671B2

公开(公告)日：2022-10-18

申请号：US16779290

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Sönke Rohde ,  Brian J. Lonsdorf ,  Jessica Lundin ,  David James Woodward ,  Alan Martin Ross

IPC: G06F3/0484

Abstract: Techniques are disclosed relating to measuring presentation aspects of portions of a user interface (UI) that have been identified to be presented neutrally and automatically generating a new UI that reduces differences in the presentation aspects of the identified portions. Portions of the UI identified to be presented neutrally may include elements or content in the UI identified to be presented neutrally. Portions for neutral presentation may include portions of UI that, for example, portions that present legal decisions, portions with survey data, forms or information displays, or portions where a user is requested to make a choice between alternative options. Presentation aspects that may be measured include, for example, visual aspects, clarity aspects, or tonal aspects. Reducing the differences in the presentation aspects may present the elements or content with more neutrality to reduce influence in decisions due to visual, clarity, or tonal aspects between the elements or content.