公开(公告)号：US20220222046A1

公开(公告)日：2022-07-14

申请号：US17354439

申请日：2021-06-22

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Sönke Rohde ,  Brian J. Lonsdorf ,  Jessica Lundin ,  David J. Woodward ,  Alan Martin Ross ,  Michael Sollami

IPC: G06F8/20 ,  G06N20/00 ,  G06F9/451 ,  G06F8/38

Abstract: Techniques are disclosed relating to automatically synthesizing user interface (UI) component instances. In disclosed techniques a computer system receives a set of existing UI elements and a set of design rules for the set of existing elements, where design rules in the set of design rules indicate one or more allowed states for respective UI elements in the set of existing UI elements. The one or more allowed states may correspond to one or more visual characteristics. Using the set of existing UI elements, the computer system may then automatically generate a plurality of UI component instances based on the set of design rules, where a respective UI component instance includes a first UI element in a first allowed state. The computer system may then train, using the plurality of UI component instances, a machine learning model operable to automatically generate UI designs.

公开(公告)号：US20220180581A1

公开(公告)日：2022-06-09

申请号：US17116944

申请日：2020-12-09

Applicant: salesforce.com, inc.

Inventor： Jessica Lundin ,  Michael Reynolds Sollami ,  Alan Martin Ross ,  Brian J. Lonsdorf ,  David James Woodward ,  Owen Winne Schoppe ,  Sönke Rohde

IPC: G06T11/60 ,  G06K9/62 ,  G06T7/70 ,  G06N3/08

Abstract: Disclosed herein are system, method and computer readable storage medium for detecting space suitable for overlaying media content onto an image. The system receives a candidate image which may be an image or a video frame. The candidate image is then input into a neural network. The neural network may output coordinates and one or more dimensions representing one or more bounding boxes for inserting media content into the candidate image. The one or more bounding boxes may be transmitted with a request for a media content item to be displayed in a bounding box. In response to the request the media content item may be received, and the candidate image and the media content item overlaid on top of the candidate image within the bounding box may be displayed.

公开(公告)号：US20220091862A1

公开(公告)日：2022-03-24

申请号：US17643089

申请日：2021-12-07

Applicant: salesforce.com, inc.

Inventor： Joseph Andolina ,  Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Sönke Rohde

IPC: G06F9/451 ,  G06F3/0481 ,  G06N20/00 ,  G06F16/28

Abstract: Techniques are disclosed relating to emphasizing user interface elements for different users based on user attributes. In some embodiments, a system maintains a set of information (e.g., for a particular product) that includes multiple types of information. The system may access the same set of information for different user requests. The computing system may determine first and second subsets of the set of information based on attributes of the different users. The computing system may cause display of a first user interface on a device of the first user showing only the first subset of item fields for the two or more of the first set of items. The computing system may cause display of a second user interface on a device of the second user showing only the second subset of item fields for the two or more of the second set of items.

公开(公告)号：US11226834B2

公开(公告)日：2022-01-18

申请号：US16393082

申请日：2019-04-24

Applicant: salesforce.com, inc.

Inventor： Joseph Andolina ,  Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Sönke Rohde

IPC: G06F3/0481 ,  G06F16/9535 ,  G06F9/451 ,  G06N20/00 ,  G06F16/28

Abstract: Techniques are disclosed relating to emphasizing user interface elements for different users based on user attributes. In some embodiments, a system maintains a set of information (e.g., for a particular product) that includes multiple types of information. The system may access the same set of information for different user requests. The computing system may determine first and second subsets of the set of information based on attributes of the different users. The computing system may cause display of a first user interface on a device of the first user, where the first user interface shows only the first subset of information with a first element displayed using a first format. The computing system may cause display of a second user interface on a device of the second user, where the second user interface shows only the second subset of information with the first element displayed using a second format.

公开(公告)号：US20210240910A1

公开(公告)日：2021-08-05

申请号：US16779390

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Jessica Lundin ,  David James Woodward ,  Alan Martin Ross ,  Brian J. Lonsdorf ,  Owen Winne Schoppe ,  Sönke Rohde

IPC: G06F40/106 ,  G06F40/151 ,  G06F9/451 ,  G06N20/00

Abstract: Techniques are disclosed relating to determining locations of child elements in a user interface (UI), automatically updating the locations of the child elements in the UI, and generating an updated UI with the updated locations. A computer system may receive information specifying content of the UI and render an image of the UI based on the received information. Computer vision algorithms may be applied to the rendered of the UI to determine locations of elements in the UI. The locations of the elements may be updated to position the elements in selected locations relative to each other. The updated locations of the elements as determined by the computer vision algorithms may be implemented to generate updating information specifying content for the updated UI.

公开(公告)号：US20210240452A1

公开(公告)日：2021-08-05

申请号：US16779215

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Alan Martin Ross ,  Sönke Rohde ,  David James Woodward ,  Jessica Lundin

IPC: G06F8/38 ,  G06T11/20

Abstract: Techniques are disclosed for automatically generating stencils for content of a user interface (UI) to be rendered. A computer system receives information specifying content of a user interface (UI) to be rendered. Based on this information, the computer system identifies one or more bounding regions of content within the UI, including analyzing metadata and a rendered version of the UI. The computer system then automatically generates, one or more UI stencils based on the identified bounding regions, that are displayable as progress indicators prior to rendering corresponding UI content. Once it has generated the stencils, the computer system stores information specifying the one or more UI stencils for use in the UI. Automatically generating stencils for UIs may advantageously reduce the time gap from development to deployment of these UIs while improving their perceived performance and, by extension, improving user experience.

公开(公告)号：US20210240451A1

公开(公告)日：2021-08-05

申请号：US16779177

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Alan Martin Ross ,  Sönke Rohde ,  David James Woodward ,  Jessica Lundin

IPC: G06F8/38 ,  G06F8/36 ,  G06N20/00 ,  G06F40/30

Abstract: Techniques are disclosed relating to determining a similarity of components of a current user interface (UI) to new UI components for use in automatically generating a new UI. A computer system may receive information specifying a current UI including a particular current UI component and information specifying a plurality of new UI components for a new UI. The computer system may then identify characteristics of the particular current UI component. Based on these identified characteristics, the computer system may score ones of the plurality of new UI components, where the scoring is performed to determine a similarity to the particular current UI component. The computer system may then select, based on the scores, a particular new UI component from the plurality of new UI components for use, in the new UI, for the particular current UI component. Such techniques may advantageously improve user experience by automatically providing up-to-date user interfaces.

公开(公告)号：US20210240319A1

公开(公告)日：2021-08-05

申请号：US16779290

申请日：2020-01-31

Applicant: salesforce.com, inc.

Inventor： Owen Winne Schoppe ,  Sönke Rohde ,  Brian J. Lonsdorf ,  Jessica Lundin ,  David James Woodward ,  Alan Martin Ross

IPC: G06F3/0484

Abstract: Techniques are disclosed relating to measuring presentation aspects of portions of a user interface (UI) that have been identified to be presented neutrally and automatically generating a new UI that reduces differences in the presentation aspects of the identified portions. Portions of the UI identified to be presented neutrally may include elements or content in the UI identified to be presented neutrally. Portions for neutral presentation may include portions of UI that, for example, portions that present legal decisions, portions with survey data, forms or information displays, or portions where a user is requested to make a choice between alternative options. Presentation aspects that may be measured include, for example, visual aspects, clarity aspects, or tonal aspects. Reducing the differences in the presentation aspects may present the elements or content with more neutrality to reduce influence in decisions due to visual, clarity, or tonal aspects between the elements or content.

公开(公告)号：US20200341780A1

公开(公告)日：2020-10-29

申请号：US16393082

申请日：2019-04-24

Applicant: salesforce.com, inc.

Inventor： Joseph Andolina ,  Owen Winne Schoppe ,  Brian J. Lonsdorf ,  Sönke Rohde

IPC: G06F9/451 ,  G06F16/28 ,  G06N20/00 ,  G06F3/0481

Abstract: Techniques are disclosed relating to emphasizing user interface elements for different users based on user attributes. In some embodiments, a system maintains a set of information (e.g., for a particular product) that includes multiple types of information. The system may access the same set of information for different user requests. The computing system may determine first and second subsets of the set of information based on attributes of the different users. The computing system may cause display of a first user interface on a device of the first user, where the first user interface shows only the first subset of information with a first element displayed using a first format. The computing system may cause display of a second user interface on a device of the second user, where the second user interface shows only the second subset of information with the first element displayed using a second format.

公开(公告)号：US20200341779A1

公开(公告)日：2020-10-29

申请号：US16393017

申请日：2019-04-24

Applicant: salesforce.com, inc.

Inventor： Sönke Rohde ,  Brian J. Lonsdorf ,  Owen Winne Schoppe

IPC: G06F9/451 ,  G06F8/20 ,  G06N20/00 ,  G06F3/0481

Abstract: Techniques are disclosed relating to providing customized user interfaces to different groups of users. A computing system may determine a plurality of different design types for a user interface and cause display of user interfaces that exhibit the different design types to different users. Based on user interactions with the user interfaces, the system may generate one or more metrics. The system may and may determine attribute values for attributes of users who interact with the user interface. The system may perform one or more correlation procedures to correlate the attribute values with one or more of the metrics. In disclosed embodiments, the computing system generates groups of users based on the correlation. The computing system may assign at least one of the design types to at least one of the groups of users based on the correlation.