Model-driven evaluator bias detection

    公开(公告)号:US10685329B2

    公开(公告)日:2020-06-16

    申请号:US15477844

    申请日:2017-04-03

    申请人: HireVue, Inc.

    摘要: A method for detecting bias in an evaluation process is provided. The method includes operations of receiving evaluation data from a candidate evaluation system. The evaluation data is provided by a set of evaluators based on digital interview data collected from evaluation candidates. The operations of the method further include extracting indicators of characteristics of the evaluation candidates from the digital interview data, classifying the evaluation candidates based on the indicators extracted from the digital interview data, and determining whether the evaluation data indicates a bias of one or more evaluators with respect to a classification of the evaluation candidates.

    INTERVIEWEE EVALUATOR
    2.
    发明申请
    INTERVIEWEE EVALUATOR 审中-公开
    采访评估员

    公开(公告)号:US20130111401A1

    公开(公告)日:2013-05-02

    申请号:US13285979

    申请日:2011-10-31

    IPC分类号: G06F3/048

    CPC分类号: G06Q10/1053 G09B7/02

    摘要: A user interface for evaluating interview candidates. A user interface, including a first interview card is displayed. The first interview card includes information about a first interviewee and the first interviewee's response to a first interview question. User input indicative of a direction is received. The user input is either indicative of a direction in a first plane or indicative of a direction in a second plane. When the user input is in a direction in the first plane, a second interview card is displayed including information about a second interviewee and the second interviewee's response to the first question. When the user input is in a direction in the second plane, a third interview card is displayed including information about the first interviewee and the first interviewee's response to a second question.

    摘要翻译: 用于评估面试候选人的用户界面。 显示包括第一个面试卡的用户界面。 第一个面试卡包括有关第一个受访者的信息和第一个受访者对第一个面试问题的回复。 接收到指示方向的用户输入。 用户输入指示第一平面中的方向或指示第二平面中的方向。 当用户输入处于第一平面中的方向时,显示第二访问卡,其包括关于第二受访者的信息和第二受访者对第一问题的响应。 当用户输入在第二平面中的方向时,显示第三访问卡,其包括关于第一受访者和第一受访者对第二个问题的响应的信息。

    Performance model adverse impact correction

    公开(公告)号:US10438135B2

    公开(公告)日:2019-10-08

    申请号:US15277769

    申请日:2016-09-27

    申请人: HireVue, Inc.

    摘要: Technology for training a predictive model is described. A processing device collects digital interview data including features identified from candidate interviews. A model training tool selects a data set of the digital interview data. The data set includes a predicted performance outcome and an actual performance outcome for each of a plurality of candidates. The model training tool determines an error metric for each of the plurality of candidates. The error metric includes a relationship between the predicted performance outcome and the actual performance outcome for each candidate. The model training tool determines a number of candidates whose digital interview data includes a feature corresponding to a protected class. The model training tool normalizes an effect of each candidate on the error metric based on the corresponding protected class and applies the normalized error metric to reduce bias in the predictive model with respect to the protected class.

    Model-driven candidate sorting
    4.
    发明授权
    Model-driven candidate sorting 有权
    模型驱动候选排序

    公开(公告)号:US09009045B1

    公开(公告)日:2015-04-14

    申请号:US14183346

    申请日:2014-02-18

    申请人: HireVue, Inc.

    IPC分类号: G10L15/06 G10L15/18

    摘要: Methods and systems for model-driven candidate sorting for evaluating digital interviews are described. In one embodiment, a model-driven candidate-sorting tool selects a data set of digital interview data for sorting. The data set includes candidate for interviewing candidates (also referred to herein as interviewees). The model-driven candidate-sorting tool analyzes the candidate data for the respective interviewing candidate to identify digital interviewing cues and applies the digital interview cues to a prediction model to predict an achievement index for the respective interviewing candidate. This is performed without reviewer input at the model-driven candidate-sorting tool. The list of interview candidates is sorted according the predicted achievement indices and the sorted list is presented to the reviewer in a user interface.

    摘要翻译: 描述了用于评估数字访谈​​的模型驱动候选排序的方法和系统。 在一个实施例中,模型驱动的候选排序工具选择用于排序的数字面试数据的数据集。 数据集包括候选人面试候选人(本文也称为受访者)。 模型驱动的候选排序工具分析相应面试候选人的候选数据,以识别数字面试提示,并将数字面试提示应用于预测模型,以预测各个面试候选人的成就指标。 在模型驱动的候选排序工具中不进行审阅者输入。 面试候选人名单根据预测成绩指标进行排序,排序列表在用户界面中呈现给审阅者。

    Detecting disability and ensuring fairness in automated scoring of video interviews

    公开(公告)号:US11257041B2

    公开(公告)日:2022-02-22

    申请号:US16105767

    申请日:2018-08-20

    申请人: HireVue, Inc.

    摘要: A processing device is to: identify, using digital interview data of interviewees captured during interviews, a subset of the interviewees that have a disability; label a first group of the interviewees as disabled and a second group of the interviewees as not disabled with reference to the disability; identify features from the digital interview data for the first group that correlate with the disability; formulate a digital fingerprint of the features that identifies how the first group differs from the second group with reference to the disability; map the digital fingerprint of the features onto a dataset of an interviewee belonging to the second group of the interviewees, to generate a mapped dataset; and determine, from the mapped dataset, effects of the digital fingerprint on a job performance score for the interviewee.

    Competency-based question selection for digital evaluation platforms

    公开(公告)号:US10528916B1

    公开(公告)日:2020-01-07

    申请号:US14935282

    申请日:2015-11-06

    申请人: HireVue, Inc.

    摘要: Described are methods and systems for interview competency and question validation and analysis to improve the effectiveness of evaluation campaigns. In one method, processing logic of an interview design program, hosted by a digital evaluation platform, receives a request from a first device to create a digital interview for a position. The interview design program sends a list of competencies associated with the position and receives a selection of a set of desired competencies. The interview design program determines a list of questions that differentiate candidates within the desired competencies, ranks the list of questions by importance, and sends the list of questions and the ranking information to the first device and receives a selection of a set of desired questions. The interview design program creates the digital interview with the set of desired questions. The digital evaluation platform presents the digital interview to a candidate on a second device.

    Automatic interview question recommendation and analysis

    公开(公告)号:US10242345B2

    公开(公告)日:2019-03-26

    申请号:US15164249

    申请日:2016-05-25

    申请人: HireVue, Inc.

    摘要: Described herein are methods and systems for interview question or prompt recommendation and analysis to improve the quality and efficacy of subsequent evaluation campaigns by combining data sets are described herein. In one method, processing logic selects a first prompt from a first data set of a first candidate evaluation campaign and a second prompt from a second data set of a second candidate evaluation campaign. The processing logic determines whether a degree of similarity between the first prompt and the second prompt exceeds a threshold and combines data from the first data set with data from the second data set to create a combined data set associated with the first prompt and with the second prompt based on the determination.

    Model-driven evaluator bias detection

    公开(公告)号:US09652745B2

    公开(公告)日:2017-05-16

    申请号:US14543776

    申请日:2014-11-17

    申请人: HireVue, Inc.

    IPC分类号: G06Q10/10

    摘要: A method for detecting bias in an evaluation process is provided. The method includes operations of receiving evaluation data from a candidate evaluation system. The evaluation data is provided by a set of evaluators based on digital interview data collected from evaluation candidates. The operations of the method further include extracting indicators of characteristics of the evaluation candidates from the digital interview data, classifying the evaluation candidates based on the indicators extracted from the digital interview data, and determining whether the evaluation data indicates a bias of one or more evaluators with respect to a classification of the evaluation candidates.

    INTERVIEW FRAMEWORKS
    9.
    发明申请
    INTERVIEW FRAMEWORKS 审中-公开
    采访框架

    公开(公告)号:US20120271774A1

    公开(公告)日:2012-10-25

    申请号:US13091308

    申请日:2011-04-21

    IPC分类号: G06Q10/00

    CPC分类号: G06Q10/1053

    摘要: Selecting interview questions to be posed to an interviewee. A method includes receiving user input. The user input selects an interview evaluation system from among a number of different interview evaluation systems. Each interview evaluation system in the number of different interview evaluation systems includes functionality for at least one of scoring interview interactions or rating interviewees. At least two or more of the interview evaluation systems from among the number of different interview evaluation systems include different functionality for scoring interview interactions or rating interviewees. Based on the user input selecting an interview evaluation system, a set of interview queries from among a plurality of pre-defined interview queries are automatically selected. The selected set of interview queries are provided for use in an interview of an interviewee.

    摘要翻译: 选择面试问题给受访者。 一种方法包括接收用户输入。 用户输入从多个不同的面试评估系统中选择面试评估系统。 每个面试评估系统在不同的面试评估系统的数量中都包含至少一个评分面试交互或评价受访者的功能。 来自不同面试评估系统的面试评估系统中至少有两个以上的面试评估系统包括评分面试交互或评价受访者的不同功能。 基于选择面试评估系统的用户输入,自动选择来自多个预定义面试查询之间的一组面试查询。 提供了一组面试查询用于面试中的受访者。

    Model-assisted evaluation and intelligent interview feedback

    公开(公告)号:US10346805B2

    公开(公告)日:2019-07-09

    申请号:US15613901

    申请日:2017-06-05

    申请人: HireVue, Inc.

    IPC分类号: G06Q10/10

    摘要: A method for facilitating the evaluation of candidates in an evaluation process is provided. The method includes operations of selecting a first data set including ratings of recorded responses of a set of evaluated persons and of selecting a second data set including additional recorded responses of a person under evaluation. The recorded responses are responsive to multiple prompts presented to each of the set evaluated persons in a recording sequence. The first data set further includes an evaluation result of each evaluated person in the evaluation. The additional recorded responses are responsive to the plurality of prompts and ordered in a first order corresponding to a recording sequence. The method includes analyzing the first data set to calculate a reviewing sequence and presenting the additional recorded responses in a second order corresponding to the reviewing sequence. Associated systems and other methods are also provided.