公开(公告)号：US12261751B2

公开(公告)日：2025-03-25

申请号：US18117616

申请日：2023-03-06

Applicant: Cisco Technology, Inc.

Inventor： Grégory Mermoud ,  Jean-Philippe Vasseur

IPC: H04L41/16 ,  H04L41/50 ,  H04L41/5009

Abstract: In one embodiment, a device causes, in accordance with a probing strategy, performance of a probing test by one or more agents in a network and with respect to an online application. The device obtains quality of experience measurements for the online application. The device adjusts, using reinforcement learning, the probing strategy based on how well a predictive model was able to predict the quality of experience measurements given results of the probing test. The device repeats the causing, obtaining, and adjusting steps using the probing strategy adjusted by the device, to find a minimally disruptive probing strategy that provides acceptable performance by the predictive model.

公开(公告)号：US20250086205A1

公开(公告)日：2025-03-13

申请号：US18244530

申请日：2023-09-11

Applicant: Cisco Technology, Inc.

Inventor： Jean-Philippe Vasseur ,  Grégory Mermoud ,  Pierre-André Savalle

IPC: G06F16/332 ,  G06F40/253

Abstract: In one implementation, a device generates a response to user input using a first language model. The device determines that the response is an erroneous response. The device generates a resolution to the erroneous response using a teacher language model. The device updates the first language model using the resolution from the teacher language model.

公开(公告)号：US12231312B2

公开(公告)日：2025-02-18

申请号：US17328205

申请日：2021-05-24

Applicant: Cisco Technology, Inc.

Inventor： Jean-Philippe Vasseur ,  Vinay Kumar Kolar ,  Grégory Mermoud ,  Pierre-André Savalle

IPC: H04L43/045 ,  G06F16/901 ,  H04L43/08 ,  H04L43/12 ,  H04L69/326

Abstract: In one embodiment, a supervisory service for a network obtains quality of experience metrics for application sessions of an online application. The supervisory service maps the application sessions to paths that traverse a plurality of autonomous systems. The supervisory service identifies, based in part on the quality of experience metrics, a particular autonomous system from the plurality of autonomous systems associated with a decreased quality of experience for the online application. The supervisory service causes application traffic for the online application to avoid the particular autonomous system.

公开(公告)号：US12199847B2

公开(公告)日：2025-01-14

申请号：US17696532

申请日：2022-03-16

Applicant: Cisco Technology, Inc.

Inventor： Vinay Kumar Kolar ,  Jean-Philippe Vasseur ,  Grégory Mermoud ,  Pierre-André Savalle

IPC: G06N5/04 ,  G06F17/18 ,  G06F18/24 ,  G06N20/00 ,  H04L43/00 ,  H04L43/08

Abstract: In one embodiment, a service tracks performance of a machine learning model over time. The machine learning model is used to monitor one or more computer networks based on data collected from the one or more computer networks. The service also tracks performance metrics associated with training of the machine learning model. The service determines that a degradation of the performance of the machine learning model is anomalous, based on the tracked performance of the machine learning model and performance metrics associated with training of the model. The service initiates a corrective measure for the degradation of the performance, in response to determining that the degradation of the performance is anomalous.

公开(公告)号：US12160348B1

公开(公告)日：2024-12-03

申请号：US18198553

申请日：2023-05-17

Applicant: Cisco Technology, Inc.

Inventor： Mukund Yelahanka Raghuprasad ,  Jean-Philippe Vasseur ,  Grégory Mermoud

IPC: G06F15/173 ,  H04L41/16 ,  H04L43/50

Abstract: In one embodiment, a device identifies a plurality of online applications accessible via a network for which a prediction model was trained to predict their application experiences. The device makes a determination as to whether a particular online application is behaviorally similar to any of the plurality of online applications. The device obtains, based on the determination, application experience metrics for the particular online application, when the particular online application is not behaviorally similar to any of the plurality of online applications. The device trains, using the application experience metrics for the particular online application, the prediction model to predict an application experience of the particular online application in addition to those of the plurality of online applications, when the particular online application is not behaviorally similar to any of the plurality of online applications.

公开(公告)号：US20240388507A1

公开(公告)日：2024-11-21

申请号：US18198553

申请日：2023-05-17

Applicant: Cisco Technology, Inc.

Inventor： Mukund Yelahanka Raghuprasad ,  Jean-Philippe Vasseur ,  Grégory Mermoud

IPC: H04L41/16 ,  H04L43/50

Abstract: In one embodiment, a device identifies a plurality of online applications accessible via a network for which a prediction model was trained to predict their application experiences. The device makes a determination as to whether a particular online application is behaviorally similar to any of the plurality of online applications. The device obtains, based on the determination, application experience metrics for the particular online application, when the particular online application is not behaviorally similar to any of the plurality of online applications. The device trains, using the application experience metrics for the particular online application, the prediction model to predict an application experience of the particular online application in addition to those of the plurality of online applications, when the particular online application is not behaviorally similar to any of the plurality of online applications.

公开(公告)号：US11979298B1

公开(公告)日：2024-05-07

申请号：US18209803

申请日：2023-06-14

Applicant: Cisco Technology, Inc.

Inventor： Grégory Mermoud ,  Jean-Philippe Vasseur ,  Romain Kakko-Chiloff ,  Pierre-André Savalle

IPC: G06F16/9035 ,  G06F16/28 ,  H04L41/16 ,  H04L41/5009 ,  H04L51/02

CPC classification number: H04L41/5009 ,  H04L41/16 ,  H04L51/02

Abstract: In one embodiment, a device trains, using feedback from a reference cohort of users of an online application, a prediction model to predict a quality of experience metric for the online application based on network telemetry. The device uses the prediction model to predict quality of experience metrics for different cohorts of users of the online application. The device makes one or more comparisons between performance metrics for the prediction model for the different cohorts of users, based on the quality of experience metrics predicted for the different cohorts of users. The device retrains, based on the one or more comparisons, the prediction model using feedback from the reference cohort and a particular cohort from among the different cohorts of users.

公开(公告)号：US11909618B2

公开(公告)日：2024-02-20

申请号：US17714483

申请日：2022-04-06

Applicant: Cisco Technology, Inc.

Inventor： Vinay Kumar Kolar ,  Jean-Philippe Vasseur ,  Michal Wladyslaw Garcarz

IPC: H04L43/12 ,  H04L47/2475

CPC classification number: H04L43/12 ,  H04L47/2475

Abstract: In one embodiment, a device computes, for each of a set of points of presence (PoPs) via which traffic for an online application can be sent from a location, application experience metrics predicted for the application over time. The device assigns, for each of the set of PoPs, weights to different time periods, based on measures of uncertainty associated with the predicted application experience metrics. The device generates, based on the weights assigned to the different time periods for each of the set of PoPs, schedules for probing network paths connecting the location to the online application via those PoPs. The device causes the network paths to be probed in accordance with their schedules. Results of this probing are used to select a particular PoP from among the set of PoPs via which traffic for the online application should be sent from the location during a certain time period.

公开(公告)号：US20240007392A1

公开(公告)日：2024-01-04

申请号：US17853167

申请日：2022-06-29

Applicant: Cisco Technology, Inc.

Inventor： Jean-Philippe Vasseur ,  Grégory Mermoud ,  Mukund Yelahanka Raghuprasad

IPC: H04L45/00 ,  H04L45/24 ,  H04L45/50 ,  H04L45/42 ,  H04L45/12 ,  H04L45/302

CPC classification number: H04L45/22 ,  H04L45/24 ,  H04L45/50 ,  H04L45/42 ,  H04L45/123 ,  H04L45/302

Abstract: In one embodiment, a device obtains quality of experience measurements for an online application having application traffic conveyed via a first path in a backbone network between an ingress point and an egress point in the backbone network. The device makes a determination that the quality of experience metrics are indicative of degraded user experience with the online application. The device causes a label switched path to be scheduled between the ingress point and the egress point in the backbone network. The device causes at least a portion of the application traffic for the online application to be sent via the label switched path instead of the first path.

公开(公告)号：US20240007387A1

公开(公告)日：2024-01-04

申请号：US17853526

申请日：2022-06-29

Applicant: Cisco Technology, Inc.

Inventor： Grégory Mermoud ,  Jean-Philippe Vasseur

IPC: H04L45/02 ,  H04L43/12

CPC classification number: H04L45/08 ,  H04L43/12

Abstract: In one embodiment, a device obtains probe results generated by probing a plurality of entities in a network from a first node in the network. The device generates a location identifier for the first node that represents its location in the network, based on the probe results. The device selects a configuration associated with the first node for use by a second node in the network, based on a difference between the location identifier for the first node and a location identifier for the second node. The device causes the configuration to be deployed to the second node.