Invention Grant
- Patent Title: Mechanism for stream processing efficiency using probabilistic model to reduce data redundancy
-
Application No.: US16779395Application Date: 2020-01-31
-
Publication No.: US11609886B2Publication Date: 2023-03-21
- Inventor: Yogesh Patel , Percy Mehta , Mattia Padovani , Shan-Cheng Ho , Shaahin Mehdinezhad Rushan , Johannes Kienzle
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Nicholson, De Vos, Webster & Elliott, LLP
- Main IPC: G06F16/21
- IPC: G06F16/21 ; G06F16/27 ; G06F16/215 ; G06F9/54 ; G06N7/00

Abstract:
A method and system of data deduplication for data streams in a multi-tenant system. The method receives, at a data accuracy manager, an event from an activity tracking component, determine whether the event is recorded in a probabilistic model that tracks previously received events from the activity tracking component, where the probabilistic model can accurately identify the event has not been previously received with a possible false positive response where the event has been previously received, determines whether information for the event is stored in a metric storage, where the metric storage is a database of metrics derived from the previously received events, and discards the event in response to determining that the event is recorded in the probabilistic model and in the metric storage.
Public/Granted literature
- US20210240679A1 MECHANISM FOR STREAM PROCESSING EFFICIENCY USING PROBABILISTIC MODEL TO REDUCE DATA REDUNDANCY Public/Granted day:2021-08-05
Information query