Invention Grant
- Patent Title: System and method for performing set operations with defined sketch accuracy distribution
-
Application No.: US14448487Application Date: 2014-07-31
-
Publication No.: US09043348B2Publication Date: 2015-05-26
- Inventor: Lee Rhodes , Anirban Dasgupta , Kevin Lang
- Applicant: Yahoo! Inc.
- Applicant Address: US CA Sunnyvale
- Assignee: Yahoo! Inc.
- Current Assignee: Yahoo! Inc.
- Current Assignee Address: US CA Sunnyvale
- Agency: Hickman Palermo Becker Bingham LLP
- Main IPC: G06F17/30
- IPC: G06F17/30

Abstract:
Techniques are provided for improving the speed and accuracy of analytics on big data using theta sketches, by converting fixed-size sketches to theta sketches, and by performing set operations on sketches. In a technique for performing a set operation, two sketches are analyzed to identify the maximum value of each sketch. The maximum values of the two sketches are compared. Based the comparison, one or more values are removed from the sketch whose maximum value is greater. After the removal, a set operation (e.g., union, intersection, or difference) is performed based on the modified sketch and the unmodified sketch. A result of the set operation is a third sketch, which may be used to estimate a cardinality of the larger data sets that are represented by the two input sketches.
Public/Granted literature
- US20150100596A1 SYSTEM AND METHOD FOR PERFORMING SET OPERATIONS WITH DEFINED SKETCH ACCURACY DISTRIBUTION Public/Granted day:2015-04-09
Information query