-
公开(公告)号:US09692708B2
公开(公告)日:2017-06-27
申请号:US14454629
申请日:2014-08-07
Applicant: Amazon Technologies, Inc.
Inventor: Dan Mihai Dumitriu , Swaminathan Sivasubramanian
CPC classification number: H04L47/70 , H04L1/0018 , H04L29/08144 , H04L67/1002 , H04L67/101 , H04L67/1019 , H04L67/1029 , H04L67/2814 , H04L67/327 , H04L69/40
Abstract: A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
-
公开(公告)号:US08805991B1
公开(公告)日:2014-08-12
申请号:US13770818
申请日:2013-02-19
Applicant: Amazon Technologies, Inc.
Inventor: Dan Mihai Dumitriu , Swaminathan Sivasubramanian
CPC classification number: H04L47/70 , H04L1/0018 , H04L29/08144 , H04L67/1002 , H04L67/101 , H04L67/1019 , H04L67/1029 , H04L67/2814 , H04L67/327 , H04L69/40
Abstract: Service requests may be routed to services in a service framework provided by a plurality of hosts. A first candidate host may receive a service request. The service latency of the first candidate host may be determined. The service latency for one or more candidate host zones may also be determined. The first candidate host may service the service request or route the service request to one or more candidate host zones. In some embodiments, a probabilistic distribution based at least in part on the service latency of the first candidate host and the service latency for each of the one or more candidate host zones is used to determine whether the first candidate host services the service request or routes the service request to the one or more candidate host zones.
Abstract translation: 服务请求可以被路由到由多个主机提供的服务框架中的服务。 第一候选主机可以接收服务请求。 可以确定第一候选主机的服务等待时间。 还可以确定一个或多个候选主机区域的服务等待时间。 第一候选主机可以服务于服务请求或将服务请求路由到一个或多个候选主机区域。 在一些实施例中,使用至少部分地基于第一候选主机的服务等待时间和一个或多个候选主机区域中的每一个的服务等待时间的概率分布来确定第一候选主机是否服务于服务请求或路由 对一个或多个候选主机区域的服务请求。
-
公开(公告)号:US20180013693A1
公开(公告)日:2018-01-11
申请号:US15630717
申请日:2017-06-22
Applicant: Amazon Technologies, Inc.
Inventor: Dan Mihai Dumitriu , Swaminathan Sivasubramanian
IPC: H04L12/911 , H04L1/00 , H04L29/08 , H04L29/14
CPC classification number: H04L47/70 , H04L1/0018 , H04L29/08144 , H04L67/1002 , H04L67/101 , H04L67/1019 , H04L67/1029 , H04L67/2814 , H04L67/327 , H04L69/40
Abstract: A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
-
公开(公告)号:US09379997B1
公开(公告)日:2016-06-28
申请号:US13942498
申请日:2013-07-15
Applicant: Amazon Technologies, Inc.
Inventor: Peter S. Vosshall , Aaron C. Thompson , Dan Mihai Dumitriu , Ozgun A. Erdogan , Werner H.P. Vogels , George A. Borle , Mathew Mills
IPC: G06F15/173 , G06F15/16 , H04L12/917 , H04L12/28 , H04L12/911
CPC classification number: H04L67/327 , H04L12/2869 , H04L12/287 , H04L47/76 , H04L47/781 , H04L47/826 , H04L67/1002 , H04L67/16 , H04L67/42
Abstract: A computer-implemented system and method for managing service requests are disclosed. The system includes a service provider, having a number of server devices, that provides a service response in response to a client service request. The service response includes a service instance ID associated with a server and a connection lease. A communication processing component routes a first client service request to one of the servers. Subsequent client service requests and responses are transmitted directly between the client device and the server device associated with service instance ID included in the first service response for the duration of the connection lease.
-
公开(公告)号:US20170111478A1
公开(公告)日:2017-04-20
申请号:US15276551
申请日:2016-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Vivek Rai , Dan Mihai Dumitriu , Swaminathan Sivasubramanian
CPC classification number: H04L67/42 , H04L67/02 , H04L67/1002
Abstract: Methods and systems for processing data requests in a client-server computing environment, such as the Web, are disclosed. A client device initially transmits a data request to a randomly selected first server device. The first server device may reject the data request if its request queue threshold is exceeded. The client device retransmits the data request, including the request queue threshold, to a randomly selected second server device. The second server device may reject the data request if the request queue threshold of the first server device is smaller than a request queue threshold of the second server device. The client device transmits the data request back to the first server device, including the request queue threshold of the second server device. The first server device processes the data request and adjusts its request queue threshold based on the request queue thresholds of the first and second server devices.
-
公开(公告)号:US09456056B2
公开(公告)日:2016-09-27
申请号:US14071245
申请日:2013-11-04
Applicant: Amazon Technologies, Inc.
Inventor: Vivek Rai , Dan Mihai Dumitriu , Swaminathan Sivasubramanian
CPC classification number: H04L67/42 , H04L67/02 , H04L67/1002
Abstract: Methods and systems for processing data requests in a client-server computing environment, such as the Web, are disclosed. A client device initially transmits a data request to a randomly selected first server device. The first server device may reject the data request if its request queue threshold is exceeded. The client device retransmits the data request, including the request queue threshold, to a randomly selected second server device. The second server device may reject the data request if the request queue threshold of the first server device is smaller than a request queue threshold of the second server device. The client device transmits the data request back to the first server device, including the request queue threshold of the second server device. The first server device processes the data request and adjusts its request queue threshold based on the request queue thresholds of the first and second server devices.
-
公开(公告)号:US20150032896A1
公开(公告)日:2015-01-29
申请号:US14454629
申请日:2014-08-07
Applicant: Amazon Technologies, Inc.
Inventor: Dan Mihai Dumitriu , Swaminathan Sivasubramanian
IPC: H04L12/911 , H04L1/00 , H04L29/08
CPC classification number: H04L47/70 , H04L1/0018 , H04L29/08144 , H04L67/1002 , H04L67/101 , H04L67/1019 , H04L67/1029 , H04L67/2814 , H04L67/327 , H04L69/40
Abstract: A computer-implemented method routes service requests to services in a service framework provided by a plurality of hosts. The method comprises receiving a service request for a service in the service framework and discovering a plurality of candidate hosts that host the service. The plurality of candidate hosts are a subset of the plurality of hosts. The method further comprises selecting a candidate host from the plurality of candidate hosts based on measured latencies for the plurality of candidate hosts and routing the service request to the selected candidate host.
-
公开(公告)号:US20140222895A1
公开(公告)日:2014-08-07
申请号:US14071245
申请日:2013-11-04
Applicant: Amazon Technologies, Inc.
Inventor: Vivek Rai , Dan Mihai Dumitriu , Swaminathan Sivasubramanian
IPC: H04L29/06
CPC classification number: H04L67/42 , H04L67/02 , H04L67/1002
Abstract: Methods and systems for processing data requests in a client-server computing environment, such as the Web, are disclosed. A client device initially transmits a data request to a randomly selected first server device. The first server device may reject the data request if its request queue threshold is exceeded. The client device retransmits the data request, including the request queue threshold, to a randomly selected second server device. The second server device may reject the data request if the request queue threshold of the first server device is smaller than a request queue threshold of the second server device. The client device transmits the data request back to the first server device, including the request queue threshold of the second server device. The first server device processes the data request and adjusts its request queue threshold based on the request queue thresholds of the first and second server devices.
Abstract translation: 公开了在诸如Web的客户端 - 服务器计算环境中处理数据请求的方法和系统。 客户机设备最初向随机选择的第一服务器设备发送数据请求。 如果超过了其请求队列阈值,则第一个服务器设备可以拒绝数据请求。 客户端设备向随机选择的第二服务器设备重传包括请求队列阈值的数据请求。 如果第一服务器设备的请求队列阈值小于第二服务器设备的请求队列阈值,则第二服务器设备可拒绝该数据请求。 客户端设备将数据请求发送回第一服务器设备,包括第二服务器设备的请求队列阈值。 第一服务器设备处理数据请求并根据第一和第二服务器设备的请求队列阈值调整其请求队列阈值。
-
公开(公告)号:US11418620B2
公开(公告)日:2022-08-16
申请号:US16840162
申请日:2020-04-03
Applicant: Amazon Technologies, Inc.
Inventor: Peter S. Vosshall , Aaron C. Thompson , Dan Mihai Dumitriu , Ozgun A. Erdogan , Werner H. P. Vogels , George A. Borle , Mathew Mills
IPC: H04L67/51 , H04L67/1001 , H04L47/76 , H04L67/01 , H04L67/63 , H04L12/28 , H04L47/78 , H04L47/70
Abstract: A computer-implemented system and method for managing service requests are disclosed. The system includes a service provider, having a number of server devices, that provides a service response in response to a client service request. The service response includes a service instance ID associated with a server and a connection lease. A communication processing component routes a first client service request to one of the servers. Subsequent client service requests and responses are transmitted directly between the client device and the server device associated with service instance ID included in the first service response for the duration of the connection lease.
-
公开(公告)号:US20200296185A1
公开(公告)日:2020-09-17
申请号:US16840162
申请日:2020-04-03
Applicant: Amazon Technologies, Inc.
Inventor: Peter S. Vosshall , Aaron C. Thompson , Dan Mihai Dumitriu , Ozgun A. Erdogan , Werner H. P. Vogels , George A. Borle , Mathew Mills
IPC: H04L29/08 , H04L12/28 , H04L12/917 , H04L12/911 , H04L29/06
Abstract: A computer-implemented system and method for managing service requests are disclosed. The system includes a service provider, having a number of server devices, that provides a service response in response to a client service request. The service response includes a service instance ID associated with a server and a connection lease. A communication processing component routes a first client service request to one of the servers. Subsequent client service requests and responses are transmitted directly between the client device and the server device associated with service instance ID included in the first service response for the duration of the connection lease.
-
-
-
-
-
-
-
-
-