Enjoy your
FREE PREVIEW which shows only 2022 data and 25 documents. Contact
Patent Forecast for full access.
Smart Cities: Edge Computing
Search All Patents in Smart Cities: Edge Computing
Patent US10270817
Issued 2019-04-23
Forward Request Queuing In A Distributed Edge Processing Environment
A server in a distributed environment includes a process that manages incoming client requests and selectively forwards service requests to other servers in the network. The server includes storage in which at least one forwarding queue is established. The server includes code for aggregating service requests in the forwarding queue and then selectively releasing the requests, or some of them, to another server. The queuing mechanism preferably is managed by metadata, which, for example, controls how many service requests may be placed in the queue, how long a given service request may remain in the queue, what action to take in response to a client request if the forwarding queue's capacity is reached, etc. In one embodiment, the server generates an estimate of a current load on an origin server (to which it is sending forwarding requests) and instantiates the forward request queuing when that current load is reached.
Much More than Average Length Specification
View the Patent Matrix® Diagram to Explore the Claim Relationships
USPTO Full Text Publication >
- 1. Apparatus for use in a distributed network, comprising:
at least one hardware processor, an operating system, and a process executed by the hardware processor that manages incoming client requests and selectively forwards given service requests to at least one other server in the distributed network; storage coupled to the processor and including a set of queues, wherein each queue in the set of queues is unique associated with a particular hostname; and code tangibly embodied on computer media and executed by the hardware processor, the code comprising:
first code operative to make a first determination that a request associated with the particular hostname should be sent to the other server in the distributed network, and conditioned upon the first determination being made, to make a second determination whether the request should be sent to the queue associated with the particular hostname rather than sent forward to the other server, thereby overriding the first determination, wherein the second determination regarding whether the request should be sent to the queue associated with the particular hostname rather than sent forward to the other server is based on presence in the queue of at least one other request associated with the particular hostname and one of: a value of an estimated load on the other server, and a value representing a maximum number of allowed concurrent connections to the other server;
second code operative upon determining that the request should be sent forward to the other server to modify the estimated load value and initiate forwarding of the request;
third code operative upon determining that the request should be sent to the queue to insert the request into the queue based on one of: a priority, and an arrival time.
