Amazon SQS introduces fair queues for multi-tenant workloads

Amazon Simple Queue Service (Amazon SQS) now offers fair queues, a new feature that mitigates noisy neighbor impact in multi-tenant standard queues. When one tenant (such as a customer, client application, or request type) sends too many messages or has messages that require longer processing time, fair queues help keep other tenants’ messages flowing without long delays. This preserves quality of service for all tenants while maintaining the scalability and throughput of standard queues.

To enable fair queues, include a message group ID when sending messages to your Amazon SQS standard queues. No changes to message consumers are required, allowing you to adopt fair queues in live systems with no interruption or migration. Fair queues are particularly valuable for SaaS applications serving multiple customers through shared queues, microservices processing events from multiple resources, and applications handling messages for different request types. Fair queues help maintain consistent dwell time (the time a message spends in the queue between being sent and received) across tenants by reordering messages when a single tenant causes the queue to build a backlog. The queue then prioritizes delivering messages from other tenants. Messages from the tenant causing the backlog continue to be delivered to consumers, but their dwell time increases based on your available consumer capacity.

Fair queues are available in all AWS commercial and AWS GovCloud (US) Regions. For more information about Amazon SQS fair queues, read our blog post and visit Amazon SQS Developer Guide.

Categories:

Source: Amazon Web Services

Latest Posts