Amazon API Gateway now progressively streams response payloads to clients as they become available. This improves REST API responsiveness by eliminating the need to buffer complete responses before transmission. This new capability works with backends that support streaming, including Lambda functions, HTTP proxy integrations, and private integrations.
Response streaming delivers three key benefits: improved time-to-first-byte (TTFB) performance, extended integration timeouts up to 15 minutes, and support for payloads larger than 10 MB. Generative AI applications particularly benefit from improved TTFB as users see responses appear incrementally in real-time, while complex deliberation-focused models that take longer to process can now run with extended timeouts. Additionally, large payload support enables direct streaming of media files and large datasets without requiring workarounds like pre-signed Amazon S3 URLs.
To learn about pricing for this feature, please see the Amazon API Gateway pricing page. Amazon API Gateway response streaming is available in all AWS Regions, including the AWS GovCloud (US) Regions, and works with regional, private, and edge-optimized endpoints. To get started, visit Amazon API Gateway documentation, AWS blog and customer success blog posts.
Categories: general:products/aws-govcloud-us,marketing:marchitecture/networking-and-content-delivery,general:products/amazon-api-gateway
Source: Amazon Web Services
Latest Posts
- Amazon ECR Pull Through Cache Now Supports Referrer Discovery and Sync
- Amazon SageMaker HyperPod now supports flexible instance groups
- (Updated) Microsoft 365 Copilot: Updates to memory and personalization [MC1158329]
- (Updated) Anthropic Claude Sonnet is now available in Microsoft 365 Copilot [MC1247880]
