SageMaker HyperPod task governance now supports fine-grained compute quota allocation of GPU, Trainium accelerator, vCPU, and vCPU memory within an instance. Administrators can allocate fine-grained compute quota across teams, optimizing compute resource distribution and staying within budget.
Data scientists often execute LLM tasks, like training or inference, that do not require entire HyperPod instances, leading to underutilization of accelerated compute resources. HyperPod task governance enables administrators to manage compute quota allocation across teams. With this capability, administrators can now strategically allocate compute resources, ensuring fair access, preventing resource monopolization, and maximizing cluster utilization. This capability enables fine-grained compute quota allocation in addition to instance-level allocation, aligning with organizational workload demands.
SageMaker HyperPod task governance is available in all AWS Regions where HyperPod is available: US East (N. Virginia), US West (N. California), US West (Oregon), Asia Pacific (Mumbai), Asia Pacific (Singapore), Asia Pacific (Sydney), and Asia Pacific (Tokyo), Europe (Frankfurt), Europe (Ireland), Europe (London), Europe (Stockholm), and South America (São Paulo).
To learn more, visit SageMaker HyperPod webpage, and HyperPod task governance documentation.
Categories:
Source: Amazon Web Services
Latest Posts
- Amazon Bedrock AgentCore Runtime introduces interactive shells for terminal access into agent sessions
- Amazon OpenSearch UI is now available in GovCloud regions
- Microsoft Viva Glint: Custom confidentiality statements [MC1318856]
- (Updated) Microsoft 365 Copilot: Add web links as references in Copilot Notebooks [MC1193414]
![(Updated) Microsoft Copilot: filter chat history for easier context recall [MC1134741]](https://mwpro.co.uk/wp-content/uploads/2024/08/pexels-wildlittlethingsphoto-4402092-150x150.webp "(Updated) Microsoft Copilot: filter chat history for easier context recall [MC1134741] 7")