Today, AWS announces the general availability of Neuron SDK 2.25.0, delivering improvements for inference workloads and performance monitoring on AWS Inferentia and Trainium instances. This latest release adds context and data parallelism support as well as chunked attention for long sequence processing in inference, and updates the neuron-ls and neuron-monitor APIs with more information on node affinities and device utilization, respectively.
This release also introduces automatic aliasing (Beta) for fast tensor operations, and adds improvements for disaggregated serving (Beta). Finally, it provides upgraded AMIs and Deep Learning Containers for inference and training workloads on Neuron.
Neuron 2.25.0 is available in all AWS Regions where Inferentia and Trainium instances are offered.
To learn more and for a full list of new features and enhancements, see:
Categories: marketing:marchitecture/artificial-intelligence,marketing:marchitecture/compute
Source: Amazon Web Services
Latest Posts
- Microsoft Entra ID: General Availability of passkey profiles and migration for existing Passkeys (FIDO2) tenants [MC1221452]
- (Updated) Microsoft Loop – User Accessible Recycle Bin for Loop workspaces [MC929021]
- (Updated) New features coming to Microsoft 365 Copilot Chat for Outlook, Word, Excel, and PowerPoint [MC1187671]
- (Updated) Microsoft 365 Copilot: Updates to PowerPoint on‑canvas features with Agent mode [MC1243550]
