Today, AWS announces the general availability of Neuron SDK 2.26.0, delivering improvements for deep learning workloads on AWS Inferentia and Trainium-based instances. This release introduces support for PyTorch 2.8 and JAX 0.6.2, along with enhanced inference capabilities on Trainium2 (Trn2) instances. These updates enable developers to leverage the latest frameworks while benefiting from improved model deployment flexibility and performance optimizations.
With Neuron SDK 2.26.0, customers can now deploy FLUX.1-dev image generation model, along with Llama 4 Scout and Maverick variants (beta) on Trn2 instances. The release introduces expert parallelism support (beta) for efficient distribution of Mixture-of-Experts (MoE) models across multiple NeuronCores, and adds new capabilities through new Neuron Kernel Interface (NKI) APIs. The updated Neuron Profiler provides improved capabilities, including system profile grouping for distributed workloads.
The new SDK version is available in all AWS Regions supporting Inferentia and Trainium instances, offering enhanced performance and monitoring capabilities for machine learning workloads.
To learn more and for a full list of new features and enhancements, see:
Categories: marketing:marchitecture/compute,marketing:marchitecture/artificial-intelligence
Source: Amazon Web Services
Latest Posts
- Amazon Connect Customer now supports embedding Cases and Customer Profiles in custom agent applications
- Collect Diagnostics change to Get Diagnostics for Outlook Mobile and Mac [MC1308855]
- Action required: Upgrade macOS 13 devices to maintain Teams desktop access [MC1308857]
- Microsoft 365 Copilot (including Copilot Chat): Admin notifications for Copilot mobile app on macOS [MC1308856]
![(Updated) Viva Engage: Agents in Viva Engage communities Public Preview [MC1155311]](https://mwpro.co.uk/wp-content/uploads/2024/08/pexels-mdsnmdsnmdsn-1405773-150x150.webp "(Updated) Viva Engage: Agents in Viva Engage communities Public Preview [MC1155311] 6")
