Today, AWS announces the general availability of Neuron SDK 2.26.0, delivering improvements for deep learning workloads on AWS Inferentia and Trainium-based instances. This release introduces support for PyTorch 2.8 and JAX 0.6.2, along with enhanced inference capabilities on Trainium2 (Trn2) instances. These updates enable developers to leverage the latest frameworks while benefiting from improved model deployment flexibility and performance optimizations.
With Neuron SDK 2.26.0, customers can now deploy FLUX.1-dev image generation model, along with Llama 4 Scout and Maverick variants (beta) on Trn2 instances. The release introduces expert parallelism support (beta) for efficient distribution of Mixture-of-Experts (MoE) models across multiple NeuronCores, and adds new capabilities through new Neuron Kernel Interface (NKI) APIs. The updated Neuron Profiler provides improved capabilities, including system profile grouping for distributed workloads.
The new SDK version is available in all AWS Regions supporting Inferentia and Trainium instances, offering enhanced performance and monitoring capabilities for machine learning workloads.
To learn more and for a full list of new features and enhancements, see:
Categories: marketing:marchitecture/compute,marketing:marchitecture/artificial-intelligence
Source: Amazon Web Services
Latest Posts
- Power Platform – Improved security for column-level audit events in Microsoft Purview [MC1189685]
- Amazon SageMaker HyperPod now supports Spot Instances
- Microsoft 365 admin center: Organizational Messages now support Action Segments for Microsoft 365 Copilot [MC1189666]
- Microsoft 365 admin center: Organizational Messages to support email delivery [MC1189665]
![(Updated) Viva Engage: Agents in Viva Engage communities Public Preview [MC1155311]](https://mwpro.co.uk/wp-content/uploads/2024/08/pexels-mdsnmdsnmdsn-1405773-150x150.webp "(Updated) Viva Engage: Agents in Viva Engage communities Public Preview [MC1155311] 6")
