About the challenge
The AWS Trainium Frontier competition invites ML researchers, systems engineers, and AI-agent builders to co-design models and custom kernels on purpose-built Trainium2 silicon. Teams of one to four receive a complete training pipeline, NKI documentation, and profiling tools, then race to maximize model capability within a fixed 30-minute, single-chip training budget in Phase 1. Top 10 advance to full Trn2 servers in Phase 2, competing for a $40,000 prize pool and the opportunity to present findings alongside Annapurna Labs researchers at NeurIPS 2026 in Sydney. See the Amazon Science: AWS Trainium Frontier post for more information. Once 100 teams are registered, registration will close.
REGISTRATION IS NOW CLOSED
Requirements
Phase 1 requires each team to register here, and train a language model on a single Trainium2 chip within a strict 30-minute wall-clock training budget. Submissions are ranked on the public leaderboard by model quality as measured by the evaluation harness provided in the starter kit. Starting Aug 31, the first 100 teams/individuals (selected by competition idea) will be added to our system so we can get you the necessary GitHub and AWS resources. You'll need both a GitHub account and an AWS account to participate. Once we hit 100, registration closes.
Specifically, teams must submit:
- A trained model checkpoint produced within the 30-minute training window on a single Trainium2 chip.
- A reproducible training script that can be re-run by organizers to verify results. The script must execute end-to-end without manual intervention.
- A brief technical write-up (recommended) describing the approach, including any architectural modifications, custom NKI kernels, optimizer changes, or training recipe innovations.
All submissions must use the provided nanochat-derived training pipeline as a starting point. Teams may modify any component, including model architecture, attention mechanisms, learning rate schedules, optimizer configurations, data mixing strategies, and custom NKI kernels, but training must complete within the fixed compute envelope.
Submissions are scored automatically via the leaderboard. The top 10 teams at the close of Phase 1 (September 30, 2026) advance to Phase 2, where they receive access to full Trn2 servers for scaled training.
Prizes
First Place
Second Place
Third Place
Devpost Achievements
Submitting to this hackathon could earn you:
Judges
Louise Ping
Judging Criteria
-
Phase 1 criteria
The score is computed by the trusted evaluate_bpb() function in prepare.py, which recomputes cross-entropy directly from your model's logits. See https://tinyurl.com/3rth8xmf for details
Questions? Email the hackathon manager
Tell your friends
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
