Buy Crypto
Pay with
USD
USD
Buy & Sell
Hot
Supports Visa, Mastercard, SEPA & more
P2P
0 Fees
Flexible trading, zero fees
Gate Card
Use your crypto for payments worldwide
Markets
Trade
Basic
Advanced
Futures
Futures
Access hundreds of perpetual contracts
CFD
Gold
One platform for global traditional assets
Options
Hot
Trade European-style vanilla options
Unified Account
Maximize your capital efficiency
Demo Trading
Introduction to Futures Trading
Learn the basics of futures trading
Futures Events
Join events to earn rewards
Demo Trading
Use virtual funds to practice risk-free trading
Earn
Launch
CandyDrop
tag
Collect candies to earn airdrops
Launchpool
Quick staking, earn potential new tokens
HODLer Airdrop
Hold GT and get massive airdrops for free
Pre-IPOs
Unlock full access to global stock IPOs
Alpha Points
Trade on-chain assets and earn airdrops
Futures Points
Earn futures points and claim airdrop rewards
Investment
Square
Square
Post, share, and explore crypto trends
Live
moments live
Live crypto market analysis
Chat
Chat with crypto traders
News
What is happening in crypto
flower_head
More
Promotions
AI
Others
TradFi
WCTC S8
Rewards

Nous Research Open-Sources Lighthouse Attention with 17x Speedup on B200 for 512K Context

GateNews
AI Industry News

According to Beating, Nous Research has open-sourced Lighthouse Attention, a long-context training mechanism that achieves 17x speedup for 512K-length text processing on a single B200 GPU, and 1.4–1.7x end-to-end training acceleration at 98K length. The technique uses a coarse-to-fine approach: it first scans compressed summaries at different levels to identify core segments, then passes the filtered text to FlashAttention for processing. In tests on a 5.3-billion-parameter model trained on 50 billion tokens, the approach not only reduced training time but matched or exceeded baseline performance of fully-attention-based training.

View Source
Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to Disclaimer.

Related News

2h ago
OpenAI Fixes Two Bugs Behind GPT-5.5 Codex Degradation, Resets User Usage Limits
6h ago
Elon Musk Claims Grok V9 (1.5T Parameters) Shows Massive Performance Jump Over V8 on May 16
05-15 15:01
Elon Musk's Grok V9 Completes Training with 1.5T Parameters, Shows Major Performance Jump Over V8
05-15 07:00
Nvidia H200 Chip Searches Surge 25-Fold on JD.com Since May 14
05-15 06:45
Claude Opus Breaks nanoGPT Record with 2930 Steps, Consuming 14,000 H200 GPU Hours
In-Depth Analysis

OpenAI adds ChatGPT crisis conversation detection, improving the ability to warn about self-harm and violence

Market Whisper05-15 05:45

Bittensor TAO Climbs Above $300 as AI Crypto Demand Surges

Crypto News Land05-14 18:36

Experts Say Zk Proofs Give DePINs an Edge as AI Trust Demands Rise

Coinpedia05-14 05:38
Comment
0/400
No comments