Lighthouse Attention is a pretty clever idea, first coarse filtering then fine calculation, splitting long texts into short segments fed into FlashAttention, achieving 17 times faster on a single B200 card with 512K. During the final training stages, switch back to full attention to prevent skipping reads, and the 5.3B model still maintains performance. Long context optimization finally no longer requires stubbornly optimizing underlying kernels.