Fixed-size state
i14 trains and serves Laplace 3B linear attention model on AWS Trainium2
i14, working with AWS's GenAI Innovation Center, rebuilt its Laplace 3B linear attention model for AWS Trainium2 chips using native PyTorch via TorchNeuron Native. The design uses a fixed-size recurrent state, so serving memory stays flat as context length…