Open Internet by MindsNet

H64LM: A 249M-parameter Mixture-of-Experts Transformer built from scratch in PyTorch [P]