Open Internet by MindsNet

Applying Mamba Model to Entropy Model in Fast Byte Latent Transformers

The author is exploring the possibility of replacing the transformer in an entropy model with a Mamba model. They are seeking feedback on potential changes and challenges associated with this approach, particularly in terms of computational efficiency.

Computing & Technology, Computer Science, Machine Learning