We display that BlackMamba performs competitively from both of those Mamba and transformer baselines, and outperforms in inference and teaching FLOPs. We fully practice and open-supply 340M/1.5B and 630M/two.8B https://k2spiceshop.com/product/liquid-k2-on-paper-online/