Upcycle Llama 3B to MoE

Warning

This guide is under construction. Check back soon to see how to give your Llama 3B a new life as an MoE!