bittensor

When do you think a subnet gonna pretrain and post train a 200b moe(not dense) or even bigger moe from scratch? I do not believe very small and efficient models can cut it, true general intelligence is needed

1 Upvotes