Position: Federated Foundation Language Model Post-Training Should Focus on Open-Source Models
When deciding on what model and what methods to use for federated post-training, it is crucial to identify different types of foundation language models in terms of theiropenness. In this paper, we classify them into four types according to their accessibility and licensing model: open-source, open-weight, gray-box, and black-box models. We find that...
