There is no posttraining data commons
27 points by lukasschwab
The article argues that while the pretraining of large language models (LLMs) benefited from a shared dataset created for various purposes, there is currently no equivalent posttraining data commons available. Posttraining involves the application of models to specific tasks rather than utilizing documents, highlighting a significant gap for the open models community that needs to be addressed to facilitate further advancements.