73How do you curate and filter a supervised fine-tuning (SFT) dataset, and why does a smaller clean set often win?▼hardAnthropicMetaHugging Face1 replies◆ premiumA few thousand carefully chosen examples can beat a million scraped ones. The signal is knowing which filters matter, how you measure example quality, and why diversity beats raw volume.Open full answer →
79Your preference data has low annotator agreement and noisy labels. How do you measure and fix preference-data quality?▼hardScale AIAnthropicOpenAI1 replies◆ premiumA reward model is only as good as its labels, and human preference labels are noisy and inconsistent. The signal is measuring inter-annotator agreement and the concrete moves that lift label quality.Open full answer →
80How do you choose the data mixture for pretraining an LLM, and what does domain reweighting buy you?▼hardGoogle DeepMindMetaMistral1 replies◆ premiumThe ratio of web, code, books, and math in pretraining quietly decides downstream skills. The signal is knowing how mixtures are chosen, why upsampling helps, and how methods like DoReMi automate it.Open full answer →
