12What is perplexity, and what are its limits as a language-model metric?▼mediumOpenAIGoogleCohere2 replies○ sign inPerplexity is the classic LM metric. The signal is knowing it is just exponentiated cross-entropy, what it intuitively measures, and why a low perplexity does not mean a good product.Open full answer →
76Implement a smoothed n-gram language model and compute perplexity on held-out text.▼mediumGoogleAmazonApple1 replies◆ premiumBefore transformers, this was the language model, and it is still the cleanest way to show you understand what perplexity actually measures. Smoothing is the part people get wrong. Here is the implementation.Open full answer →
