90 likes | 210 Views
This document analyzes the performance of MLR (Maximum Likelihood Ranking) compared to Yahoo Search, establishing MLR as the preferred baseline due to its relevance, especially in CNB contexts. Notably, MLR struggles with Latin queries, indicating a substantial opportunity for improvement. Suggested strategies include using English for Latin charsets (3% gain) and opting for MLR/Bracket for queries over 4 characters (7% gain). Ultimately, addressing these weaknesses could significantly enhance MLR's overall effectiveness against competitors like Yahoo and Baidu.
E N D
MLR * Used Yahoo Simplified-preferred as baseline, since it has higher relevance than all-language and cn-preferred. Also both used CNB.
MLR vs Yahoo The only place where MLR does really bad is on Latin queries. If we fix this the gain could be much bigger.
MLR vs Yahoo by Length This is because MLR currently always uses bracket.
Best MLR • If query is latin charset use English (3% Gain) • If query is >4 characters (or 12 bytes) use MLR/Bracket (7% Gain) • Else use IRF (0% Gain)
Yahoo vs Google Here darker color means longer query.
Yahoo vs. Baidu All of our gain over Baidu is due to Latin queries.