{"id":13875,"date":"2025-10-06T15:12:13","date_gmt":"2025-10-06T15:12:13","guid":{"rendered":"https:\/\/www.nizamuddeen.com\/community\/?p=13875"},"modified":"2026-01-19T05:41:38","modified_gmt":"2026-01-19T05:41:38","slug":"what-are-evaluation-metrics-for-ir","status":"publish","type":"post","link":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/","title":{"rendered":"What are Evaluation Metrics for IR?"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"13875\" class=\"elementor elementor-13875\" data-elementor-post-type=\"post\">\n\t\t\t\t<div class=\"elementor-element elementor-element-1232d42f e-flex e-con-boxed e-con e-parent\" data-id=\"1232d42f\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-60354473 elementor-widget elementor-widget-text-editor\" data-id=\"60354473\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<blockquote><p data-start=\"214\" data-end=\"428\">Evaluation metrics for Information Retrieval (IR) are <strong>quantitative measures used to assess how effectively a search or retrieval system ranks documents in response to a query<\/strong>. The most common metrics include:<\/p><ul><li data-start=\"432\" data-end=\"502\"><strong data-start=\"432\" data-end=\"445\">Precision<\/strong> \u2013 proportion of retrieved documents that are relevant.<\/li><li data-start=\"505\" data-end=\"572\"><strong data-start=\"505\" data-end=\"515\">Recall<\/strong> \u2013 proportion of relevant documents that are retrieved.<\/li><li data-start=\"575\" data-end=\"676\"><strong data-start=\"575\" data-end=\"607\">MAP (Mean Average Precision)<\/strong> \u2013 average ranking quality across all relevant documents per query.<\/li><li data-start=\"679\" data-end=\"833\"><strong data-start=\"679\" data-end=\"727\">nDCG (Normalized Discounted Cumulative Gain)<\/strong> \u2013 evaluates ranking order with graded relevance, rewarding highly relevant results at higher positions.<\/li><li data-start=\"836\" data-end=\"945\"><strong data-start=\"836\" data-end=\"866\">MRR (Mean Reciprocal Rank)<\/strong> \u2013 measures how quickly the first relevant result appears in the ranked list.<\/li><\/ul><p data-start=\"947\" data-end=\"1147\">Together, these metrics balance <strong data-start=\"979\" data-end=\"1024\">relevance, ranking position, and coverage<\/strong>, making them essential for evaluating modern <strong data-start=\"1070\" data-end=\"1146\">search engines, recommendation systems, and semantic retrieval pipelines<\/strong>.<\/p><\/blockquote><h2 data-start=\"503\" data-end=\"527\"><span class=\"ez-toc-section\" id=\"Why_IR_Metrics_Matter\"><\/span>Why IR Metrics Matter?<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"529\" data-end=\"774\">Every search engine ranks results, but the real question is: <em data-start=\"590\" data-end=\"624\">did it satisfy the user\u2019s query?<\/em> Offline metrics give us quantitative answers by comparing ranked lists against labeled relevance judgments. The choice of metric depends on the task:<\/p><ul data-start=\"776\" data-end=\"988\"><li data-start=\"776\" data-end=\"850\"><p data-start=\"778\" data-end=\"850\">Do we care about <strong data-start=\"795\" data-end=\"821\">all relevant documents<\/strong> or just the <strong data-start=\"834\" data-end=\"847\">first one<\/strong>?<\/p><\/li><li data-start=\"851\" data-end=\"908\"><p data-start=\"853\" data-end=\"908\">Do we care about <strong data-start=\"870\" data-end=\"890\">graded relevance<\/strong> or just binary?<\/p><\/li><li data-start=\"909\" data-end=\"988\"><p data-start=\"911\" data-end=\"988\">Are we optimizing for <strong data-start=\"933\" data-end=\"960\">purity of top-k results<\/strong> or <strong data-start=\"964\" data-end=\"985\">coverage at scale<\/strong>?<\/p><\/li><\/ul><p data-start=\"990\" data-end=\"1327\">These distinctions matter both in academic IR and in <strong data-start=\"1043\" data-end=\"1059\">semantic SEO<\/strong>, where metrics guide whether we\u2019re meeting <strong data-start=\"1103\" data-end=\"1204\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-semantic-relevance\/\" target=\"_new\" rel=\"noopener\" data-start=\"1105\" data-end=\"1202\">semantic relevance<\/a><\/strong> and capturing <strong data-start=\"1219\" data-end=\"1326\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-central-search-intent\/\" target=\"_new\" rel=\"noopener\" data-start=\"1221\" data-end=\"1324\">central search intent<\/a><\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-87f92e8 e-flex e-con-boxed e-con e-parent\" data-id=\"87f92e8\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-d6e7113 elementor-widget elementor-widget-text-editor\" data-id=\"d6e7113\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p><div class=\"_df_book df-lite\" id=\"df_17016\"  _slug=\"dense-vs-sparse-retrieval-models\" data-title=\"contextual-coverage_-the-foundation-of-seo-authority\" wpoptions=\"true\" thumb=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2026\/01\/Contextual-Coverage_-The-Foundation-of-SEO-Authority.jpg\" thumbtype=\"\" ><\/div><script class=\"df-shortcode-script\" nowprocket type=\"application\/javascript\">window.option_df_17016 = {\"outline\":[],\"autoEnableOutline\":\"false\",\"autoEnableThumbnail\":\"false\",\"overwritePDFOutline\":\"false\",\"direction\":\"1\",\"pageSize\":\"0\",\"source\":\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2026\/01\/Contextual-Coverage_-The-Foundation-of-SEO-Authority-1.pdf\",\"wpOptions\":\"true\"}; if(window.DFLIP && window.DFLIP.parseBooks){window.DFLIP.parseBooks();}<\/script><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-6bd9b71 e-flex e-con-boxed e-con e-parent\" data-id=\"6bd9b71\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-e7fbe4d elementor-align-center elementor-mobile-align-center elementor-widget elementor-widget-button\" data-id=\"e7fbe4d\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2026\/01\/Evaluation-Metrics-for-Information-Retrieval-2.pdf\" target=\"_blank\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Download PDF!<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-4f932a3 e-flex e-con-boxed e-con e-parent\" data-id=\"4f932a3\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-5220cd9 elementor-widget elementor-widget-text-editor\" data-id=\"5220cd9\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<h2 data-start=\"1334\" data-end=\"1374\"><span class=\"ez-toc-section\" id=\"Precision_and_Recall_The_Foundations\"><\/span>Precision and Recall: The Foundations<span class=\"ez-toc-section-end\"><\/span><\/h2><h3 data-start=\"1376\" data-end=\"1389\"><span class=\"ez-toc-section\" id=\"Precision\"><\/span>Precision<span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"1390\" data-end=\"1633\"><strong data-start=\"1390\" data-end=\"1404\">Definition<\/strong>: The fraction of retrieved documents that are relevant.<br data-start=\"1460\" data-end=\"1463\" \/><strong data-start=\"1463\" data-end=\"1474\">Formula<\/strong>: <span class=\"katex\"><span class=\"katex-mathml\">Precision=\u2223Relevant\u00a0\u2229\u00a0Retrieved\u2223\u2223Retrieved\u2223text{Precision} = frac{|text{Relevant \u2229 Retrieved}|}{|text{Retrieved}|}<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mord text\"><span class=\"mord\">Precision<\/span><\/span><span class=\"mrel\">=<\/span><\/span><span class=\"base\"><span class=\"mord\"><span class=\"mfrac\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">\u2223<span class=\"mord text mtight\">Retrieved<\/span>\u2223<\/span><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">\u2223<span class=\"mord text mtight\">Relevant\u00a0\u2229\u00a0Retrieved<\/span>\u2223<\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><br data-start=\"1557\" data-end=\"1560\" \/><strong data-start=\"1560\" data-end=\"1575\">Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a><\/strong>: Focuses only on the top-<em data-start=\"1601\" data-end=\"1604\">k<\/em> results (e.g., top-10 SERP).<\/p><ul data-start=\"1635\" data-end=\"1746\"><li data-start=\"1635\" data-end=\"1670\"><p data-start=\"1637\" data-end=\"1670\">High precision = clean results.<\/p><\/li><li data-start=\"1671\" data-end=\"1746\"><p data-start=\"1673\" data-end=\"1746\">In SEO, this means fewer irrelevant pages ranking for a <strong data-start=\"1729\" data-end=\"1745\">query intent<\/strong>.<\/p><\/li><\/ul><h3 data-start=\"1748\" data-end=\"1758\"><span class=\"ez-toc-section\" id=\"Recall\"><\/span>Recall<span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"1759\" data-end=\"1996\"><strong data-start=\"1759\" data-end=\"1773\">Definition<\/strong>: The fraction of relevant documents that were retrieved.<br data-start=\"1830\" data-end=\"1833\" \/><strong data-start=\"1833\" data-end=\"1844\">Formula<\/strong>: <span class=\"katex\"><span class=\"katex-mathml\">Recall=\u2223Relevant\u00a0\u2229\u00a0Retrieved\u2223\u2223Relevant\u2223text{Recall} = frac{|text{Relevant \u2229 Retrieved}|}{|text{Relevant}|}<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mord text\"><span class=\"mord\">Recall<\/span><\/span><span class=\"mrel\">=<\/span><\/span><span class=\"base\"><span class=\"mord\"><span class=\"mfrac\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">\u2223<span class=\"mord text mtight\">Relevant<\/span>\u2223<\/span><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\">\u2223<span class=\"mord text mtight\">Relevant\u00a0\u2229\u00a0Retrieved<\/span>\u2223<\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><br data-start=\"1923\" data-end=\"1926\" \/><strong data-start=\"1926\" data-end=\"1938\">Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a><\/strong>: Measures how many relevant docs appear in the top-<em data-start=\"1990\" data-end=\"1993\">k<\/em>.<\/p><ul data-start=\"1998\" data-end=\"2225\"><li data-start=\"1998\" data-end=\"2041\"><p data-start=\"2000\" data-end=\"2041\">High recall = broad coverage of intent.<\/p><\/li><li data-start=\"2042\" data-end=\"2225\"><p data-start=\"2044\" data-end=\"2225\">Crucial for <strong data-start=\"2056\" data-end=\"2077\">long-tail queries<\/strong>, where capturing rare entity matches is key to <strong data-start=\"2125\" data-end=\"2224\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-topical-authority\/\" target=\"_new\" rel=\"noopener\" data-start=\"2127\" data-end=\"2222\">topical authority<\/a><\/strong>.<\/p><\/li><\/ul><h2 data-start=\"2232\" data-end=\"2263\"><span class=\"ez-toc-section\" id=\"Mean_Average_Precision_MAP\"><\/span>Mean Average Precision (MAP)<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"2265\" data-end=\"2364\">MAP combines <strong data-start=\"2278\" data-end=\"2291\">precision<\/strong> with <strong data-start=\"2297\" data-end=\"2311\">rank order<\/strong>, rewarding systems that place relevant docs earlier.<\/p><ul data-start=\"2366\" data-end=\"2516\"><li data-start=\"2366\" data-end=\"2472\"><p data-start=\"2368\" data-end=\"2472\"><strong data-start=\"2368\" data-end=\"2394\">Average Precision (AP)<\/strong> per query: average of precision values at ranks where relevant items occur.<\/p><\/li><li data-start=\"2473\" data-end=\"2516\"><p data-start=\"2475\" data-end=\"2516\"><strong data-start=\"2475\" data-end=\"2482\">MAP<\/strong>: mean of AP across all queries.<\/p><\/li><\/ul><p data-start=\"2518\" data-end=\"2538\"><strong data-start=\"2518\" data-end=\"2537\">When to use MAP<\/strong>:<\/p><ul data-start=\"2539\" data-end=\"2674\"><li data-start=\"2539\" data-end=\"2594\"><p data-start=\"2541\" data-end=\"2594\">Best when queries have <strong data-start=\"2564\" data-end=\"2591\">many relevant documents<\/strong>.<\/p><\/li><li data-start=\"2595\" data-end=\"2674\"><p data-start=\"2597\" data-end=\"2674\">Strong in <strong data-start=\"2607\" data-end=\"2624\">ad-hoc search<\/strong> tasks (e.g., enterprise or academic retrieval).<\/p><\/li><\/ul><p data-start=\"2676\" data-end=\"2850\">MAP aligns well with <strong data-start=\"2697\" data-end=\"2798\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-query-optimization\/\" target=\"_new\" rel=\"noopener\" data-start=\"2699\" data-end=\"2796\">query optimization<\/a><\/strong> because it balances both <em data-start=\"2824\" data-end=\"2834\">coverage<\/em> and <em data-start=\"2839\" data-end=\"2849\">ordering<\/em>.<\/p><h2 data-start=\"2857\" data-end=\"2904\"><span class=\"ez-toc-section\" id=\"Normalized_Discounted_Cumulative_Gain_nDCG\"><\/span>Normalized Discounted Cumulative Gain (nDCG)<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"2906\" data-end=\"2986\">nDCG evaluates <strong data-start=\"2921\" data-end=\"2941\">graded relevance<\/strong>\u2014not all relevant documents are equally good.<\/p><ul data-start=\"2988\" data-end=\"3153\"><li data-start=\"2988\" data-end=\"3083\"><p data-start=\"2990\" data-end=\"3083\"><strong data-start=\"2990\" data-end=\"2999\">DCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a><\/strong> = <span class=\"katex\"><span class=\"katex-mathml\">\u2211i=1kgainilog\u20612(i+1)sum_{i=1}^{k} frac{gain_i}{log_2(i+1)}<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mop\"><span class=\"mop op-symbol small-op\">\u2211<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">i<\/span><span class=\"mrel mtight\">=<\/span>1<\/span><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">k<\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><span class=\"mord\"><span class=\"mfrac\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mop mtight\"><span class=\"mtight\">l<\/span><span class=\"mtight\">o<\/span><span class=\"mtight\">g<\/span><span class=\"msupsub\"><span class=\"sizing reset-size3 size1 mtight\">2<\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><span class=\"mopen mtight\">(<\/span><span class=\"mord mathnormal mtight\">i<\/span><span class=\"mbin mtight\">+<\/span>1<span class=\"mclose mtight\">)<\/span><\/span><\/span><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">g<\/span><span class=\"mord mathnormal mtight\">ai<\/span><span class=\"mord mathnormal mtight\">n<\/span><span class=\"msupsub\"><span class=\"sizing reset-size3 size1 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span> where <span class=\"katex\"><span class=\"katex-mathml\">gaini=2reli\u22121gain_i = 2^{rel_i} &#8211; 1<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mord mathnormal\">g<\/span><span class=\"mord mathnormal\">ai<\/span><span class=\"mord\"><span class=\"mord mathnormal\">n<\/span><span class=\"msupsub\"><span class=\"vlist-t vlist-t2\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><span class=\"mrel\">=<\/span><\/span><span class=\"base\"><span class=\"mord\">2<span class=\"msupsub\"><span class=\"vlist-t\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">re<\/span><span class=\"mord mathnormal mtight\">l<\/span><span class=\"vlist-t vlist-t2\"><span class=\"sizing reset-size3 size1 mtight\"><span class=\"mord mathnormal mtight\">i<\/span><\/span><span class=\"vlist-s\">\u200b<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mbin\">\u2212<\/span><\/span><span class=\"base\"><span class=\"mord\">1<\/span><\/span><\/span><\/span>.<\/p><\/li><li data-start=\"3084\" data-end=\"3153\"><p data-start=\"3086\" data-end=\"3153\"><strong data-start=\"3086\" data-end=\"3096\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a><\/strong> = DCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a> \/ IDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a> (best possible score for that query).<\/p><\/li><\/ul><p data-start=\"3155\" data-end=\"3176\"><strong data-start=\"3155\" data-end=\"3175\">Why nDCG matters<\/strong>:<\/p><ul data-start=\"3177\" data-end=\"3372\"><li data-start=\"3177\" data-end=\"3234\"><p data-start=\"3179\" data-end=\"3234\">Sensitive to <strong data-start=\"3192\" data-end=\"3204\">position<\/strong> (higher ranks matter more).<\/p><\/li><li data-start=\"3235\" data-end=\"3310\"><p data-start=\"3237\" data-end=\"3310\">Supports graded labels (e.g., \u201chighly relevant\u201d, \u201cpartially relevant\u201d).<\/p><\/li><li data-start=\"3311\" data-end=\"3372\"><p data-start=\"3313\" data-end=\"3372\">Default metric in most modern IR benchmarks (e.g., BEIR).<\/p><\/li><\/ul><p data-start=\"3374\" data-end=\"3583\">For SEO, nDCG helps judge whether your <strong data-start=\"3413\" data-end=\"3526\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-semantic-content-network\/\" target=\"_new\" rel=\"noopener\" data-start=\"3415\" data-end=\"3524\">semantic content network<\/a><\/strong> surfaces the <em data-start=\"3540\" data-end=\"3555\">most relevant<\/em> entities early in the SERP.<\/p><h2 data-start=\"3590\" data-end=\"3619\"><span class=\"ez-toc-section\" id=\"Mean_Reciprocal_Rank_MRR\"><\/span>Mean Reciprocal Rank (MRR)<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"3621\" data-end=\"3696\">MRR measures how quickly the system delivers the <strong data-start=\"3670\" data-end=\"3695\">first relevant result<\/strong>.<\/p><ul data-start=\"3698\" data-end=\"3813\"><li data-start=\"3698\" data-end=\"3768\"><p data-start=\"3700\" data-end=\"3768\"><strong data-start=\"3700\" data-end=\"3724\">Reciprocal Rank (RR)<\/strong> per query = 1 \/ (rank of first relevant).<\/p><\/li><li data-start=\"3769\" data-end=\"3813\"><p data-start=\"3771\" data-end=\"3813\"><strong data-start=\"3771\" data-end=\"3778\">MRR<\/strong> = mean of RR across all queries.<\/p><\/li><\/ul><p data-start=\"3815\" data-end=\"3835\"><strong data-start=\"3815\" data-end=\"3834\">When to use MRR<\/strong>:<\/p><ul data-start=\"3836\" data-end=\"3982\"><li data-start=\"3836\" data-end=\"3907\"><p data-start=\"3838\" data-end=\"3907\">Ideal for <strong data-start=\"3848\" data-end=\"3904\">QA systems, navigational queries, and entity lookups<\/strong>.<\/p><\/li><li data-start=\"3908\" data-end=\"3982\"><p data-start=\"3910\" data-end=\"3982\">Ignores additional relevant results, focusing only on \u201cfirst success.\u201d<\/p><\/li><\/ul><p data-start=\"3984\" data-end=\"4164\">This is tightly aligned with <strong data-start=\"4013\" data-end=\"4108\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-query-semantics\/\" target=\"_new\" rel=\"noopener\" data-start=\"4015\" data-end=\"4106\">query semantics<\/a><\/strong> in scenarios where users seek a single, precise answer.<\/p><h2 data-start=\"4171\" data-end=\"4204\"><span class=\"ez-toc-section\" id=\"Cutoff_Choices_Why_usman_Matters\"><\/span>Cutoff Choices: Why <a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a> Matters<span class=\"ez-toc-section-end\"><\/span><\/h2><ul data-start=\"4206\" data-end=\"4372\"><li data-start=\"4206\" data-end=\"4281\"><p data-start=\"4208\" data-end=\"4281\"><strong data-start=\"4208\" data-end=\"4215\"><a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a><\/strong>: Mirrors user behavior (most SERP clicks happen in the top-10).<\/p><\/li><li data-start=\"4282\" data-end=\"4372\"><p data-start=\"4284\" data-end=\"4372\"><strong data-start=\"4284\" data-end=\"4300\"><a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0 \/ <a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>00<\/strong>: Useful for checking <strong data-start=\"4322\" data-end=\"4334\">coverage<\/strong> (important for re-ranking and RAG).<\/p><\/li><\/ul><p data-start=\"4374\" data-end=\"4583\">For semantic SEO, evaluate both <strong data-start=\"4406\" data-end=\"4417\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a><\/strong> (top-SERP quality) and <strong data-start=\"4441\" data-end=\"4455\">Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0<\/strong> (breadth of coverage across your <strong data-start=\"4489\" data-end=\"4581\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-an-entity-graph\/\" target=\"_new\" rel=\"noopener\" data-start=\"4491\" data-end=\"4579\">entity graph<\/a><\/strong>).<\/p><h2 data-start=\"4590\" data-end=\"4623\"><span class=\"ez-toc-section\" id=\"Mini_Example_Binary_Relevance\"><\/span>Mini Example: Binary Relevance<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"4625\" data-end=\"4707\">Suppose the top-5 results are labeled <strong data-start=\"4663\" data-end=\"4682\">[1, 0, 1, 0, 1]<\/strong> (1 = relevant, 0 = not).<\/p><ul data-start=\"4709\" data-end=\"5056\"><li data-start=\"4709\" data-end=\"4740\"><p data-start=\"4711\" data-end=\"4740\"><strong data-start=\"4711\" data-end=\"4726\">Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/saqi256\/\">Saqlain Khan<\/a><\/strong> = 3\/5 = 0.6<\/p><\/li><li data-start=\"4741\" data-end=\"4803\"><p data-start=\"4743\" data-end=\"4803\"><strong data-start=\"4743\" data-end=\"4755\">Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/saqi256\/\">Saqlain Khan<\/a><\/strong> (if 4 total relevant docs exist) = 3\/4 = 0.75<\/p><\/li><li data-start=\"4804\" data-end=\"4883\"><p data-start=\"4806\" data-end=\"4883\"><strong data-start=\"4806\" data-end=\"4812\">AP<\/strong> = (1\/1 + 2\/3 + 3\/5) \/ 3 \u2248 0.756 \u2192 MAP is the average across queries.<\/p><\/li><li data-start=\"4884\" data-end=\"4935\"><p data-start=\"4886\" data-end=\"4935\"><strong data-start=\"4886\" data-end=\"4893\">MRR<\/strong> = 1\/1 = 1.0 (first relevant at rank 1).<\/p><\/li><li data-start=\"4936\" data-end=\"5056\"><p data-start=\"4938\" data-end=\"5056\"><strong data-start=\"4938\" data-end=\"4948\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/saqi256\/\">Saqlain Khan<\/a><\/strong> requires graded labels, but with binary relevance, gains = 1 at positions 1, 3, 5 (discounted by log rank).<\/p><\/li><\/ul><h2 data-start=\"436\" data-end=\"476\"><span class=\"ez-toc-section\" id=\"Common_Pitfalls_When_Using_IR_Metrics\"><\/span>Common Pitfalls When Using IR Metrics<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"478\" data-end=\"573\">Even strong metrics can mislead if applied carelessly. Here are the traps most teams fall into:<\/p><h3 data-start=\"575\" data-end=\"609\"><span class=\"ez-toc-section\" id=\"1_Binary_vs_graded_relevance\"><\/span>1. Binary vs. graded relevance<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"610\" data-end=\"1028\"><li data-start=\"610\" data-end=\"687\"><p data-start=\"612\" data-end=\"687\"><strong data-start=\"612\" data-end=\"619\">MAP<\/strong> and <strong data-start=\"624\" data-end=\"631\">MRR<\/strong> assume <strong data-start=\"639\" data-end=\"656\">binary labels<\/strong> (relevant vs. not relevant).<\/p><\/li><li data-start=\"688\" data-end=\"756\"><p data-start=\"690\" data-end=\"756\"><strong data-start=\"690\" data-end=\"698\">nDCG<\/strong> is designed for <strong data-start=\"715\" data-end=\"735\">graded relevance<\/strong> (e.g., 0\u20133 scale).<\/p><\/li><li data-start=\"757\" data-end=\"847\"><p data-start=\"759\" data-end=\"847\">Misaligned labels \u2192 misleading scores. Always match your judgments to the metric type.<\/p><\/li><li data-start=\"848\" data-end=\"1028\"><p data-start=\"850\" data-end=\"1028\">For SEO teams, this aligns with <strong data-start=\"882\" data-end=\"983\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-semantic-relevance\/\" target=\"_new\" rel=\"noopener\" data-start=\"884\" data-end=\"981\">semantic relevance<\/a><\/strong> scoring: not all matches are equally useful.<\/p><\/li><\/ul><h3 data-start=\"1030\" data-end=\"1063\"><span class=\"ez-toc-section\" id=\"2_Pooling_and_incompleteness\"><\/span>2. Pooling and incompleteness<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"1064\" data-end=\"1543\"><li data-start=\"1064\" data-end=\"1166\"><p data-start=\"1066\" data-end=\"1166\">Benchmarks like TREC and BEIR use <strong data-start=\"1100\" data-end=\"1111\">pooling<\/strong> (collect top results from many systems, then label).<\/p><\/li><li data-start=\"1167\" data-end=\"1261\"><p data-start=\"1169\" data-end=\"1261\">Unjudged documents are treated as non-relevant, which can unfairly depress Recall and MAP.<\/p><\/li><li data-start=\"1262\" data-end=\"1323\"><p data-start=\"1264\" data-end=\"1323\">Always compare <strong data-start=\"1279\" data-end=\"1300\">on the same pools<\/strong> to avoid false gaps.<\/p><\/li><li data-start=\"1324\" data-end=\"1543\"><p data-start=\"1326\" data-end=\"1543\">In semantic SEO evaluations, pooling from your <strong data-start=\"1373\" data-end=\"1486\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-semantic-content-network\/\" target=\"_new\" rel=\"noopener\" data-start=\"1375\" data-end=\"1484\">semantic content network<\/a><\/strong> ensures you aren\u2019t penalizing new or uncovered entities.<\/p><\/li><\/ul><h3 data-start=\"1545\" data-end=\"1573\"><span class=\"ez-toc-section\" id=\"3_DCG_variant_confusion\"><\/span>3. DCG variant confusion<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"1574\" data-end=\"1910\"><li data-start=\"1574\" data-end=\"1677\"><p data-start=\"1576\" data-end=\"1677\">Multiple definitions exist: gain = <span class=\"katex\"><span class=\"katex-mathml\">relrel<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mord mathnormal\">re<\/span><span class=\"mord mathnormal\">l<\/span><\/span><\/span><\/span> vs. <span class=\"katex\"><span class=\"katex-mathml\">2rel\u221212^{rel}-1<\/span><span class=\"katex-html\" aria-hidden=\"true\"><span class=\"base\"><span class=\"mord\">2<span class=\"msupsub\"><span class=\"vlist-t\"><span class=\"vlist-r\"><span class=\"vlist\"><span class=\"sizing reset-size6 size3 mtight\"><span class=\"mord mtight\"><span class=\"mord mathnormal mtight\">re<\/span><span class=\"mord mathnormal mtight\">l<\/span><\/span><\/span><\/span><\/span><\/span><\/span><\/span><span class=\"mbin\">\u2212<\/span><\/span><span class=\"base\"><span class=\"mord\">1<\/span><\/span><\/span><\/span>; discount base = log2 vs. natural log.<\/p><\/li><li data-start=\"1678\" data-end=\"1738\"><p data-start=\"1680\" data-end=\"1738\">Changing either can shift absolute scores significantly.<\/p><\/li><li data-start=\"1739\" data-end=\"1910\"><p data-start=\"1741\" data-end=\"1910\">Always document <strong data-start=\"1757\" data-end=\"1774\">which variant<\/strong> you use, especially in <strong data-start=\"1798\" data-end=\"1899\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-query-optimization\/\" target=\"_new\" rel=\"noopener\" data-start=\"1800\" data-end=\"1897\">query optimization<\/a><\/strong> pipelines.<\/p><\/li><\/ul><h3 data-start=\"1912\" data-end=\"1940\"><span class=\"ez-toc-section\" id=\"4_Ignoring_tail_queries\"><\/span>4. Ignoring tail queries<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"1941\" data-end=\"2217\"><li data-start=\"1941\" data-end=\"2024\"><p data-start=\"1943\" data-end=\"2024\">Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> looks good for head queries, but <strong data-start=\"1989\" data-end=\"2010\">long-tail queries<\/strong> may suffer.<\/p><\/li><li data-start=\"2025\" data-end=\"2129\"><p data-start=\"2027\" data-end=\"2129\">Combine metrics (nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> + Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>00) to test both <strong data-start=\"2080\" data-end=\"2105\">central search intent<\/strong> and <strong data-start=\"2110\" data-end=\"2126\">rare queries<\/strong>.<\/p><\/li><li data-start=\"2130\" data-end=\"2217\"><p data-start=\"2132\" data-end=\"2217\">This is critical for sites pursuing <strong data-start=\"2168\" data-end=\"2189\">topical authority<\/strong> across entity-rich domains.<\/p><\/li><\/ul><h2 data-start=\"2224\" data-end=\"2254\"><span class=\"ez-toc-section\" id=\"Benchmark_Practices_in_2025\"><\/span>Benchmark Practices in 2025<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"2256\" data-end=\"2351\">Modern IR benchmarks (TREC, MS MARCO, BEIR, MIRACL) have converged on a few standard practices:<\/p><ul data-start=\"2353\" data-end=\"2723\"><li data-start=\"2353\" data-end=\"2440\"><p data-start=\"2355\" data-end=\"2440\"><strong data-start=\"2355\" data-end=\"2366\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a><\/strong>: the default for top-rank evaluation, especially with graded judgments.<\/p><\/li><li data-start=\"2441\" data-end=\"2542\"><p data-start=\"2443\" data-end=\"2542\"><strong data-start=\"2443\" data-end=\"2462\">Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0\/1000<\/strong>: checks whether the system retrieves enough candidates for re-ranking or RAG.<\/p><\/li><li data-start=\"2543\" data-end=\"2634\"><p data-start=\"2545\" data-end=\"2634\"><strong data-start=\"2545\" data-end=\"2552\">MAP<\/strong>: still useful for classic ad-hoc retrieval where multiple relevant docs matter.<\/p><\/li><li data-start=\"2635\" data-end=\"2723\"><p data-start=\"2637\" data-end=\"2723\"><strong data-start=\"2637\" data-end=\"2647\">MRR<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a><\/strong>: reported for QA tasks where only the <strong data-start=\"2686\" data-end=\"2708\">first relevant hit<\/strong> is critical.<\/p><\/li><\/ul><p data-start=\"2725\" data-end=\"2944\">This mirrors user behavior: most users scan only the top-10, but engines must ensure deeper recall for downstream <strong data-start=\"2839\" data-end=\"2934\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-passage-ranking\/\" target=\"_new\" rel=\"noopener\" data-start=\"2841\" data-end=\"2932\">passage ranking<\/a><\/strong> or RAG.<\/p><h2 data-start=\"2951\" data-end=\"2991\"><span class=\"ez-toc-section\" id=\"Implementation_Tips_for_Practitioners\"><\/span>Implementation Tips for Practitioners<span class=\"ez-toc-section-end\"><\/span><\/h2><h3 data-start=\"2993\" data-end=\"3014\"><span class=\"ez-toc-section\" id=\"1_Metric_pairing\"><\/span>1. Metric pairing<span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"3015\" data-end=\"3084\">Don\u2019t rely on a single score. Pair metrics to cover multiple aspects:<\/p><ul data-start=\"3085\" data-end=\"3270\"><li data-start=\"3085\" data-end=\"3129\"><p data-start=\"3087\" data-end=\"3129\"><strong data-start=\"3087\" data-end=\"3098\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a><\/strong> \u2192 top-rank graded precision.<\/p><\/li><li data-start=\"3130\" data-end=\"3175\"><p data-start=\"3132\" data-end=\"3175\"><strong data-start=\"3132\" data-end=\"3146\">Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0<\/strong> \u2192 coverage for re-ranking.<\/p><\/li><li data-start=\"3176\" data-end=\"3236\"><p data-start=\"3178\" data-end=\"3236\"><strong data-start=\"3178\" data-end=\"3185\">MAP<\/strong> \u2192 depth quality when multiple docs are relevant.<\/p><\/li><li data-start=\"3237\" data-end=\"3270\"><p data-start=\"3239\" data-end=\"3270\"><strong data-start=\"3239\" data-end=\"3246\">MRR<\/strong> \u2192 speed to first hit.<\/p><\/li><\/ul><p data-start=\"3272\" data-end=\"3367\">This triangulation mirrors how search engines balance <strong data-start=\"3326\" data-end=\"3348\">semantic relevance<\/strong> with <strong data-start=\"3354\" data-end=\"3366\">coverage<\/strong>.<\/p><h3 data-start=\"3369\" data-end=\"3396\"><span class=\"ez-toc-section\" id=\"2_Report_usman_explicitly\"><\/span>2. Report <a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/usman-khizar\/\">usman<\/a> explicitly<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"3397\" data-end=\"3561\"><li data-start=\"3397\" data-end=\"3462\"><p data-start=\"3399\" data-end=\"3462\">Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/saqi256\/\">Saqlain Khan<\/a> vs. Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> can tell very different stories.<\/p><\/li><li data-start=\"3463\" data-end=\"3561\"><p data-start=\"3465\" data-end=\"3561\">Always specify cutoffs\u2014especially in SEO experiments where <strong data-start=\"3524\" data-end=\"3539\">click depth<\/strong> varies by query type.<\/p><\/li><\/ul><h3 data-start=\"3563\" data-end=\"3585\"><span class=\"ez-toc-section\" id=\"3_Macro-averaging\"><\/span>3. Macro-averaging<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"3586\" data-end=\"3937\"><li data-start=\"3586\" data-end=\"3634\"><p data-start=\"3588\" data-end=\"3634\">Compute metrics <strong data-start=\"3604\" data-end=\"3631\">per query, then average<\/strong>.<\/p><\/li><li data-start=\"3635\" data-end=\"3741\"><p data-start=\"3637\" data-end=\"3741\">Avoid concatenating results across queries (micro-averaging), which overweights frequent head queries.<\/p><\/li><li data-start=\"3742\" data-end=\"3937\"><p data-start=\"3744\" data-end=\"3937\">This ensures fair representation of <strong data-start=\"3780\" data-end=\"3801\">long-tail queries<\/strong>, reinforcing your <strong data-start=\"3820\" data-end=\"3927\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-central-search-intent\/\" target=\"_new\" rel=\"noopener\" data-start=\"3822\" data-end=\"3925\">central search intent<\/a><\/strong> coverage.<\/p><\/li><\/ul><h3 data-start=\"3939\" data-end=\"3969\"><span class=\"ez-toc-section\" id=\"4_Integrate_user_feedback\"><\/span>4. Integrate user feedback<span class=\"ez-toc-section-end\"><\/span><\/h3><ul data-start=\"3970\" data-end=\"4270\"><li data-start=\"3970\" data-end=\"4152\"><p data-start=\"3972\" data-end=\"4152\">Metrics should be cross-validated against <strong data-start=\"4014\" data-end=\"4030\">click models<\/strong> and <strong data-start=\"4035\" data-end=\"4129\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-search-engine-trust\/\" target=\"_new\" rel=\"noopener\" data-start=\"4037\" data-end=\"4127\">dwell time<\/a><\/strong> as implicit signals.<\/p><\/li><li data-start=\"4153\" data-end=\"4270\"><p data-start=\"4155\" data-end=\"4270\">For live SEO systems, supplement offline metrics with <strong data-start=\"4209\" data-end=\"4240\">CTR\/dwell-based evaluations<\/strong> (debiased with click models).<\/p><\/li><\/ul><h2 data-start=\"4277\" data-end=\"4299\"><span class=\"ez-toc-section\" id=\"Practical_Playbooks\"><\/span>Practical Playbooks<span class=\"ez-toc-section-end\"><\/span><\/h2><ol data-start=\"4301\" data-end=\"5172\"><li data-start=\"4301\" data-end=\"4557\"><p data-start=\"4304\" data-end=\"4327\"><strong data-start=\"4304\" data-end=\"4325\">Research pipeline<\/strong><\/p><ul data-start=\"4331\" data-end=\"4557\"><li data-start=\"4331\" data-end=\"4431\"><p data-start=\"4333\" data-end=\"4431\">Train retrieval model \u2192 Evaluate with nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> and Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>00 \u2192 Compare with MAP for robustness.<\/p><\/li><li data-start=\"4435\" data-end=\"4557\"><p data-start=\"4437\" data-end=\"4557\">Diagnose failures by inspecting queries with low nDCG but high Recall (means relevant docs are found but poorly ranked).<\/p><\/li><\/ul><\/li><li data-start=\"4559\" data-end=\"4922\"><p data-start=\"4562\" data-end=\"4593\"><strong data-start=\"4562\" data-end=\"4591\">Enterprise\/SEO evaluation<\/strong><\/p><ul data-start=\"4597\" data-end=\"4922\"><li data-start=\"4597\" data-end=\"4637\"><p data-start=\"4599\" data-end=\"4637\">Segment queries: head vs. long-tail.<\/p><\/li><li data-start=\"4641\" data-end=\"4699\"><p data-start=\"4643\" data-end=\"4699\">Use Precision<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/saqi256\/\">Saqlain Khan<\/a> for high-traffic navigational queries.<\/p><\/li><li data-start=\"4703\" data-end=\"4761\"><p data-start=\"4705\" data-end=\"4761\">Use Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0 for exploratory, entity-driven queries.<\/p><\/li><li data-start=\"4765\" data-end=\"4922\"><p data-start=\"4767\" data-end=\"4922\">Map poor-performing queries to your <strong data-start=\"4803\" data-end=\"4895\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-an-entity-graph\/\" target=\"_new\" rel=\"noopener\" data-start=\"4805\" data-end=\"4893\">entity graph<\/a><\/strong> to identify coverage gaps.<\/p><\/li><\/ul><\/li><li data-start=\"4924\" data-end=\"5172\"><p data-start=\"4927\" data-end=\"4945\"><strong data-start=\"4927\" data-end=\"4943\">RAG pipeline<\/strong><\/p><ul data-start=\"4949\" data-end=\"5172\"><li data-start=\"4949\" data-end=\"5022\"><p data-start=\"4951\" data-end=\"5022\">Retrieval stage: Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0 ensures the right passages are available.<\/p><\/li><li data-start=\"5026\" data-end=\"5088\"><p data-start=\"5028\" data-end=\"5088\">Re-ranking stage: nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> ensures the best are placed top.<\/p><\/li><li data-start=\"5092\" data-end=\"5172\"><p data-start=\"5094\" data-end=\"5172\">Generation stage: Validate against user satisfaction (implicit clicks, dwell).<\/p><\/li><\/ul><\/li><\/ol><h2 data-start=\"5179\" data-end=\"5215\"><span class=\"ez-toc-section\" id=\"Frequently_Asked_Questions_FAQs\"><\/span>Frequently Asked Questions (FAQs)<span class=\"ez-toc-section-end\"><\/span><\/h2><h3 data-start=\"5217\" data-end=\"5401\"><span class=\"ez-toc-section\" id=\"Which_is_better_MAP_or_nDCG\"><\/span><strong data-start=\"5217\" data-end=\"5250\">Which is better: MAP or nDCG?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"5217\" data-end=\"5401\">MAP is great when multiple relevant docs exist. nDCG is better when graded relevance and <strong data-start=\"5342\" data-end=\"5362\">top-rank quality<\/strong> matter most. Use both when possible.<\/p><h3 data-start=\"5403\" data-end=\"5551\"><span class=\"ez-toc-section\" id=\"Why_does_my_MRR_look_inflated\"><\/span><strong data-start=\"5403\" data-end=\"5437\">Why does my MRR look inflated?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"5403\" data-end=\"5551\">If most queries have one obvious relevant doc, MRR spikes\u2014but this hides poor coverage. Pair with Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0.<\/p><h3 data-start=\"5553\" data-end=\"5676\"><span class=\"ez-toc-section\" id=\"How_do_I_handle_graded_labels_in_MAP\"><\/span><strong data-start=\"5553\" data-end=\"5594\">How do I handle graded labels in MAP?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"5553\" data-end=\"5676\">Use graded AP variants, but note nDCG handles graded relevance more natively.<\/p><h3 data-start=\"5678\" data-end=\"5850\"><span class=\"ez-toc-section\" id=\"What_metrics_should_I_report_for_SEO_experiments\"><\/span><strong data-start=\"5678\" data-end=\"5731\">What metrics should I report for SEO experiments?<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3><p data-start=\"5678\" data-end=\"5850\">nDCG<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a> for <strong data-start=\"5746\" data-end=\"5762\">SERP quality<\/strong> + Recall<a target=\"_blank\" href=\"https:\/\/www.nizamuddeen.com\/community\/profile\/amir110\/\">aamir<\/a>0 for <strong data-start=\"5780\" data-end=\"5800\">content coverage<\/strong>. Supplement with CTR\/dwell for live validation.<\/p><h2 data-start=\"6435\" data-end=\"6469\"><span class=\"ez-toc-section\" id=\"Final_Thoughts_on_Query_Rewrite\"><\/span>Final Thoughts on Query Rewrite<span class=\"ez-toc-section-end\"><\/span><\/h2><p data-start=\"6471\" data-end=\"6938\">IR metrics are only as good as the <strong data-start=\"6506\" data-end=\"6530\">queries they measure<\/strong>. Upstream <strong data-start=\"6541\" data-end=\"6636\"><a class=\"decorated-link\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-is-query-rewriting\/\" target=\"_new\" rel=\"noopener\" data-start=\"6543\" data-end=\"6634\">query rewriting<\/a><\/strong> ensures clarity, while downstream metrics like nDCG, MAP, and Recall confirm whether intent was satisfied. Together, they let you evaluate <strong data-start=\"6776\" data-end=\"6798\">semantic retrieval<\/strong> in a way that balances <strong data-start=\"6822\" data-end=\"6856\">precision, coverage, and trust<\/strong>\u2014ensuring your rankings reflect true user satisfaction, not just surface clicks.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-37a245d elementor-section-content-middle elementor-reverse-tablet elementor-reverse-mobile elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"37a245d\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-no\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-98be8f7\" data-id=\"98be8f7\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-10a35d7 elementor-widget elementor-widget-heading\" data-id=\"10a35d7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Want to Go Deeper into SEO?<\/p>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-3676db7 elementor-widget elementor-widget-text-editor\" data-id=\"3676db7\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p data-start=\"302\" data-end=\"342\">Explore more from my SEO knowledge base:<\/p><p data-start=\"344\" data-end=\"744\">\u25aa\ufe0f <strong data-start=\"478\" data-end=\"564\"><a class=\"\" href=\"https:\/\/www.nizamuddeen.com\/seo-hub-content-marketing\/\" target=\"_blank\" rel=\"noopener\" data-start=\"480\" data-end=\"562\">SEO &amp; Content Marketing Hub<\/a><\/strong> \u2014 Learn how content builds authority and visibility<br data-start=\"616\" data-end=\"619\" \/>\u25aa\ufe0f <strong data-start=\"611\" data-end=\"714\"><a class=\"\" href=\"https:\/\/www.nizamuddeen.com\/community\/search-engine-semantics\/\" target=\"_blank\" rel=\"noopener\" data-start=\"613\" data-end=\"712\">Search Engine Semantics Hub<\/a><\/strong> \u2014 A resource on entities, meaning, and search intent<br \/>\u25aa\ufe0f <strong data-start=\"622\" data-end=\"685\"><a class=\"\" href=\"https:\/\/www.nizamuddeen.com\/academy\/\" target=\"_blank\" rel=\"noopener\" data-start=\"624\" data-end=\"683\">Join My SEO Academy<\/a><\/strong> \u2014 Step-by-step guidance for beginners to advanced learners<\/p><p data-start=\"746\" data-end=\"857\">Whether you&#8217;re learning, growing, or scaling, you&#8217;ll find everything you need to <strong data-start=\"831\" data-end=\"856\">build real SEO skills<\/strong>.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-0c8cc20 elementor-section-content-middle elementor-reverse-tablet elementor-reverse-mobile elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"0c8cc20\" data-element_type=\"section\" data-e-type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-no\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-09bdbe7\" data-id=\"09bdbe7\" data-element_type=\"column\" data-e-type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-0022480 elementor-widget elementor-widget-heading\" data-id=\"0022480\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Feeling stuck with your SEO strategy?<\/p>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-5443deb elementor-widget elementor-widget-text-editor\" data-id=\"5443deb\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<p>If you&#8217;re unclear on next steps, I\u2019m offering a <a href=\"https:\/\/www.nizamuddeen.com\/seo-consultancy-services\/\" target=\"_blank\" rel=\"noopener\"><strong data-start=\"1294\" data-end=\"1327\">free one-on-one audit session<\/strong><\/a> to help and let\u2019s get you moving forward.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-09d4f8b elementor-align-center elementor-mobile-align-center elementor-widget elementor-widget-button\" data-id=\"09d4f8b\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/wa.me\/+923006456323\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Consult Now!<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t<div class=\"elementor-element elementor-element-7054060 e-flex e-con-boxed e-con e-parent\" data-id=\"7054060\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-c678333 elementor-widget elementor-widget-heading\" data-id=\"c678333\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t<p class=\"elementor-heading-title elementor-size-default\">Download My Local SEO Books Now!<\/p>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-72cabd8 e-grid e-con-full e-con e-child\" data-id=\"72cabd8\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t<div class=\"elementor-element elementor-element-25367d2 e-con-full e-flex e-con e-child\" data-id=\"25367d2\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-b4ae89c elementor-widget elementor-widget-image\" data-id=\"b4ae89c\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/roofer.quest\/product\/the-roofing-lead-gen-blueprint\/\" target=\"_blank\" rel=\"nofollow\">\n\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"300\" height=\"300\" src=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-300x300.webp\" class=\"attachment-medium size-medium wp-image-16462\" alt=\"The Roofing Lead Gen Blueprint\" srcset=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-300x300.webp 300w, https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-1024x1024.webp 1024w, https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-150x150.webp 150w, https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-768x768.webp 768w, https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover.webp 1080w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-35b0e74 elementor-align-center elementor-mobile-align-center elementor-widget elementor-widget-button\" data-id=\"35b0e74\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/roofer.quest\/product\/the-roofing-lead-gen-blueprint\/\" target=\"_blank\" rel=\"nofollow\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Download Now!<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-89dd481 e-con-full e-flex e-con e-child\" data-id=\"89dd481\" data-element_type=\"container\" data-e-type=\"container\">\n\t\t\t\t<div class=\"elementor-element elementor-element-9828364 elementor-widget elementor-widget-image\" data-id=\"9828364\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<a href=\"https:\/\/www.nizamuddeen.com\/the-local-seo-cosmos\/\" target=\"_blank\">\n\t\t\t\t\t\t\t<img decoding=\"async\" width=\"215\" height=\"300\" src=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/The-Local-SEO-Cosmos-Book-Cover-3xD-215x300.png\" class=\"attachment-medium size-medium wp-image-16461\" alt=\"The-Local-SEO-Cosmos-Book-Cover\" srcset=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/The-Local-SEO-Cosmos-Book-Cover-3xD-215x300.png 215w, https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/The-Local-SEO-Cosmos-Book-Cover-3xD.png 701w\" sizes=\"(max-width: 215px) 100vw, 215px\" \/>\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-0c4fb03 elementor-align-center elementor-mobile-align-center elementor-widget elementor-widget-button\" data-id=\"0c4fb03\" data-element_type=\"widget\" data-e-type=\"widget\" data-widget_type=\"button.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t<div class=\"elementor-button-wrapper\">\n\t\t\t\t\t<a class=\"elementor-button elementor-button-link elementor-size-sm\" href=\"https:\/\/www.nizamuddeen.com\/the-local-seo-cosmos\/\" target=\"_blank\">\n\t\t\t\t\t\t<span class=\"elementor-button-content-wrapper\">\n\t\t\t\t\t\t\t\t\t<span class=\"elementor-button-text\">Download Now!<\/span>\n\t\t\t\t\t<\/span>\n\t\t\t\t\t<\/a>\n\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 ez-toc-wrap-right counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 eztoc-toggle-hide-by-default' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Why_IR_Metrics_Matter\" >Why IR Metrics Matter?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Precision_and_Recall_The_Foundations\" >Precision and Recall: The Foundations<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Precision\" >Precision<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Recall\" >Recall<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Mean_Average_Precision_MAP\" >Mean Average Precision (MAP)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Normalized_Discounted_Cumulative_Gain_nDCG\" >Normalized Discounted Cumulative Gain (nDCG)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Mean_Reciprocal_Rank_MRR\" >Mean Reciprocal Rank (MRR)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Cutoff_Choices_Why_usman_Matters\" >Cutoff Choices: Why usman Matters<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Mini_Example_Binary_Relevance\" >Mini Example: Binary Relevance<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Common_Pitfalls_When_Using_IR_Metrics\" >Common Pitfalls When Using IR Metrics<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#1_Binary_vs_graded_relevance\" >1. Binary vs. graded relevance<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#2_Pooling_and_incompleteness\" >2. Pooling and incompleteness<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#3_DCG_variant_confusion\" >3. DCG variant confusion<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#4_Ignoring_tail_queries\" >4. Ignoring tail queries<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Benchmark_Practices_in_2025\" >Benchmark Practices in 2025<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Implementation_Tips_for_Practitioners\" >Implementation Tips for Practitioners<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#1_Metric_pairing\" >1. Metric pairing<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#2_Report_usman_explicitly\" >2. Report usman explicitly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#3_Macro-averaging\" >3. Macro-averaging<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-20\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#4_Integrate_user_feedback\" >4. Integrate user feedback<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-21\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Practical_Playbooks\" >Practical Playbooks<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-22\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Frequently_Asked_Questions_FAQs\" >Frequently Asked Questions (FAQs)<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-23\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Which_is_better_MAP_or_nDCG\" >Which is better: MAP or nDCG?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-24\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Why_does_my_MRR_look_inflated\" >Why does my MRR look inflated?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-25\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#How_do_I_handle_graded_labels_in_MAP\" >How do I handle graded labels in MAP?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-26\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#What_metrics_should_I_report_for_SEO_experiments\" >What metrics should I report for SEO experiments?<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-27\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#Final_Thoughts_on_Query_Rewrite\" >Final Thoughts on Query Rewrite<\/a><\/li><\/ul><\/nav><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Evaluation metrics for Information Retrieval (IR) are quantitative measures used to assess how effectively a search or retrieval system ranks documents in response to a query. The most common metrics include: Precision \u2013 proportion of retrieved documents that are relevant. Recall \u2013 proportion of relevant documents that are retrieved. MAP (Mean Average Precision) \u2013 average [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[161],"tags":[],"class_list":["post-13875","post","type-post","status-publish","format-standard","hentry","category-semantics"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What are Evaluation Metrics for IR? - Nizam SEO Community<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What are Evaluation Metrics for IR? - Nizam SEO Community\" \/>\n<meta property=\"og:description\" content=\"Evaluation metrics for Information Retrieval (IR) are quantitative measures used to assess how effectively a search or retrieval system ranks documents in response to a query. The most common metrics include: Precision \u2013 proportion of retrieved documents that are relevant. Recall \u2013 proportion of relevant documents that are retrieved. MAP (Mean Average Precision) \u2013 average [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/\" \/>\n<meta property=\"og:site_name\" content=\"Nizam SEO Community\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/SEO.Observer\" \/>\n<meta property=\"article:published_time\" content=\"2025-10-06T15:12:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-01-19T05:41:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"NizamUdDeen\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/x.com\/SEO_Observer\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"NizamUdDeen\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/\"},\"author\":{\"name\":\"NizamUdDeen\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#\\\/schema\\\/person\\\/c2b1d1b3711de82c2ec53648fea1989d\"},\"headline\":\"What are Evaluation Metrics for IR?\",\"datePublished\":\"2025-10-06T15:12:13+00:00\",\"dateModified\":\"2026-01-19T05:41:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/\"},\"wordCount\":1478,\"publisher\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/TRLGB-Book-Cover-300x300.webp\",\"articleSection\":[\"Semantics\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/\",\"url\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/\",\"name\":\"What are Evaluation Metrics for IR? - Nizam SEO Community\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/TRLGB-Book-Cover-300x300.webp\",\"datePublished\":\"2025-10-06T15:12:13+00:00\",\"dateModified\":\"2026-01-19T05:41:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/TRLGB-Book-Cover.webp\",\"contentUrl\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/04\\\/TRLGB-Book-Cover.webp\",\"width\":1080,\"height\":1080,\"caption\":\"The Roofing Lead Gen Blueprint\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/semantics\\\/what-are-evaluation-metrics-for-ir\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"community\",\"item\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Semantics\",\"item\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/category\\\/semantics\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"What are Evaluation Metrics for IR?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#website\",\"url\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/\",\"name\":\"Nizam SEO Community\",\"description\":\"SEO Discussion with Nizam\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#organization\",\"name\":\"Nizam SEO Community\",\"url\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/Nizam-SEO-Community-Logo-1.png\",\"contentUrl\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/wp-content\\\/uploads\\\/2025\\\/01\\\/Nizam-SEO-Community-Logo-1.png\",\"width\":527,\"height\":200,\"caption\":\"Nizam SEO Community\"},\"image\":{\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.nizamuddeen.com\\\/community\\\/#\\\/schema\\\/person\\\/c2b1d1b3711de82c2ec53648fea1989d\",\"name\":\"NizamUdDeen\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g\",\"caption\":\"NizamUdDeen\"},\"description\":\"Nizam Ud Deen, author of The Local SEO Cosmos, is a seasoned SEO Observer and digital marketing consultant with close to a decade of experience. Based in Multan, Pakistan, he is the founder and SEO Lead Consultant at ORM Digital Solutions, an exclusive consultancy specializing in advanced SEO and digital strategies. In The Local SEO Cosmos, Nizam Ud Deen blends his expertise with actionable insights, offering a comprehensive guide for businesses to thrive in local search rankings. With a passion for empowering others, he also trains aspiring professionals through initiatives like the National Freelance Training Program (NFTP) and shares free educational content via his blog and YouTube channel. His mission is to help businesses grow while giving back to the community through his knowledge and experience.\",\"sameAs\":[\"https:\\\/\\\/www.nizamuddeen.com\\\/about\\\/\",\"https:\\\/\\\/www.facebook.com\\\/SEO.Observer\",\"https:\\\/\\\/www.instagram.com\\\/seo.observer\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/seoobserver\\\/\",\"https:\\\/\\\/www.pinterest.com\\\/SEO_Observer\\\/\",\"https:\\\/\\\/x.com\\\/https:\\\/\\\/x.com\\\/SEO_Observer\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCwLcGcVYTiNNwpUXWNKHuLw\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What are Evaluation Metrics for IR? - Nizam SEO Community","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/","og_locale":"en_US","og_type":"article","og_title":"What are Evaluation Metrics for IR? - Nizam SEO Community","og_description":"Evaluation metrics for Information Retrieval (IR) are quantitative measures used to assess how effectively a search or retrieval system ranks documents in response to a query. The most common metrics include: Precision \u2013 proportion of retrieved documents that are relevant. Recall \u2013 proportion of relevant documents that are retrieved. MAP (Mean Average Precision) \u2013 average [&hellip;]","og_url":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/","og_site_name":"Nizam SEO Community","article_author":"https:\/\/www.facebook.com\/SEO.Observer","article_published_time":"2025-10-06T15:12:13+00:00","article_modified_time":"2026-01-19T05:41:38+00:00","og_image":[{"width":1080,"height":1080,"url":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover.webp","type":"image\/webp"}],"author":"NizamUdDeen","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/x.com\/SEO_Observer","twitter_misc":{"Written by":"NizamUdDeen","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#article","isPartOf":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/"},"author":{"name":"NizamUdDeen","@id":"https:\/\/www.nizamuddeen.com\/community\/#\/schema\/person\/c2b1d1b3711de82c2ec53648fea1989d"},"headline":"What are Evaluation Metrics for IR?","datePublished":"2025-10-06T15:12:13+00:00","dateModified":"2026-01-19T05:41:38+00:00","mainEntityOfPage":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/"},"wordCount":1478,"publisher":{"@id":"https:\/\/www.nizamuddeen.com\/community\/#organization"},"image":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#primaryimage"},"thumbnailUrl":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-300x300.webp","articleSection":["Semantics"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/","url":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/","name":"What are Evaluation Metrics for IR? - Nizam SEO Community","isPartOf":{"@id":"https:\/\/www.nizamuddeen.com\/community\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#primaryimage"},"image":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#primaryimage"},"thumbnailUrl":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover-300x300.webp","datePublished":"2025-10-06T15:12:13+00:00","dateModified":"2026-01-19T05:41:38+00:00","breadcrumb":{"@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#primaryimage","url":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover.webp","contentUrl":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/04\/TRLGB-Book-Cover.webp","width":1080,"height":1080,"caption":"The Roofing Lead Gen Blueprint"},{"@type":"BreadcrumbList","@id":"https:\/\/www.nizamuddeen.com\/community\/semantics\/what-are-evaluation-metrics-for-ir\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"community","item":"https:\/\/www.nizamuddeen.com\/community\/"},{"@type":"ListItem","position":2,"name":"Semantics","item":"https:\/\/www.nizamuddeen.com\/community\/category\/semantics\/"},{"@type":"ListItem","position":3,"name":"What are Evaluation Metrics for IR?"}]},{"@type":"WebSite","@id":"https:\/\/www.nizamuddeen.com\/community\/#website","url":"https:\/\/www.nizamuddeen.com\/community\/","name":"Nizam SEO Community","description":"SEO Discussion with Nizam","publisher":{"@id":"https:\/\/www.nizamuddeen.com\/community\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nizamuddeen.com\/community\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.nizamuddeen.com\/community\/#organization","name":"Nizam SEO Community","url":"https:\/\/www.nizamuddeen.com\/community\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.nizamuddeen.com\/community\/#\/schema\/logo\/image\/","url":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/01\/Nizam-SEO-Community-Logo-1.png","contentUrl":"https:\/\/www.nizamuddeen.com\/community\/wp-content\/uploads\/2025\/01\/Nizam-SEO-Community-Logo-1.png","width":527,"height":200,"caption":"Nizam SEO Community"},"image":{"@id":"https:\/\/www.nizamuddeen.com\/community\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.nizamuddeen.com\/community\/#\/schema\/person\/c2b1d1b3711de82c2ec53648fea1989d","name":"NizamUdDeen","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/a65bee5baf0c4fe21ee1cc99b3c091c3cfb0be4c65dcc5893ab97b4f671ab894?s=96&d=mm&r=g","caption":"NizamUdDeen"},"description":"Nizam Ud Deen, author of The Local SEO Cosmos, is a seasoned SEO Observer and digital marketing consultant with close to a decade of experience. Based in Multan, Pakistan, he is the founder and SEO Lead Consultant at ORM Digital Solutions, an exclusive consultancy specializing in advanced SEO and digital strategies. In The Local SEO Cosmos, Nizam Ud Deen blends his expertise with actionable insights, offering a comprehensive guide for businesses to thrive in local search rankings. With a passion for empowering others, he also trains aspiring professionals through initiatives like the National Freelance Training Program (NFTP) and shares free educational content via his blog and YouTube channel. His mission is to help businesses grow while giving back to the community through his knowledge and experience.","sameAs":["https:\/\/www.nizamuddeen.com\/about\/","https:\/\/www.facebook.com\/SEO.Observer","https:\/\/www.instagram.com\/seo.observer\/","https:\/\/www.linkedin.com\/in\/seoobserver\/","https:\/\/www.pinterest.com\/SEO_Observer\/","https:\/\/x.com\/https:\/\/x.com\/SEO_Observer","https:\/\/www.youtube.com\/channel\/UCwLcGcVYTiNNwpUXWNKHuLw"]}]}},"_links":{"self":[{"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/posts\/13875","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/comments?post=13875"}],"version-history":[{"count":4,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/posts\/13875\/revisions"}],"predecessor-version":[{"id":17038,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/posts\/13875\/revisions\/17038"}],"wp:attachment":[{"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/media?parent=13875"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/categories?post=13875"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.nizamuddeen.com\/community\/wp-json\/wp\/v2\/tags?post=13875"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}