{"id":4248,"date":"2024-02-27T15:56:19","date_gmt":"2024-02-27T14:56:19","guid":{"rendered":"https:\/\/kairntech.com\/doc\/?p=4248"},"modified":"2025-07-31T10:49:45","modified_gmt":"2025-07-31T08:49:45","slug":"how-to-evaluate-the-quality-of-a-retriever-for-question-answering","status":"publish","type":"post","link":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/","title":{"rendered":"How to evaluate the quality of a retriever for question answering?"},"content":{"rendered":"\n<p>In your question-answering project, if you are not fully satisfied with the search retriever leveraging the default vectorizer, you can use and experiment different vectorizers to see which perform best. <\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Prepare a set of question answer in a JSON file with the format below. This dataset will be considered as your GOLD dataset. <\/li>\n\n\n\n<li>Important notes:\n<ul class=\"wp-block-list\">\n<li>all answers should be in your corpus of segments. <\/li>\n\n\n\n<li>if you have a FAQ, you can import it even if the segments don&#8217;t contain the exact answer as formulated in the FAQ: the &#8220;Reference&#8221; retriever&#8217;s search plain text (see below) should still bring it back.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<pre class=\"wp-block-code\"><code>&#91;\n  {\n    \"text\": \"My first question?\",\n    \"identifier\": \"question1\",\n    \"metadata\": {\n      \"question\": \"true\"\n    },\n    \"altTexts\": &#91;\n      {\n        \"name\": \"answer\",\n        \"text\": \"My first answer\"\n      }\n    ]\n  },\n  {\n    \"text\": \"My second question?\",\n    \"identifier\": \"question2\",\n    \"metadata\": {\n      \"question\": \"true\"\n    },\n    \"altTexts\": &#91;\n      {\n        \"name\": \"answer\",\n        \"text\": \"My second answer\"\n      }\n    ]\n  },\n  {\n    \"text\": \"My third question?\",\n    \"identifier\": \"question3\",\n    \"metadata\": {\n      \"question\": \"true\"\n    },\n    \"altTexts\": &#91;\n      {\n        \"name\": \"answer\",\n        \"text\": \"My third answer\"\n      }\n    ]\n  }\n]<\/code><\/pre>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Go to the <em>Document <\/em>view<\/li>\n\n\n\n<li>Import the JSON file in your project as you would import documents<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"570\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png\" alt=\"\" class=\"wp-image-5244\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-300x167.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-768x428.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png 1214w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Go the <em>Processing<\/em> menue<\/li>\n\n\n\n<li>Create a first &#8220;Retriever&#8221; component <\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"811\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-100-1024x811.png\" alt=\"\" class=\"wp-image-5246\" style=\"width:679px;height:auto\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-100-1024x811.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-100-300x238.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-100-768x609.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-100.png 1036w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Use the default configuration<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"475\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-102-1024x475.png\" alt=\"\" class=\"wp-image-5248\" style=\"width:765px;height:auto\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-102-1024x475.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-102-300x139.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-102-768x356.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-102.png 1111w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Configure the &#8220;Search parameter builder&#8221; component<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"926\" height=\"461\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-103.png\" alt=\"\" class=\"wp-image-5249\" style=\"width:554px;height:auto\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-103.png 926w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-103-300x149.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-103-768x382.png 768w\" sizes=\"auto, (max-width: 926px) 100vw, 926px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Give the name &#8220;Reference&#8221;\n<ul class=\"wp-block-list\">\n<li>keep all default values except the Size (Maximum number of hits to be returned) = 1<\/li>\n\n\n\n<li>Apply Size = 3 if the segments don&#8217;t contain the exact answer as formulated in the FAQ. <\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Don&#8217;t forget to Save<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"325\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107-1024x325.png\" alt=\"\" class=\"wp-image-5253\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107-1024x325.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107-300x95.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107-768x244.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107-1536x488.png 1536w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-107.png 1594w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Create a new &#8220;Retriever&#8221; <\/li>\n\n\n\n<li>Select\n<ul class=\"wp-block-list\">\n<li>the Size (Maximum number of hits to be returned) = for instance 10<\/li>\n\n\n\n<li>the Search type you want to test (full-text, vector or hybrid search)<\/li>\n\n\n\n<li>the Vectorizer if you want to test vector or hybrid search&#8230;<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Don&#8217;t forget to Save<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"374\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109-1024x374.png\" alt=\"\" class=\"wp-image-5255\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109-1024x374.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109-300x110.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109-768x281.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109-1536x561.png 1536w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-109.png 1782w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Go to the <em>Experiment <\/em>view<\/li>\n\n\n\n<li>Create a new &#8220;Experiment&#8221;<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"469\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112-1024x469.png\" alt=\"\" class=\"wp-image-5258\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112-1024x469.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112-300x138.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112-768x352.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112-1536x704.png 1536w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-112.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The default engine is &#8220;SearchRanking&#8221;<\/li>\n\n\n\n<li>Select the &#8220;Reference&#8221; search parameter<\/li>\n\n\n\n<li>Select the search parameter to be tested<\/li>\n\n\n\n<li>Don&#8217;t forget to Save<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1018\" height=\"708\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-113.png\" alt=\"\" class=\"wp-image-5259\" style=\"width:582px;height:auto\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-113.png 1018w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-113-300x209.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-113-768x534.png 768w\" sizes=\"auto, (max-width: 1018px) 100vw, 1018px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Launch the experiment<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"316\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114-1024x316.png\" alt=\"\" class=\"wp-image-5260\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114-1024x316.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114-300x93.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114-768x237.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114-1536x474.png 1536w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-114.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Access the different quality metrics<\/li>\n<\/ul>\n\n\n<div class=\"wp-block-image is-style-default\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"491\" src=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45-1024x491.png\" alt=\"\" class=\"wp-image-4379\" srcset=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45-1024x491.png 1024w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45-300x144.png 300w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45-768x368.png 768w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45-1536x736.png 1536w, https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/03\/image-45.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<ul class=\"wp-block-list\">\n<li>If you want to experiment with different vectorizers, you have to create and configure them as below:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-embed is-type-wp-embed is-provider-kairntech-documentation wp-block-embed-kairntech-documentation\"><div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"wp-embedded-content\" data-secret=\"cMWbrRLccY\"><a href=\"https:\/\/kairntech.com\/doc\/how-to-configure-and-customize-a-vectorizer\/\">How to configure and customize a vectorizer?<\/a><\/blockquote><iframe loading=\"lazy\" class=\"wp-embedded-content\" sandbox=\"allow-scripts\" security=\"restricted\" style=\"position: absolute; visibility: hidden;\" title=\"&#8220;How to configure and customize a vectorizer?&#8221; &#8212; Kairntech Documentation\" src=\"https:\/\/kairntech.com\/doc\/how-to-configure-and-customize-a-vectorizer\/embed\/#?secret=kFph379cSc#?secret=cMWbrRLccY\" data-secret=\"cMWbrRLccY\" width=\"600\" height=\"338\" frameborder=\"0\" marginwidth=\"0\" marginheight=\"0\" scrolling=\"no\"><\/iframe>\n<\/div><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>In your question-answering project, if you are not fully satisfied with the search retriever leveraging the default vectorizer, you can use and experiment different vectorizers to see which perform best.<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[14],"tags":[31,30,29],"class_list":["post-4248","post","type-post","status-publish","format-standard","hentry","category-advanced-topics","tag-question-answering","tag-rag","tag-retrieval-augmented-generation"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>How to evaluate the quality of a retriever for question answering? - Kairntech Documentation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to evaluate the quality of a retriever for question answering? - Kairntech Documentation\" \/>\n<meta property=\"og:description\" content=\"In your question-answering project, if you are not fully satisfied with the search retriever leveraging the default vectorizer, you can use and experiment different vectorizers to see which perform best.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\" \/>\n<meta property=\"og:site_name\" content=\"Kairntech Documentation\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-27T14:56:19+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-07-31T08:49:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1214\" \/>\n\t<meta property=\"og:image:height\" content=\"676\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"vincent.nibart\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"vincent.nibart\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\"},\"author\":{\"name\":\"vincent.nibart\",\"@id\":\"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de\"},\"headline\":\"How to evaluate the quality of a retriever for question answering?\",\"datePublished\":\"2024-02-27T14:56:19+00:00\",\"dateModified\":\"2025-07-31T08:49:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\"},\"wordCount\":293,\"image\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png\",\"keywords\":[\"question-answering\",\"rag\",\"retrieval augmented generation\"],\"articleSection\":[\"Advanced Topics\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\",\"url\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\",\"name\":\"How to evaluate the quality of a retriever for question answering? - Kairntech Documentation\",\"isPartOf\":{\"@id\":\"https:\/\/kairntech.com\/doc\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png\",\"datePublished\":\"2024-02-27T14:56:19+00:00\",\"dateModified\":\"2025-07-31T08:49:45+00:00\",\"author\":{\"@id\":\"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de\"},\"breadcrumb\":{\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage\",\"url\":\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png\",\"contentUrl\":\"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png\",\"width\":1214,\"height\":676},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/kairntech.com\/doc\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to evaluate the quality of a retriever for question answering?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/kairntech.com\/doc\/#website\",\"url\":\"https:\/\/kairntech.com\/doc\/\",\"name\":\"Kairntech Documentation\",\"description\":\"All the information you need to use Kairntech Software, methodology,  user and installation guides.\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/kairntech.com\/doc\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de\",\"name\":\"vincent.nibart\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/kairntech.com\/doc\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8c6c4f0e2ce82e7f30989e62388adbfe6071cdc185ead6e4bff5281aa3255ae2?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8c6c4f0e2ce82e7f30989e62388adbfe6071cdc185ead6e4bff5281aa3255ae2?s=96&d=mm&r=g\",\"caption\":\"vincent.nibart\"},\"url\":\"https:\/\/kairntech.com\/doc\/author\/vincent-nibart\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to evaluate the quality of a retriever for question answering? - Kairntech Documentation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/","og_locale":"en_GB","og_type":"article","og_title":"How to evaluate the quality of a retriever for question answering? - Kairntech Documentation","og_description":"In your question-answering project, if you are not fully satisfied with the search retriever leveraging the default vectorizer, you can use and experiment different vectorizers to see which perform best.","og_url":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/","og_site_name":"Kairntech Documentation","article_published_time":"2024-02-27T14:56:19+00:00","article_modified_time":"2025-07-31T08:49:45+00:00","og_image":[{"width":1214,"height":676,"url":"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png","type":"image\/png"}],"author":"vincent.nibart","twitter_card":"summary_large_image","twitter_misc":{"Written by":"vincent.nibart","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#article","isPartOf":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/"},"author":{"name":"vincent.nibart","@id":"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de"},"headline":"How to evaluate the quality of a retriever for question answering?","datePublished":"2024-02-27T14:56:19+00:00","dateModified":"2025-07-31T08:49:45+00:00","mainEntityOfPage":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/"},"wordCount":293,"image":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage"},"thumbnailUrl":"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png","keywords":["question-answering","rag","retrieval augmented generation"],"articleSection":["Advanced Topics"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/","url":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/","name":"How to evaluate the quality of a retriever for question answering? - Kairntech Documentation","isPartOf":{"@id":"https:\/\/kairntech.com\/doc\/#website"},"primaryImageOfPage":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage"},"image":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage"},"thumbnailUrl":"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99-1024x570.png","datePublished":"2024-02-27T14:56:19+00:00","dateModified":"2025-07-31T08:49:45+00:00","author":{"@id":"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de"},"breadcrumb":{"@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#primaryimage","url":"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png","contentUrl":"https:\/\/kairntech.com\/doc\/wp-content\/uploads\/sites\/2\/2024\/02\/image-99.png","width":1214,"height":676},{"@type":"BreadcrumbList","@id":"https:\/\/kairntech.com\/doc\/how-to-evaluate-the-quality-of-a-retriever-for-question-answering\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/kairntech.com\/doc\/"},{"@type":"ListItem","position":2,"name":"How to evaluate the quality of a retriever for question answering?"}]},{"@type":"WebSite","@id":"https:\/\/kairntech.com\/doc\/#website","url":"https:\/\/kairntech.com\/doc\/","name":"Kairntech Documentation","description":"All the information you need to use Kairntech Software, methodology,  user and installation guides.","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/kairntech.com\/doc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/kairntech.com\/doc\/#\/schema\/person\/e2b5ed8a33aa3f4a90dca6f0a0c5f0de","name":"vincent.nibart","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/kairntech.com\/doc\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8c6c4f0e2ce82e7f30989e62388adbfe6071cdc185ead6e4bff5281aa3255ae2?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8c6c4f0e2ce82e7f30989e62388adbfe6071cdc185ead6e4bff5281aa3255ae2?s=96&d=mm&r=g","caption":"vincent.nibart"},"url":"https:\/\/kairntech.com\/doc\/author\/vincent-nibart\/"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/posts\/4248","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/comments?post=4248"}],"version-history":[{"count":15,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/posts\/4248\/revisions"}],"predecessor-version":[{"id":5261,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/posts\/4248\/revisions\/5261"}],"wp:attachment":[{"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/media?parent=4248"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/categories?post=4248"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/kairntech.com\/doc\/wp-json\/wp\/v2\/tags?post=4248"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}