-
Notifications
You must be signed in to change notification settings - Fork 285
Add text rerank pipeline #2436
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
as-suvorov
merged 30 commits into
openvinotoolkit:master
from
as-suvorov:as/rag_text_reranker
Jul 29, 2025
Merged
Add text rerank pipeline #2436
as-suvorov
merged 30 commits into
openvinotoolkit:master
from
as-suvorov:as/rag_text_reranker
Jul 29, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
as-suvorov
commented
Jul 17, 2025
Comment on lines
+576
to
+577
infer_request_guard.get().set_input_tensor(0, ov::Tensor{ov::element::string, {prompts_1.size()}, const_cast<std::string*>(prompts_1.data())}); | ||
infer_request_guard.get().set_input_tensor(1, ov::Tensor{ov::element::string, {prompts_2.size()}, const_cast<std::string*>(prompts_2.data())}); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
as-suvorov
commented
Jul 17, 2025
Comment on lines
+214
to
+215
if MODELS[model_id].get("convert_2_input_tokenizer", False): | ||
convert_2_input_tokenizer(Path(model_path)) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Temporary until 2 inputs tokenizer transformation is implemented
apaniukov
approved these changes
Jul 18, 2025
rkazants
approved these changes
Jul 18, 2025
github-merge-queue bot
pushed a commit
that referenced
this pull request
Jul 21, 2025
Add TextRerankPipeline which reranks a list of candidate documents based on their relevance to a query using a cross-encoder or reranker model.
.pyi is incorrect |
Merged
via the queue into
openvinotoolkit:master
with commit Jul 29, 2025
a6631f5
103 of 105 checks passed
github-merge-queue bot
pushed a commit
that referenced
this pull request
Aug 1, 2025
**Details**: After #2436 merged, there are two test_rag.py as follow: - [pytests/samples/test_rag.py](https://github.com/openvinotoolkit/openvino.genai/blob/master/tests/python_tests/samples/test_rag.py) - [pytests/test_rag.py](https://github.com/openvinotoolkit/openvino.genai/blob/master/tests/python_tests/test_rag.py) Which introduced following issue in CI precommit test locally: ``` __________________________ERROR collecting test_rag.py__________________________ import file mismatch: imported module 'test_rag' has this __file__ attribute: C:\xsun\openvino.genai\tests\python_tests\samples\test_rag.py which is not the same as the test file we want to collect: C:\xsun\openvino.genai\tests\python_tests\test_rag.py HINT: remove __pycache__ / .pyc files and/or use a unique basename for your test file modules ``` This PR aim to rename `pytests/samples/test_rag.py` to `pytests/samples/test_rag_sample.py` to avoid ambiguous name conflict with [pytests/test_rag.py](https://github.com/openvinotoolkit/openvino.genai/blob/master/tests/python_tests/test_rag.py), therefore fix the pytest import issue in CI precommit test. --------- Co-authored-by: Vladimir Zlobin <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
category: cmake / build
Cmake scripts
category: CPP API
Changes in GenAI C++ public headers
category: GHA
CI based on Github actions
category: llm_bench
Label for tool/llm_bench folder
category: Python API
Python API for GenAI
category: RAG samples
RAG samples
category: RAG
RAG pipeline components
category: speech generation
category: tokenizers
Tokenizer class or submodule update
no-match-files
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add TextRerankPipeline which reranks a list of candidate documents based on their relevance to a query using a cross-encoder or reranker model.