Context propagation problem using the Scorer of the testing framework

[mariofusco]

I have a AI service with request scope that I want to test. Despite I have annotated the testing method with @ActivateRequestContext it still fails with the following error:

2025-02-26 16:30:44,049 ERROR [io.qua.lan.tes.sco.Scorer] (pool-8-thread-1) Failed to evaluate sample `Medical`: java.lang.AssertionError: Failed to execute sample EvaluationSample[name=Medical, parameters=io.quarkiverse.langchain4j.testing.scorer.Parameters@fe451ee, expectedOutput=MEDICAL, tags=[]]
        at io.quarkiverse.langchain4j.testing.scorer.Scorer.execute(Scorer.java:98)
        at io.quarkiverse.langchain4j.testing.scorer.Scorer.lambda$evaluate$0(Scorer.java:43)
        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: jakarta.enterprise.context.ContextNotActiveException: RequestScoped context was not active when trying to obtain a bean instance for a client proxy of CLASS bean [class=org.agenticai.routing.CategoryRouter$$QuarkusImpl, id=Rf2qKJjPmnBesgNwSLYG4vrrFhA]
        - you can activate the request context for a specific method using the @ActivateRequestContext interceptor binding
        at io.quarkus.arc.impl.ClientProxies.notActive(ClientProxies.java:76)
        at io.quarkus.arc.impl.ClientProxies.getSingleContextDelegate(ClientProxies.java:32)
        at org.agenticai.routing.CategoryRouter$$QuarkusImpl_ClientProxy.arc$delegate(Unknown Source)
        at org.agenticai.routing.CategoryRouter$$QuarkusImpl_ClientProxy.classify(Unknown Source)
        at org.agenticai.routing.CategoryRouterTest.lambda$testCategoryRouter$0(CategoryRouterTest.java:39)
        at io.quarkiverse.langchain4j.testing.scorer.Scorer.execute(Scorer.java:96)
        ... 6 more

jakarta.enterprise.context.ContextNotActiveException: RequestScoped context was not active when trying to obtain a bean instance for a client proxy of CLASS bean [class=org.agenticai.routing.CategoryRouter$$QuarkusImpl, id=Rf2qKJjPmnBesgNwSLYG4vrrFhA]
        - you can activate the request context for a specific method using the @ActivateRequestContext interceptor binding

A reproducer for this problem can be found here https://github.com/mariofusco/quarkus-agentic-ai/blob/main/src/test/java/org/agenticai/routing/CategoryRouterTest.java

/cc @geoand @cescoffier

[geoand]

The problem is that we are not using a ManagedExecutor in Scorer.

@cescoffier any reason not to use the ManagedExecutor?

[cescoffier]

It was my attempt to not depend on Quarkus (in order to contribute it to langchain4j).

[geoand]

Okay, so then should I just introduce an SPI or something?

[cescoffier]

Yes, but that’s not the only SPI that need to be introduced. So I would switch to the ManagedExecutor for now, until we redo it the extension points.

…

On Wed 26 Feb 2025 at 17:03, Georgios Andrianakis ***@***.***> wrote: Okay, so then should I just introduce an SPI or something? — Reply to this email directly, view it on GitHub <#1327 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADCG7NAO2SCFCPO6LNCNGL2RXQT3AVCNFSM6AAAAABX5TBLQKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMOBVGUYDMNZTGE> . You are receiving this because you were mentioned.Message ID: ***@***.***> [image: geoand]*geoand* left a comment (quarkiverse/quarkus-langchain4j#1327) <#1327 (comment)> Okay, so then should I just introduce an SPI or something? — Reply to this email directly, view it on GitHub <#1327 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AADCG7NAO2SCFCPO6LNCNGL2RXQT3AVCNFSM6AAAAABX5TBLQKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMOBVGUYDMNZTGE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[geoand]

Okay, let me do that

[geoand]

Also, @ScorerConfiguration doesn't make sense if we supply the executor

[geoand]

Unfortunately this is more difficult than I thought because Quarkus JUnit extentions don't play nicely with other JUnit extensions.
I'll have a closer look tomorrow.

[geoand]

#1329 strays away from the original intent, but I don't see another way of supporting the Scorer in @QuarkusTest currently