Search results

Evaluation <code>Invocation.user_content</code> ValidationError when session has invocations without user events

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

need attention[Status] This issue is important but the maintainers haven't started working on it[Status] This issue is important but the maintainers haven't started working on it

Status: Open.

Bug

#3760 In google/adk-python;

· lifeodyssey opened on Nov 29, 2025

Guidance on Mocking MCP Toolbox Request and Responses for Testing (Agent Evaluation)

answered[Status] This issue has been answered by the maintainer[Status] This issue has been answered by the maintainer

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

question[Component] This issue is asking a question or clarification[Component] This issue is asking a question or clarification

Status: Open.

Task

#3740 In google/adk-python;

· sivakumar-d3v opened on Nov 27, 2025

<code>adk web</code> does not render Eval tab when more than one agent folder exists

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

web[Component] This issue will be transferred to adk-web[Component] This issue will be transferred to adk-web

Status: Open.

Bug

#3718 In google/adk-python;

· olliefr opened on Nov 26, 2025

tool_trajectory_avg_score class doesn't accept string values for <code>match_type</code>

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#3711 In google/adk-python;

· alexhermida opened on Nov 25, 2025

Multi-Agent Orchestration: Missing Tool Execution Details in Evaluation + SQL Tool Parameter Matching Issues

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

needs-review[Status] The PR is awaiting review from the maintainer[Status] The PR is awaiting review from the maintainer

Status: Open.

Feature

#3652 In google/adk-python;

· sivakumar-d3v opened on Nov 21, 2025

rubric_based_tool_use_quality_v1 is flaky when the test case have multiple turns

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

request clarification[Status] The maintainer need clarification or more information from the author[Status] The maintainer need clarification or more information from the author

Status: Open.

Bug

#3593 In google/adk-python;

· miyannishar opened on Nov 18, 2025

Agent Evaluation using pytest is using id for <code>tool_trajectory_avg_score</code> that can never be predicted

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#3434 In google/adk-python;

· miyannishar opened on Nov 6, 2025

Support Custom LLM Models for LlmAsAJudgeCriterion

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

help wanted[Community] Extra attention is needed[Community] Extra attention is needed

needs-review[Status] The PR is awaiting review from the maintainer[Status] The PR is awaiting review from the maintainer

Status: Open.

Feature

#3400 In google/adk-python;

· nathan-tsien opened on Nov 5, 2025

asyncio: Unclosed connector connections while invoking adk agent while running the evaluations

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#3344 In google/adk-python;

· supraja-yarramsetti-efx opened on Oct 30, 2025

Web UI can't run multiple eval cases with stdio MCP tools

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

Status: Open.

Bug

#3161 In google/adk-python;

· jedick opened on Oct 14, 2025

Eval fails for non-English languages

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

good first issue[Community] This issue is good for newcomers to participate[Community] This issue is good for newcomers to participate

help wanted[Community] Extra attention is needed[Community] Extra attention is needed

Status: Open.

Feature

#3111 In google/adk-python;

· lifnaja opened on Oct 8, 2025

In-Conversation Evals

eval[Component] This issue is related to evaluation[Component] This issue is related to evaluation

needs-review[Status] The PR is awaiting review from the maintainer[Status] The PR is awaiting review from the maintainer

Status: Open.

Feature

#2746 In google/adk-python;

· tiaaburton opened on Aug 26, 2025