Introduce streaming tool and support streaming for AgentTool
and TeamTool
.
#6712
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation: currently tool execution is not observable through
run_stream
of agents and teams. This is necessary especially forAgentTool
andTeamTool
.This PR addresses this issue by makign the following changes:
BaseStreamTool
inautogen_core.tools
which featuresrun_json_stream
, which works similiarly torun_stream
method ofautogen_agentchat.base.TaskRunner
.TeamTool
andAgentTool
to subclass theBaseStreamTool
StreamingWorkbench
interface featuringcall_tool_stream
StaticStreamingWorkbench
implementationAssistantAgent
, useStaticStreamingWorkbench
.Example:
output