Skip to content

Fix evals in CI #143

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 2, 2025
Merged

Fix evals in CI #143

merged 2 commits into from
May 2, 2025

Conversation

cmsparks
Copy link
Collaborator

@cmsparks cmsparks commented May 2, 2025

There was an issue with the containers evals. I fixed the evals and got dev mode in sync with the other folders in the repo

@cmsparks cmsparks requested review from deloreyj and Maximo-Guk and removed request for deloreyj May 2, 2025 21:25
@@ -54,6 +54,10 @@ export class ContainerMcpAgent extends McpAgent<Env, never, Props> {
Use this tool to initialize a container before running any python or node.js code that the user requests ro run.`,
// @ts-ignore
async () => {
console.log('initializing')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove log? Or maybe we should add some tags here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nah i'm gonna remove

@@ -47,6 +49,7 @@ export async function runTask(
return acc
}, {} as ToolSet)

console.log('streaming res')
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stray log?

description: v.description,
execute: async (args, opts) => {
execute: async (args: any, opts) => {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just curious why set to this to :any ?

Copy link
Collaborator Author

@cmsparks cmsparks May 2, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was just copypasted from the workers-bindings evals. IIRC this was to prevent eslint from complaining. We should honestly move this to be a common function though tbh (but I'll do that in a follow up pr)

@cmsparks cmsparks force-pushed the csparks/fix-evals branch from fa83d75 to ae8bc13 Compare May 2, 2025 21:34
@cmsparks cmsparks force-pushed the csparks/fix-evals branch from ae8bc13 to 9a750b4 Compare May 2, 2025 21:39
@cmsparks cmsparks merged commit 1835809 into main May 2, 2025
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants