Skip to content

Evaluation experiment runs #54

Description

@sahil-sagwekar2652

What happened?

The agents-cli eval submit command does not create experiments on the agent platform. Is this supposed to happen?

Steps to Reproduce

  1. Deploy the agent to agent_runtime - agents-cli deploy
  2. Run agents-cli eval generate
  3. and the agents-cli eval submit
  4. Go to the Evaluations inside the agent deployment on GCP console.

What did you expect to happen?

Eval runs to be listed as experiments in the GCP console.

Client information

Client Information

Run agents-cli info to output debugging information about your client.

Command Output / Logs

No response

Anything else we need to know?

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

known issueKnown issueneeds review[Status] The PR/issue is awaiting review from the maintainer

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions