agent-evaluation

Evaluation framework to synthetically generate data, fine-tune and evaluate small language models made for agents

Name		Name	Last commit message	Last commit date
evaluation		evaluation
log02 - qwen3:1.7b		log02 - qwen3:1.7b
log03 - qwen3:1.7b		log03 - qwen3:1.7b
log04 - qwen3:1.7b		log04 - qwen3:1.7b
log05 - qwen3:1.7b		log05 - qwen3:1.7b
log06 - gemma3:1b		log06 - gemma3:1b
log07 - qwen3:14b		log07 - qwen3:14b
log08 - dria-agent-alpha-3b		log08 - dria-agent-alpha-3b
log09 - phi4		log09 - phi4
log10 - phi4-reasoning		log10 - phi4-reasoning
log11 - o3-mini		log11 - o3-mini
log11 - phi4-mini-reasoning		log11 - phi4-mini-reasoning
log11 - phi4-mini		log11 - phi4-mini
log12 - gpt4.1		log12 - gpt4.1
log13 - sonar-pro		log13 - sonar-pro
log15 - gpt-4.1		log15 - gpt-4.1
log16 - deepseek-r1:1.5b		log16 - deepseek-r1:1.5b
log17 - deepseek-r1:7b		log17 - deepseek-r1:7b
log18 - osmosis		log18 - osmosis
log19 - mistral		log19 - mistral
log20 - qwen2.5:0.5b		log20 - qwen2.5:0.5b
log21 - qwen2.5:0.5b		log21 - qwen2.5:0.5b
log22 - llama3.2:1b		log22 - llama3.2:1b
log23 - llama3.2:1b		log23 - llama3.2:1b
log24 - qwen2.5:0.5b		log24 - qwen2.5:0.5b
log25 - qwen2.5:1.5b		log25 - qwen2.5:1.5b
log27 - llama3.2:3b		log27 - llama3.2:3b
log28 - qwen2.5-coder:0.5b		log28 - qwen2.5-coder:0.5b
log29 - qwen2.5-coder:1.5b		log29 - qwen2.5-coder:1.5b
log30 - qwen3:1.7b		log30 - qwen3:1.7b
log31 - olmo2-1b		log31 - olmo2-1b
log32 - starcoder		log32 - starcoder
log33 - smollm2:135m		log33 - smollm2:135m
log34 - smollm2:360m		log34 - smollm2:360m
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
config.json		config.json
evaluation.py		evaluation.py
loop-azure-compute.py		loop-azure-compute.py
loop-azure-foundary.py		loop-azure-foundary.py
loop-azure-mistral-medium.py		loop-azure-mistral-medium.py
loop-mac-mini.py		loop-mac-mini.py
loop-ori-2.py		loop-ori-2.py
loop-ori.py		loop-ori.py
loop-perplexity.py		loop-perplexity.py
loop-rock5t.py		loop-rock5t.py
loop-rpi5.py		loop-rpi5.py
loop-vast.py		loop-vast.py
loop.py		loop.py
ollama-test.py		ollama-test.py
report.md		report.md
requirements.txt		requirements.txt
run.py		run.py
task-subset.json		task-subset.json
task.json		task.json

Navigation Menu

Repository files navigation

agent-evaluation

About

Releases

Packages

Used by

Contributors

Languages

Latest commit

History

Folders and files

Repository files navigation

agent-evaluation

About

Resources

Stars

Watchers

Forks

Releases

Packages

Used by

Contributors

Languages