Skip to content

docs: align benchmark guide and template with dataloader.py naming - #43

Merged
Yifan Yang (Yif-Yang) merged 1 commit into
microsoft:mainfrom
imshunsuke:docs/fix-benchmark-loader-naming
Jun 15, 2026
Merged

Yifan Yang (Yif-Yang) merged 1 commit into
microsoft:mainfrom
imshunsuke:docs/fix-benchmark-loader-naming

Conversation

@imshunsuke

Copy link
Copy Markdown
Contributor

Summary

The "Add a New Benchmark" guide (docs/guide/new-benchmark.md) and the env
template README (skillopt/envs/_template/README.md) refer to the data-loader
file as loader.py, but all six built-in benchmarks name it dataloader.py
(skillopt/envs/<name>/dataloader.py). This aligns the docs with the actual
convention so a new contributor following the guide produces a filename
consistent with the existing benchmarks.

Note the template was even internally inconsistent: the docstring in
skillopt/envs/_template/loader_template.py already points to
skillopt/envs/officeqa/dataloader.py, while _template/README.md told you to
rename the file to loader.py.

Changes (docs only, no code changes)

  • docs/guide/new-benchmark.md: Step 2 file path and the adapter import now use dataloader.py.
  • skillopt/envs/_template/README.md: the rename step (mv loader_template.py dataloader.py) and the TODO reference now use dataloader.py.

The new-benchmark guide and the env template README referred to the data
loader file as loader.py, but all six built-in benchmarks name it
dataloader.py (skillopt/envs/<name>/dataloader.py). Update the docs and
the template rename step to match the actual convention.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
@imshunsuke

Copy link
Copy Markdown
Contributor Author

@microsoft-github-policy-service agree

@Yif-Yang
Yifan Yang (Yif-Yang) merged commit eef4805 into microsoft:main Jun 15, 2026
1 check passed
Yifan Yang (Yif-Yang) added a commit to Yif-Yang/SkillOpt that referenced this pull request Jun 15, 2026
…g branch

Pulls microsoft/main after the merged community PRs: OpenClaw plugin shell
(microsoft#59), Codex Desktop transcript harvesting + skill-first integration (microsoft#48/microsoft#49),
shared-default reflect refactor (microsoft#44), and benchmark-guide doc fixes (microsoft#43).

Conflict resolution: shared plugin/docs/engine files (README, plugins/codex/*,
backend.py, docs/sleep/*) taken from upstream — upstream already contains my
pushed plugin (86bad36) plus the community additions, so this loses nothing of
mine. .gitignore unioned. Codex prompt files removed to follow upstream's
skill-first design. My local-only work (blog/, docs/sleep experiments, v2
research harnesses) is untouched; engine fixes (sample_id dream diversity,
guarded imports, retry) preserved. 104/104 tests pass.

Co-Authored-By: Claude Opus 4 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants