Skip to content

Add code coverage metrics and reporting #45

Closed

Description

@jsam

Problem

No code coverage reports or targets configured for Rust, Python, or TypeScript. Hard to track if new code maintains test quality.

Action

  • Add cargo-llvm-cov or cargo-tarpaulin for Rust coverage
  • Add pytest-cov for Python coverage
  • Integrate coverage reports into CI (e.g. Codecov or Coveralls)
  • Consider setting minimum coverage thresholds for PRs

Generated from production readiness audit

Activity

  1. self-assigned this
    on Mar 17, 2026
  2. added
    enhancementNew feature or request
    infraInfrastructure, CI/CD, DevOps
    on Mar 17, 2026
  3. jsam commented on Aug 21, 2026

    @jsam
    ContributorAuthor

    Partial: Rust coverage has been in CI for a while (Coverage job runs make coverage via cargo-llvm-cov and uploads the report on every PR). Still open: Python SDK coverage (pytest-cov), TypeScript coverage, and any minimum-threshold gating. Also note the coverage job currently measures only the root crate - the workspace now has gateway and ontology-client crates (from #105) that the coverage run should include.

  4. jsam commented on Oct 1, 2026

    @jsam
    ContributorAuthor

    Rust tarpaulin coverage exists. Remaining: run with --workspace (gateway, ontology-client), pytest-cov and vitest coverage, a baseline, then fail-under. The --workspace part lands in wp-ci-gate.

  5. added this to the Ops & resources milestone on Oct 3, 2026
  6. added
    backendBackend/server related
    sdkPython, JavaScript and Rust clients and CLI
    P2Follow-on functionality after core release prerequisites
    on Oct 3, 2026
  7. jsam commented on Oct 4, 2026

    @jsam
    ContributorAuthor

    Moved to Later / deferred. Code coverage reporting: deferred.

    The neurosymbolic decision layer plan narrows the roadmap to two milestones: Engine production readiness (current focus), then Gateway neural integration (Jev, CLM, Laya) (#266). This issue stays open and can be pulled back in. Tracker: #199.

  8. jsam commented on Oct 10, 2026

    @jsam
    ContributorAuthor

    Rust coverage runs through tarpaulin in make coverage and CI, but only for the root crate and without a baseline or threshold. The Python and TypeScript parts left with the SDKs removed in https://github.com/inputlayer/inputlayer-symbolic/pull/14. Remaining work continues in https://github.com/inputlayer/inputlayer-symbolic/issues/124.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

P2Follow-on functionality after core release prerequisitesbackendBackend/server relatedenhancementNew feature or requestinfraInfrastructure, CI/CD, DevOpssdkPython, JavaScript and Rust clients and CLI

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions