Skip to content

Some sort of test run feedback would be helpful #5

Open

Description

@mksenzov

An image that seem to run fine locally fails the test run upon submission. All the feedback we get is an error status in the table column on the dashboard. Is there a way to get some output that could help understand the issue?

Activity

  1. mksenzov commented on Oct 8, 2020

    @mksenzov
    Author

    As I go through it, it would be good to add --network="none" to first docker run in Testing submissions on https://efficientqa.github.io/submit.html

    #6, #7

    but then in my case it was clearly not the only issue. An email with run log would go a long way here.

  2. tomkwiat commented on Oct 9, 2020

    @tomkwiat
    Contributor

    Thanks for the feedback Mikhail.

    I'm afraid it is difficult for us to automatically expose significant logs output while also maintaining a blind test set, so you will need to email [email protected] and we will get back to you within a day.

    I have looked up your logs and I suspect that there may be a bug stemming from our assumption that the Docker WORKDIR is set to /. Could you please retry your local test by calling ./submission.sh instead of /submission.sh.

    Thanks also for the suggested addition to our Testing submissions section, I will add that now.

    cheers,
    Tom

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions