Skip to content

Test timing issues for slow github test runners #64

@Charlesworth

Description

@Charlesworth

Some of the tests, in particular the eva_locker_test.py tests use sleeps to ensure thing happen within a set time frame. Unfortunately GitHub's free action test runners are slow enough that these tests can fail in a non-deterministic way if the runner is processing the test a bit slowly. As an example the following test run failed due to a timeout: https://github.com/automata-tech/eva_python_sdk/runs/831475589?check_suite_focus=true

To fix this issue either:

  • increase to duration which is allowed for each test action in eva_locker_test.py (quick and easy but not ideal)
  • remove any reliance on sleeps from eva_locker_test.py (this will be a longer task)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions