I use Gitlab CICD tools and pytest 2.7 to test my updates on Shotgun event Daemon. It acts strange as the same tests will sometimes fail, sometimes pass. I do not change a thing between the two, simply restart the test step.
I am not that scared as tests are always running ok in local (actually I do not push my code on the repository if they don’t).
So I have a few questions:
- has any of you experienced this?
- my feeling is that it is related to the amount of work Shotgun event daemon has to deal when the pipeline runs; how does Shotgun deal with non-event-generating scripts? i.e. do these scripts generate events anyway but are filtered out at a certain point?
- is it related to Gitlab runners (I know it is not the correct place to ask for this )?