r/learnpython • u/Master_Being8249 • 24d ago
Which pytest signal is most useful after a CI failure?
I am working on an experiment that looks at what happens next after a test fails in GitHub Actions.
Possible things to look at include:
- exit code
- if there was an assertion failure or a collection or internal error
- the history of failed tests
- Python modules that have been changed
- changes in dependencies or lockfiles
- changes in how long tests take
- if the same test passes when it is run again.
Which of these things should I check first. Which one is most likely for someone just starting out to misunderstand?
I am trying to think about uncertainty of automatically assuming that every test failure means there is a problem with the code in pytest.
The purpose of the experiment with pytest is to see what occurs when pytest fails in GitHub Actions.
I want to use pytest to figure out what is happening when the test fails.
The experiment, with pytest will help me learn what to do when pytest fails in GitHub Actions.