Notices, exceptions and debug message make build unstable while running Drupal tests on Jenkins

Question

Jenkins runs Drupal tests (simpletest core module) of some custom modules. Tests pass, however result considered unstable because of some warnings, notices, etc.

Same 'unstable' result is when some tests fails, so I couldn't run next job if build unstable.

Setting php error reporting and display errors doesn't help.

Using scripts/run-tests.sh. Drush test-run made build fail (even not unstable) because of some drush messages.

Any way to check if only real tests passed, not looking at other mesaages?

Answer 1

Had to fix all notices and warnings to resolve this issue. Trouble was in missing some modules including while running tests on test installation profile