[PATCH] spec/a53: Set conditionally failing test state

Kinsey Moore kinsey.moore at oarcorp.com
Tue Nov 24 13:32:17 UTC 2020


The spintrcritical03-05 and psx12 tests are known to fail on Qemu when
the host system is heavily loaded. A single run of Qemu per core
during a testsuite run tends to yield positive results, but any
additional load on a system will result in test failures.

This patch also applies the correct expected test state for intermittent
failures so that those tests will still build.
---
 spec/build/bsps/aarch64/a53/tsta53.yml | 36 ++++++++++++++++----------
 1 file changed, 22 insertions(+), 14 deletions(-)

diff --git a/spec/build/bsps/aarch64/a53/tsta53.yml b/spec/build/bsps/aarch64/a53/tsta53.yml
index a40cc8671c..9135fac7f4 100644
--- a/spec/build/bsps/aarch64/a53/tsta53.yml
+++ b/spec/build/bsps/aarch64/a53/tsta53.yml
@@ -12,20 +12,28 @@ actions:
     spmisc01: exclude
 
     # tests that are passing intermittently
-    spcpucounter01: exclude
-    rtmonuse: exclude
-    sp37: exclude
-    sp68: exclude
-    sp04: exclude
-    sp20: exclude
-    sp69: exclude
-    rtmonusxtimes01: exclude
-    spedfsched02: exclude
-    psxtimes01: exclude
-    sprmsched01: exclude
-    sptimecounter02: exclude
-    sptimecounter04: exclude
-    ttest02: exclude
+    spcpucounter01: indeterminate
+    rtmonuse: indeterminate
+    sp37: indeterminate
+    sp68: indeterminate
+    sp04: indeterminate
+    sp20: indeterminate
+    sp69: indeterminate
+    rtmonusxtimes01: indeterminate
+    spedfsched02: indeterminate
+    spedfsched04: indeterminate
+    psxtimes01: indeterminate
+    sprmsched01: indeterminate
+    sptimecounter02: indeterminate
+    sptimecounter04: indeterminate
+    ttest02: indeterminate
+
+    # tests that pass nominally, but fail under Qemu when the host is under
+    # heavy load
+    psx12: indeterminate
+    spintrcritical03: indeterminate
+    spintrcritical04: indeterminate
+    spintrcritical05: indeterminate
 build-type: option
 copyrights:
 - Copyright (C) 2020 On-Line Applications Research (OAR)
-- 
2.20.1



More information about the devel mailing list