[rtems commit] spec/a53: Set conditionally failing test state

Joel Sherrill joel at rtems.org
Tue Nov 24 16:06:58 UTC 2020


Module:    rtems
Branch:    master
Commit:    22c3d4f2ed136a6e5376ae74d85cd75d2c5c6c1f
Changeset: http://git.rtems.org/rtems/commit/?id=22c3d4f2ed136a6e5376ae74d85cd75d2c5c6c1f

Author:    Kinsey Moore <kinsey.moore at oarcorp.com>
Date:      Tue Nov 17 15:25:38 2020 -0600

spec/a53: Set conditionally failing test state

The spintrcritical03-05 and psx12 tests are known to fail on Qemu when
the host system is heavily loaded. A single run of Qemu per core
during a testsuite run tends to yield positive results, but any
additional load on a system will result in test failures.

This patch also applies the correct expected test state for intermittent
failures so that those tests will still build.

---

 spec/build/bsps/aarch64/a53/tsta53.yml | 36 +++++++++++++++++++++-------------
 1 file changed, 22 insertions(+), 14 deletions(-)

diff --git a/spec/build/bsps/aarch64/a53/tsta53.yml b/spec/build/bsps/aarch64/a53/tsta53.yml
index a40cc86..9135fac 100644
--- a/spec/build/bsps/aarch64/a53/tsta53.yml
+++ b/spec/build/bsps/aarch64/a53/tsta53.yml
@@ -12,20 +12,28 @@ actions:
     spmisc01: exclude
 
     # tests that are passing intermittently
-    spcpucounter01: exclude
-    rtmonuse: exclude
-    sp37: exclude
-    sp68: exclude
-    sp04: exclude
-    sp20: exclude
-    sp69: exclude
-    rtmonusxtimes01: exclude
-    spedfsched02: exclude
-    psxtimes01: exclude
-    sprmsched01: exclude
-    sptimecounter02: exclude
-    sptimecounter04: exclude
-    ttest02: exclude
+    spcpucounter01: indeterminate
+    rtmonuse: indeterminate
+    sp37: indeterminate
+    sp68: indeterminate
+    sp04: indeterminate
+    sp20: indeterminate
+    sp69: indeterminate
+    rtmonusxtimes01: indeterminate
+    spedfsched02: indeterminate
+    spedfsched04: indeterminate
+    psxtimes01: indeterminate
+    sprmsched01: indeterminate
+    sptimecounter02: indeterminate
+    sptimecounter04: indeterminate
+    ttest02: indeterminate
+
+    # tests that pass nominally, but fail under Qemu when the host is under
+    # heavy load
+    psx12: indeterminate
+    spintrcritical03: indeterminate
+    spintrcritical04: indeterminate
+    spintrcritical05: indeterminate
 build-type: option
 copyrights:
 - Copyright (C) 2020 On-Line Applications Research (OAR)



More information about the vc mailing list