[RTEMS Project] #2963: Add a testsuite top level confguration file that is common to all tests.

[RTEMS trac]

#2963: Add a testsuite top level confguration file that is common to all tests.
-------------------------+------------------------------
 Reporter:  Chris Johns  |       Owner:  joel.sherrill@…
     Type:  defect       |      Status:  assigned
 Priority:  normal       |   Milestone:  4.12.0
Component:  testing      |     Version:  4.12
 Severity:  normal       |  Resolution:
 Keywords:  testing      |
-------------------------+------------------------------

Comment (by Chris Johns):

 I have never looked at the gcc testsuite and from what I have read about
 it was not flattering.

 I do not think adding 500+ files to state `fileio` is a `user-input` test
 and will never complete is not good. Maybe global is not a great word,
 maybe common is better. We need accurate data to determine the results of
 tests.

 It is similar to the work you have been doing to have a common linkercmd
 file where ever possible. It is the same thing or are you saying we should
 create a separate linker command file for every bsp as well? ;)

 Look at the results with a work in progress `rtems-test` for `erc32-run`:

 {{{
 Passed:        546
 Failed:          1
 User Input:      4
 Expected Fail:   0
 Indeterminate:   0
 Timeout:         6
 Invalid:         1
 ------------------
 Total:         558

 Failures:
  spcontext01.exe
 User Input:
  fileio.exe
  top.exe
  termios.exe
  monitor.exe
 Timeouts:
  jffs2_fssymlink.exe
  mrfs_fserror.exe
  dhrystone.exe
  fsdosfsformat01.exe
  imfs_fsrdwr.exe
  whetstone.exe
 Invalid:
  minimum.exe
 Average test time: 0:00:00.481800
 Testing time     : 0:04:28.844749
 }}}

 Note, the benchmark tests have broken parallel testing because of the time
 they now take.

--
Ticket URL: <http://devel.rtems.org/ticket/2963#comment:2>
RTEMS Project <http://www.rtems.org/>
RTEMS Project