Where are results of rtems-tester test results archived?

Chris Johns chrisj at rtems.org
Wed Sep 25 01:42:15 UTC 2019


On 25/9/19 1:08 am, Gedare Bloom wrote:
> On Sat, Sep 21, 2019 at 9:41 AM Joel Sherrill <joel at rtems.org> wrote:
>> On Sat, Sep 21, 2019, 10:18 AM <dufault at hda.com> wrote:
>>>> On Sep 21, 2019, at 11:03 , Joel Sherrill <joel at rtems.org> wrote:
>>>> On Sat, Sep 21, 2019, 9:55 AM Peter Dufault <dufault at hda.com> wrote:
>>>> I’ve searched but can’t find anywhere.  I’d like to see the results of the tests on all architectures to compare to what I see on PowerPC-beatnik.
>>>> There is a build@ mailing list and the archives are at https://lists.rtems.org/pipermail/build/
>>>> There should be results from at least me for psim.
>>>> You are encouraged to subscribe to the list and post results. Many boards have no results.
>>> That doesn’t look like what I want.  I’m looking for something like the following (a small snippet of my test run in progress) to see what failures are shared by what board support packages.
>>>
>>> [141/597] p:128 f:7   u:2   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: telnetd01.exe
>>> [142/597] p:129 f:7   u:2   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios.exe
>>> [143/597] p:129 f:7   u:3   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios01.exe
>>> [144/597] p:129 f:8   u:3   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios02.exe
>>> [145/597] p:129 f:9   u:3   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios03.exe
>>> [146/597] p:130 f:9   u:3   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios04.exe
>>> [147/597] p:131 f:9   u:3   e:0   I:0   B:3   t:0   i:0   W:0   | powerpc/beatnik: termios05.exe
>>
>> Most are for tools builds. I have a script I run periodically which includes tools and bsps. This is a psim results post: https://lists.rtems.org/pipermail/build/2019-August/002973.html
>>
>> It shows the failures but still doesn't show the in process view. Does that help at all?
>>
> Just to jump in, as I recall the "in process" view is not always
> useful, since it does not exactly tell you what has failed (when you
> run several tests in parallel, that is).  Collecting the end results
> of could be nice. 

Sorry, I am not following what is being said here. The tester collects the
results for a single run as shown in ...

https://lists.rtems.org/pipermail/build/2019-August/002970.html

which is ...

Summary
=======

Passed:        578
Failed:          2
User Input:      6
Expected Fail:   0
Indeterminate:   0
Benchmark:       3
Timeout:         0
Invalid:         0
Wrong Version:   0
Wrong Build:     0
Wrong Tools:     0
------------------
Total:         589

Failures:
 dl06.exe
 dl09.exe
User Input:
 dl10.exe
 monitor.exe
 termios.exe
 top.exe
 capture.exe
 fileio.exe
Benchmark:
 dhrystone.exe
 linpack.exe
 whetstone.exe

Are you asking for something across separate runs of the tester?

> Automating this and creating a colored status matrix
> would be a nice little project for someone.

Where would this be run and the data held?

Chris



More information about the devel mailing list