[ESA summer of code, 2014] RTEMS testing

[Gedare Bloom]

On Tue, May 13, 2014 at 11:21 AM, Kumar Amit Mehta <gmate.amit at gmail.com> wrote:
> Hi,
>
> I've some queries regarding the testing framework for rtems.
>
> 1: There seem to be two different set of framework and set of tests.
> First one [1] is part of rtems package itself and the second one [2]
> seem to have a different git repository and is written in Python.
> How are these two different ?
>
The testsuites are the test cases written to run in RTEMS. The
rtems-tools/tester project (aka rtems-test) executes these test cases
for particular target BSPs. You can think of rtems-test as the
"driver" that does the testing, where testsuites are the tests
themselves.

> 2: I ran the simple hello world test case on the simulator, then
> I also ran all those ~490 test cases that were part of rtems-tools
> tests[2]. According to the information on the ESA summer of code page
> of RTEMS [4], RTEMS testing using 'C' and 'C++' (seems like cmock is
> the favorite right now [3]) is a prospective candidate for ESA summer
> of code. I just want to be sure that It is still the case, Therefore,
> CC'd mentors for RTEMS testing [4] here.
>
The goal at present is to improve the rtems-test to include additional
BSPs and to subsume the previous approach of testing on BSPs that used
mostly shell scripts located in the git.rtems.org/rtems-testing.git
repository under sim-scripts directory. There were a couple of emails
about this a couple days ago in rtems-devel mailing list, start with
this thread: http://www.rtems.org/pipermail/rtems-devel/2014-May/006689.html

> 3: Is there a guide or link on running rtems test suite [1] (I ran
> the modified hello world program on the simulator, but was wondering,
> If those standalone test cases can be run as a batch, one after
> another)
>
That's exactly the purpose of rtems-test, to run the test cases in a
batch. So you have already done this, hooray!

> [1] http://git.rtems.org/rtems/tree/testsuites
> [2] git://git.rtems.org/rtems-tools.git
> [3] http://www.rtems.org/wiki/index.php/TestingReview
> [4] http://www.rtems.org/wiki/index.php/RTEMS_Testing
>
> Thanks,
> Kumar
> _______________________________________________
> rtems-users mailing list
> rtems-users at rtems.org
> http://www.rtems.org/mailman/listinfo/rtems-users