[ESA summer of code, 2014] RTEMS testing

[Kumar Amit Mehta]

On Tue, May 13, 2014 at 11:41:00AM -0400, Gedare Bloom wrote:
> On Tue, May 13, 2014 at 11:21 AM, Kumar Amit Mehta <gmate.amit at gmail.com> wrote:
> > Hi,
> >
> > I've some queries regarding the testing framework for rtems.
> >
> > 1: There seem to be two different set of framework and set of tests.
> > First one [1] is part of rtems package itself and the second one [2]
> > seem to have a different git repository and is written in Python.
> > How are these two different ?
> >
> The testsuites are the test cases written to run in RTEMS. The
> rtems-tools/tester project (aka rtems-test) executes these test cases
> for particular target BSPs. You can think of rtems-test as the
> "driver" that does the testing, where testsuites are the tests
> themselves.
> 
> > 2: I ran the simple hello world test case on the simulator, then
> > I also ran all those ~490 test cases that were part of rtems-tools
> > tests[2]. According to the information on the ESA summer of code page
> > of RTEMS [4], RTEMS testing using 'C' and 'C++' (seems like cmock is
> > the favorite right now [3]) is a prospective candidate for ESA summer
> > of code. I just want to be sure that It is still the case, Therefore,
> > CC'd mentors for RTEMS testing [4] here.
> >
> The goal at present is to improve the rtems-test to include additional
> BSPs and to subsume the previous approach of testing on BSPs that used
> mostly shell scripts located in the git.rtems.org/rtems-testing.git
> repository under sim-scripts directory. There were a couple of emails
> about this a couple days ago in rtems-devel mailing list, start with
> this thread: http://www.rtems.org/pipermail/rtems-devel/2014-May/006689.html
> 
> > 3: Is there a guide or link on running rtems test suite [1] (I ran
> > the modified hello world program on the simulator, but was wondering,
> > If those standalone test cases can be run as a batch, one after
> > another)
> >
> That's exactly the purpose of rtems-test, to run the test cases in a
> batch. So you have already done this, hooray!

Thank you so much for clearing my doubts.

Thanks,
Kumar