[PATCH] tester: Limit simultaneous QEMU jobs to 1

[Sebastian Huber]

On 30/08/2021 20:32, Kinsey Moore wrote:
> On 8/30/2021 12:12, Sebastian Huber wrote:
>> On 24/08/2021 20:45, Kinsey Moore wrote:
>>> diff --git a/tester/rtems/testing/bsps/a53_ilp32_qemu.ini 
>>> b/tester/rtems/testing/bsps/a53_ilp32_qemu.ini
>>> index 3beba06..581c59c 100644
>>> --- a/tester/rtems/testing/bsps/a53_ilp32_qemu.ini
>>> +++ b/tester/rtems/testing/bsps/a53_ilp32_qemu.ini
>>> @@ -36,3 +36,4 @@ bsp           = a53_ilp32_qemu
>>>   arch          = aarch64
>>>   tester        = %{_rtscripts}/qemu.cfg
>>>   bsp_qemu_opts = %{qemu_opts_base} -serial mon:stdio -machine 
>>> virt,gic-version=3 -cpu cortex-a53 -m 4096
>>> +jobs          = 1
>>
>> Does this overwrite the command line option or is this a default value?
>>
> When this is set in the tester configuration, the command line switch 
> has no effect but it can be overridden in the user-config.

Overruling the command line option is not that great. I have a vastly 
different test run duration with --jobs=1 vs. --jobs=48 with more or 
less the same test results. I think this option should be split into a 
"force-jobs" and "default-jobs" option.

Passed:        640
Failed:          8
User Input:      6
Expected Fail:   0
Indeterminate:   0
Benchmark:       3
Timeout:         0
Test too long:   0
Invalid:         0
Wrong Version:   0
Wrong Build:     0
Wrong Tools:     0
------------------
Total:         657
Failures:
  dl06.exe
  psx12.exe
  smpirqs01.exe
  spcpucounter01.exe
  sptimecounter02.exe
  ts-validation-0.exe
  dl09.exe
  minimum.exe
User Input:
  dl10.exe
  monitor.exe
  termios.exe
  top.exe
  fileio.exe
  capture.exe
Benchmark:
  whetstone.exe
  linpack.exe
  dhrystone.exe
Average test time: 0:00:00.088409
Testing time     : 0:00:58.084406

Passed:        642
Failed:          6
User Input:      6
Expected Fail:   0
Indeterminate:   0
Benchmark:       3
Timeout:         0
Test too long:   0
Invalid:         0
Wrong Version:   0
Wrong Build:     0
Wrong Tools:     0
------------------
Total:         657
Failures:
  dl06.exe
  psx12.exe
  smpirqs01.exe
  ts-validation-0.exe
  dl09.exe
  minimum.exe
User Input:
  dl10.exe
  monitor.exe
  termios.exe
  top.exe
  capture.exe
  fileio.exe
Benchmark:
  dhrystone.exe
  linpack.exe
  whetstone.exe
Average test time: 0:00:01.232188
Testing time     : 0:13:29.547340

-- 
embedded brains GmbH
Herr Sebastian HUBER
Dornierstr. 4
82178 Puchheim
Germany
email: sebastian.huber at embedded-brains.de
phone: +49-89-18 94 741 - 16
fax:   +49-89-18 94 741 - 08

Registergericht: Amtsgericht München
Registernummer: HRB 157899
Vertretungsberechtigte Geschäftsführer: Peter Rasmussen, Thomas Dörfler
Unsere Datenschutzerklärung finden Sie hier:
https://embedded-brains.de/datenschutzerklaerung/