Application Configuration Tests?

[Sebastian Huber]

Hello,

we have about 147 documented configuration options (see attached file). 
We probably need a test case for the minimum, default, and maximum 
value. Some defines have boolean values. Lets assume three test cases 
per option. So, about 500 tests. Should we use full test programs which 
run on the target for the tests or should I try to use C preprocess or 
compile only tests? For example we could C preprocess a file and then 
grep for a certain pattern. We could also compile the configuration file 
and use GDB to pretty print the relevant data structures and then 
compare it with a pattern.

-- 
Sebastian Huber, embedded brains GmbH

Address : Dornierstr. 4, D-82178 Puchheim, Germany
Phone   : +49 89 189 47 41-16
Fax     : +49 89 189 47 41-09
E-Mail  : sebastian.huber at embedded-brains.de
PGP     : Public key available on request.

Diese Nachricht ist keine geschäftliche Mitteilung im Sinne des EHUG.
-------------- next part --------------
CONFIGURE_APPLICATION_DISABLE_FILESYSTEM
CONFIGURE_APPLICATION_DOES_NOT_NEED_CLOCK_DRIVER
CONFIGURE_APPLICATION_EXTRA_DRIVERS
CONFIGURE_APPLICATION_NEEDS_CLOCK_DRIVER
CONFIGURE_APPLICATION_NEEDS_CONSOLE_DRIVER
CONFIGURE_APPLICATION_NEEDS_FRAME_BUFFER_DRIVER
CONFIGURE_APPLICATION_NEEDS_LIBBLOCK
CONFIGURE_APPLICATION_NEEDS_NULL_DRIVER
CONFIGURE_APPLICATION_NEEDS_RTC_DRIVER
CONFIGURE_APPLICATION_NEEDS_SIMPLE_CONSOLE_DRIVER
CONFIGURE_APPLICATION_NEEDS_SIMPLE_TASK_CONSOLE_DRIVER
CONFIGURE_APPLICATION_NEEDS_STUB_DRIVER
CONFIGURE_APPLICATION_NEEDS_TIMER_DRIVER
CONFIGURE_APPLICATION_NEEDS_WATCHDOG_DRIVER
CONFIGURE_APPLICATION_NEEDS_ZERO_DRIVER
CONFIGURE_APPLICATION_PREREQUISITE_DRIVERS
CONFIGURE_BDBUF_BUFFER_COUNT
CONFIGURE_BDBUF_BUFFER_MAX_SIZE
CONFIGURE_BDBUF_BUFFER_MIN_SIZE
CONFIGURE_BDBUF_BUFFER_SIZE
CONFIGURE_BDBUF_CACHE_MEMORY_SIZE
CONFIGURE_BDBUF_MAX_READ_AHEAD_BLOCKS
CONFIGURE_BDBUF_MAX_WRITE_BLOCKS
CONFIGURE_BDBUF_READ_AHEAD_TASK_PRIORITY
CONFIGURE_BDBUF_TASK_STACK_SIZE
CONFIGURE_BSP_PREREQUISITE_DRIVERS
CONFIGURE_DISABLE_BSP_SETTINGS
CONFIGURE_DISABLE_CLASSIC_API_NOTEPADS
CONFIGURE_ENABLE_GO
CONFIGURE_EXTRA_TASK_STACKS
CONFIGURE_GNAT_RTEMS
CONFIGURE_HAS_OWN_BDBUF_TABLE
CONFIGURE_HAS_OWN_CONFIGURATION_TABLE
CONFIGURE_HAS_OWN_DEVICE_DRIVER_TABLE
CONFIGURE_HAS_OWN_INIT_TASK_TABLE
CONFIGURE_HAS_OWN_MOUNT_TABLE
CONFIGURE_HAS_OWN_MULTIPROCESSING_TABLE
CONFIGURE_IDLE_TASK_BODY
CONFIGURE_IDLE_TASK_INITIALIZES_APPLICATION
CONFIGURE_IDLE_TASK_STACK_SIZE
CONFIGURE_IMFS_DISABLE_CHMOD
CONFIGURE_IMFS_DISABLE_CHOWN
CONFIGURE_IMFS_DISABLE_LINK
CONFIGURE_IMFS_DISABLE_MKNOD
CONFIGURE_IMFS_DISABLE_MKNOD_FILE
CONFIGURE_IMFS_DISABLE_MOUNT
CONFIGURE_IMFS_DISABLE_READDIR
CONFIGURE_IMFS_DISABLE_READLINK
CONFIGURE_IMFS_DISABLE_RENAME
CONFIGURE_IMFS_DISABLE_RMNOD
CONFIGURE_IMFS_DISABLE_SYMLINK
CONFIGURE_IMFS_DISABLE_UNMOUNT
CONFIGURE_IMFS_DISABLE_UTIME
CONFIGURE_IMFS_MEMFILE_BYTES_PER_BLOCK
CONFIGURE_INITIAL_EXTENSIONS
CONFIGURE_INIT_TASK_ARGUMENTS
CONFIGURE_INIT_TASK_ATTRIBUTES
CONFIGURE_INIT_TASK_ENTRY_POINT
CONFIGURE_INIT_TASK_INITIAL_MODES
CONFIGURE_INIT_TASK_NAME
CONFIGURE_INIT_TASK_PRIORITY
CONFIGURE_INIT_TASK_STACK_SIZE
CONFIGURE_INTERRUPT_STACK_SIZE
CONFIGURE_LIBIO_MAXIMUM_FILE_DESCRIPTORS
CONFIGURE_MALLOC_BSP_SUPPORTS_SBRK
CONFIGURE_MAXIMUM_ADA_TASKS
CONFIGURE_MAXIMUM_BARRIERS
CONFIGURE_MAXIMUM_DEVICES
CONFIGURE_MAXIMUM_DRIVERS
CONFIGURE_MAXIMUM_FAKE_ADA_TASKS
CONFIGURE_MAXIMUM_GO_CHANNELS
CONFIGURE_MAXIMUM_GOROUTINES
CONFIGURE_MAXIMUM_MESSAGE_QUEUES
CONFIGURE_MAXIMUM_MRSP_SEMAPHORES
CONFIGURE_MAXIMUM_PARTITIONS
CONFIGURE_MAXIMUM_PERIODS
CONFIGURE_MAXIMUM_PORTS
CONFIGURE_MAXIMUM_POSIX_BARRIERS
CONFIGURE_MAXIMUM_POSIX_CONDITION_VARIABLES
CONFIGURE_MAXIMUM_POSIX_KEYS
CONFIGURE_MAXIMUM_POSIX_KEY_VALUE_PAIRS
CONFIGURE_MAXIMUM_POSIX_MESSAGE_QUEUE_DESCRIPTORS
CONFIGURE_MAXIMUM_POSIX_MESSAGE_QUEUES
CONFIGURE_MAXIMUM_POSIX_MUTEXES
CONFIGURE_MAXIMUM_POSIX_QUEUED_SIGNALS
CONFIGURE_MAXIMUM_POSIX_RWLOCKS
CONFIGURE_MAXIMUM_POSIX_SEMAPHORES
CONFIGURE_MAXIMUM_POSIX_SPINLOCKS
CONFIGURE_MAXIMUM_POSIX_THREADS
CONFIGURE_MAXIMUM_POSIX_TIMERS
CONFIGURE_MAXIMUM_PRIORITY
CONFIGURE_MAXIMUM_PROCESSORS
CONFIGURE_MAXIMUM_REGIONS
CONFIGURE_MAXIMUM_SEMAPHORES
CONFIGURE_MAXIMUM_TASKS
CONFIGURE_MAXIMUM_THREAD_NAME_SIZE
CONFIGURE_MAXIMUM_TIMERS
CONFIGURE_MAXIMUM_USER_EXTENSIONS
CONFIGURE_MEMORY_OVERHEAD
CONFIGURE_MESSAGE_BUFFER_MEMORY
CONFIGURE_MESSAGE_BUFFERS_FOR_QUEUE
CONFIGURE_MICROSECONDS_PER_TICK
CONFIGURE_MINIMUM_POSIX_THREAD_STACK_SIZE
CONFIGURE_MINIMUM_TASK_STACK_SIZE
CONFIGURE_MP_APPLICATION
CONFIGURE_MP_MAXIMUM_GLOBAL_OBJECTS
CONFIGURE_MP_MAXIMUM_NODES
CONFIGURE_MP_MAXIMUM_PROXIES
CONFIGURE_MP_MPCI_TABLE_POINTER
CONFIGURE_MP_NODE_NUMBER
CONFIGURE_NUMBER_OF_TERMIOS_PORTS
CONFIGURE_POSIX_HAS_OWN_INIT_THREAD_TABLE
CONFIGURE_POSIX_INIT_THREAD_ENTRY_POINT
CONFIGURE_POSIX_INIT_THREAD_STACK_SIZE
CONFIGURE_POSIX_INIT_THREAD_TABLE
CONFIGURE_RECORD_EXTENSIONS_ENABLED
CONFIGURE_RECORD_PER_PROCESSOR_ITEMS
CONFIGURE_RTEMS_INIT_TASKS_TABLE
CONFIGURE_SCHEDULER_CBS
CONFIGURE_SCHEDULER_EDF
CONFIGURE_SCHEDULER_EDF_SMP
CONFIGURE_SCHEDULER_NAME
CONFIGURE_SCHEDULER_PRIORITY
CONFIGURE_SCHEDULER_PRIORITY_AFFINITY_SMP
CONFIGURE_SCHEDULER_PRIORITY_SMP
CONFIGURE_SCHEDULER_SIMPLE
CONFIGURE_SCHEDULER_SIMPLE_SMP
CONFIGURE_SCHEDULER_USER
CONFIGURE_SMP_APPLICATION
CONFIGURE_SMP_MAXIMUM_PROCESSORS
CONFIGURE_STACK_CHECKER_ENABLED
CONFIGURE_SWAPOUT_BLOCK_HOLD
CONFIGURE_SWAPOUT_SWAP_PERIOD
CONFIGURE_SWAPOUT_TASK_PRIORITY
CONFIGURE_SWAPOUT_WORKER_TASK_PRIORITY
CONFIGURE_SWAPOUT_WORKER_TASKS
CONFIGURE_TASK_STACK_ALLOCATOR
CONFIGURE_TASK_STACK_ALLOCATOR_INIT
CONFIGURE_TASK_STACK_DEALLOCATOR
CONFIGURE_TERMIOS_DISABLED
CONFIGURE_TICKS_PER_TIMESLICE
CONFIGURE_UNIFIED_WORK_AREAS
CONFIGURE_UNLIMITED_ALLOCATION_SIZE
CONFIGURE_UNLIMITED_OBJECTS
CONFIGURE_USE_DEVFS_AS_BASE_FILESYSTEM
CONFIGURE_USE_MINIIMFS_AS_BASE_FILESYSTEM
CONFIGURE_ZERO_WORKSPACE_AUTOMATICALLY