[riot-commits] [RIOT-OS/RIOT] 622fe2: tests/pthread_rwlock: run the test in CI

Kaspar Schleiser noreply at github.com
Wed Aug 21 15:32:50 CEST 2019


  Branch: refs/heads/master
  Home:   https://github.com/RIOT-OS/RIOT
  Commit: 622fe2c28f35fe0c2f472f6d92e835680286fa6b
      https://github.com/RIOT-OS/RIOT/commit/622fe2c28f35fe0c2f472f6d92e835680286fa6b
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/pthread_rwlock/Makefile

  Log Message:
  -----------
  tests/pthread_rwlock: run the test in CI

HACK, the test currently fails in CI for `native` due to `utf-8` handling.
HACK, the test implementation can fail due being de-scheduled during printf.


  Commit: 095268a33aa61ea6914ccc8160349302a8a6cc40
      https://github.com/RIOT-OS/RIOT/commit/095268a33aa61ea6914ccc8160349302a8a6cc40
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/netstats_l2/Makefile

  Log Message:
  -----------
  tests/netstats_l2: run the test in CI

HACK, blacklist native as it fails to create a tun interface in murdock.


  Commit: 12d4b71c318f10ab139f27dde0eef37a1029d845
      https://github.com/RIOT-OS/RIOT/commit/12d4b71c318f10ab139f27dde0eef37a1029d845
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/socket_zep/Makefile

  Log Message:
  -----------
  tests/socket_zep: define TEST_ON_CI_BLACKLIST

HACK, the test currently fails in CI for 'native' due to binding issue


  Commit: f7176f425fe012dc0caa7e0ea80c59d6a71ddd36
      https://github.com/RIOT-OS/RIOT/commit/f7176f425fe012dc0caa7e0ea80c59d6a71ddd36
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/gnrc_ipv6_ext/Makefile
    M tests/gnrc_rpl_srh/Makefile
    M tests/gnrc_sock_dns/Makefile

  Log Message:
  -----------
  tests/gnrc: disable tests that need setup and root

Disable running tests that need a setup and run with root as they cannot
currently be run in CI.


  Commit: 1f1184362317fb6590f9bc9aefae623d2b9e110d
      https://github.com/RIOT-OS/RIOT/commit/1f1184362317fb6590f9bc9aefae623d2b9e110d
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/pkg_fatfs_vfs/Makefile

  Log Message:
  -----------
  tests/pkg_fatfs_vfs: disable tests that need setup

The test need a manual setup that cannot currently be done in CI.


  Commit: 084c6f739dcbd4459bc5bf698f7bb20db95dcde2
      https://github.com/RIOT-OS/RIOT/commit/084c6f739dcbd4459bc5bf698f7bb20db95dcde2
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/lwip/Makefile

  Log Message:
  -----------
  tests/lwip: disable failing test

The test fails on both murdock and on my machine due to the process
exiting directly.

pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.


  Commit: 1e6ac084231d3341381370e19c9d991de549e9d9
      https://github.com/RIOT-OS/RIOT/commit/1e6ac084231d3341381370e19c9d991de549e9d9
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M makefiles/murdock.inc.mk

  Log Message:
  -----------
  murdock: only set test is enabled if there are tests

Only set `TEST_ON_CI_ENABLED` if the application has tests.
Currently `TEST_ON_CI_WHITELIST` was only set if there were tests.

This is a pre-step to have `TEST_ON_CI_WHITELIST` being `all` by
default.


  Commit: 1292d96feb909d611143dad60d41fa71ff96eeec
      https://github.com/RIOT-OS/RIOT/commit/1292d96feb909d611143dad60d41fa71ff96eeec
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M makefiles/murdock.inc.mk

  Log Message:
  -----------
  makefiles/murdock.inc.mk: change policy to run tests by default

By default if a test is available and not blacklisted it will be run by
murdock.

This will move from a whitelisting everything that works, to
blacklisting what fails. This way, failing tests will be easier to
track instead of being silently just not run.

It could even allow introducing failing tests before a fix is available.


  Commit: 8e5422ff78e931f3f295d928da175a0d6cf0af58
      https://github.com/RIOT-OS/RIOT/commit/8e5422ff78e931f3f295d928da175a0d6cf0af58
  Author: Gaëtan Harter <gaetan.harter at fu-berlin.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M tests/bench_msg_pingpong/Makefile
    M tests/bench_mutex_pingpong/Makefile
    M tests/bench_runtime_coreapis/Makefile
    M tests/bench_sched_nop/Makefile
    M tests/bench_sizeof_coretypes/Makefile
    M tests/bench_thread_flags_pingpong/Makefile
    M tests/bench_thread_yield_pingpong/Makefile
    M tests/bitarithm_timings/Makefile
    M tests/bloom_bytes/Makefile
    M tests/buttons/Makefile
    M tests/cb_mux/Makefile
    M tests/cb_mux_bench/Makefile
    M tests/cpp11_condition_variable/Makefile
    M tests/cpp11_mutex/Makefile
    M tests/cpp11_thread/Makefile
    M tests/devfs/Makefile
    M tests/embunit/Makefile
    M tests/event_wait_timeout/Makefile
    M tests/events/Makefile
    M tests/evtimer_msg/Makefile
    M tests/evtimer_underflow/Makefile
    M tests/float/Makefile
    M tests/fmt_print/Makefile
    M tests/gnrc_ipv6_ext/Makefile
    M tests/gnrc_ipv6_fwd_w_sub/Makefile
    M tests/gnrc_ipv6_nib/Makefile
    M tests/gnrc_ipv6_nib_6ln/Makefile
    M tests/gnrc_ndp/Makefile
    M tests/gnrc_netif/Makefile
    M tests/gnrc_rpl_srh/Makefile
    M tests/gnrc_sixlowpan/Makefile
    M tests/gnrc_sixlowpan_frag/Makefile
    M tests/gnrc_sock_dns/Makefile
    M tests/gnrc_sock_ip/Makefile
    M tests/gnrc_sock_udp/Makefile
    M tests/irq/Makefile
    M tests/isr_yield_higher/Makefile
    M tests/l2util/Makefile
    M tests/libc_newlib/Makefile
    M tests/libfixmath/Makefile
    M tests/log_printfnoformat/Makefile
    M tests/lua_loader/Makefile
    M tests/lwip/Makefile
    M tests/lwip_sock_ip/Makefile
    M tests/msg_avail/Makefile
    M tests/msg_send_receive/Makefile
    M tests/msg_try_receive/Makefile
    M tests/mutex_order/Makefile
    M tests/mutex_unlock_and_sleep/Makefile
    M tests/netdev_test/Makefile
    M tests/netstats_l2/Makefile
    M tests/nhdp/Makefile
    M tests/od/Makefile
    M tests/periph_hwrng/Makefile
    M tests/periph_timer/Makefile
    M tests/pipe/Makefile
    M tests/pkg_c25519/Makefile
    M tests/pkg_cayenne-lpp/Makefile
    M tests/pkg_cmsis-dsp/Makefile
    M tests/pkg_cn-cbor/Makefile
    M tests/pkg_fatfs_vfs/Makefile
    M tests/pkg_hacl/Makefile
    M tests/pkg_heatshrink/Makefile
    M tests/pkg_jsmn/Makefile
    M tests/pkg_libb2/Makefile
    M tests/pkg_libcoap/Makefile
    M tests/pkg_libhydrogen/Makefile
    M tests/pkg_littlefs/Makefile
    M tests/pkg_lora-serialization/Makefile
    M tests/pkg_micro-ecc-with-hwrng/Makefile
    M tests/pkg_micro-ecc/Makefile
    M tests/pkg_minmea/Makefile
    M tests/pkg_monocypher/Makefile
    M tests/pkg_nanocbor/Makefile
    M tests/pkg_qdsa/Makefile
    M tests/pkg_relic/Makefile
    M tests/pkg_spiffs/Makefile
    M tests/pkg_tiny-asn1/Makefile
    M tests/pkg_tinycbor/Makefile
    M tests/pkg_tinycrypt/Makefile
    M tests/pkg_u8g2/Makefile
    M tests/pkg_ubasic/Makefile
    M tests/pkg_umorse/Makefile
    M tests/posix_semaphore/Makefile
    M tests/posix_time/Makefile
    M tests/ps_schedstatistics/Makefile
    M tests/pthread/Makefile
    M tests/pthread_barrier/Makefile
    M tests/pthread_cleanup/Makefile
    M tests/pthread_condition_variable/Makefile
    M tests/pthread_cooperation/Makefile
    M tests/pthread_rwlock/Makefile
    M tests/pthread_tls/Makefile
    M tests/riotboot/Makefile
    M tests/rmutex/Makefile
    M tests/sched_testing/Makefile
    M tests/shell/Makefile
    M tests/socket_zep/Makefile
    M tests/ssp/Makefile
    M tests/stdin/Makefile
    M tests/struct_tm_utility/Makefile
    M tests/thread_basic/Makefile
    M tests/thread_cooperation/Makefile
    M tests/thread_exit/Makefile
    M tests/thread_flags/Makefile
    M tests/thread_flags_xtimer/Makefile
    M tests/thread_flood/Makefile
    M tests/thread_msg/Makefile
    M tests/thread_msg_block_race/Makefile
    M tests/thread_msg_block_w_queue/Makefile
    M tests/thread_msg_block_wo_queue/Makefile
    M tests/thread_race/Makefile
    M tests/trace/Makefile
    M tests/trickle/Makefile
    M tests/unittests/Makefile
    M tests/warn_conflict/Makefile
    M tests/xtimer_hang/Makefile
    M tests/xtimer_msg/Makefile
    M tests/xtimer_msg_receive_timeout/Makefile
    M tests/xtimer_mutex_lock_timeout/Makefile
    M tests/xtimer_now64_continuity/Makefile
    M tests/xtimer_periodic_wakeup/Makefile
    M tests/xtimer_remove/Makefile
    M tests/xtimer_reset/Makefile
    M tests/xtimer_usleep/Makefile
    M tests/xtimer_usleep_short/Makefile

  Log Message:
  -----------
  applications: remove 'TEST_ON_CI_WHITELIST += all'

This is now the default so not required anymore.


  Commit: 8f7009e4f949edd751b091928a58a761f2dc47e9
      https://github.com/RIOT-OS/RIOT/commit/8f7009e4f949edd751b091928a58a761f2dc47e9
  Author: Kaspar Schleiser <kaspar at schleiser.de>
  Date:   2019-08-21 (Wed, 21 Aug 2019)

  Changed paths:
    M makefiles/murdock.inc.mk
    M tests/bench_msg_pingpong/Makefile
    M tests/bench_mutex_pingpong/Makefile
    M tests/bench_runtime_coreapis/Makefile
    M tests/bench_sched_nop/Makefile
    M tests/bench_sizeof_coretypes/Makefile
    M tests/bench_thread_flags_pingpong/Makefile
    M tests/bench_thread_yield_pingpong/Makefile
    M tests/bitarithm_timings/Makefile
    M tests/bloom_bytes/Makefile
    M tests/buttons/Makefile
    M tests/cb_mux/Makefile
    M tests/cb_mux_bench/Makefile
    M tests/cpp11_condition_variable/Makefile
    M tests/cpp11_mutex/Makefile
    M tests/cpp11_thread/Makefile
    M tests/devfs/Makefile
    M tests/embunit/Makefile
    M tests/event_wait_timeout/Makefile
    M tests/events/Makefile
    M tests/evtimer_msg/Makefile
    M tests/evtimer_underflow/Makefile
    M tests/float/Makefile
    M tests/fmt_print/Makefile
    M tests/gnrc_ipv6_ext/Makefile
    M tests/gnrc_ipv6_fwd_w_sub/Makefile
    M tests/gnrc_ipv6_nib/Makefile
    M tests/gnrc_ipv6_nib_6ln/Makefile
    M tests/gnrc_ndp/Makefile
    M tests/gnrc_netif/Makefile
    M tests/gnrc_rpl_srh/Makefile
    M tests/gnrc_sixlowpan/Makefile
    M tests/gnrc_sixlowpan_frag/Makefile
    M tests/gnrc_sock_dns/Makefile
    M tests/gnrc_sock_ip/Makefile
    M tests/gnrc_sock_udp/Makefile
    M tests/irq/Makefile
    M tests/isr_yield_higher/Makefile
    M tests/l2util/Makefile
    M tests/libc_newlib/Makefile
    M tests/libfixmath/Makefile
    M tests/log_printfnoformat/Makefile
    M tests/lua_loader/Makefile
    M tests/lwip/Makefile
    M tests/lwip_sock_ip/Makefile
    M tests/msg_avail/Makefile
    M tests/msg_send_receive/Makefile
    M tests/msg_try_receive/Makefile
    M tests/mutex_order/Makefile
    M tests/mutex_unlock_and_sleep/Makefile
    M tests/netdev_test/Makefile
    M tests/netstats_l2/Makefile
    M tests/nhdp/Makefile
    M tests/od/Makefile
    M tests/periph_hwrng/Makefile
    M tests/periph_timer/Makefile
    M tests/pipe/Makefile
    M tests/pkg_c25519/Makefile
    M tests/pkg_cayenne-lpp/Makefile
    M tests/pkg_cmsis-dsp/Makefile
    M tests/pkg_cn-cbor/Makefile
    M tests/pkg_fatfs_vfs/Makefile
    M tests/pkg_hacl/Makefile
    M tests/pkg_heatshrink/Makefile
    M tests/pkg_jsmn/Makefile
    M tests/pkg_libb2/Makefile
    M tests/pkg_libcoap/Makefile
    M tests/pkg_libhydrogen/Makefile
    M tests/pkg_littlefs/Makefile
    M tests/pkg_lora-serialization/Makefile
    M tests/pkg_micro-ecc-with-hwrng/Makefile
    M tests/pkg_micro-ecc/Makefile
    M tests/pkg_minmea/Makefile
    M tests/pkg_monocypher/Makefile
    M tests/pkg_nanocbor/Makefile
    M tests/pkg_qdsa/Makefile
    M tests/pkg_relic/Makefile
    M tests/pkg_spiffs/Makefile
    M tests/pkg_tiny-asn1/Makefile
    M tests/pkg_tinycbor/Makefile
    M tests/pkg_tinycrypt/Makefile
    M tests/pkg_u8g2/Makefile
    M tests/pkg_ubasic/Makefile
    M tests/pkg_umorse/Makefile
    M tests/posix_semaphore/Makefile
    M tests/posix_time/Makefile
    M tests/ps_schedstatistics/Makefile
    M tests/pthread/Makefile
    M tests/pthread_barrier/Makefile
    M tests/pthread_cleanup/Makefile
    M tests/pthread_condition_variable/Makefile
    M tests/pthread_cooperation/Makefile
    M tests/pthread_rwlock/Makefile
    M tests/pthread_tls/Makefile
    M tests/riotboot/Makefile
    M tests/rmutex/Makefile
    M tests/sched_testing/Makefile
    M tests/shell/Makefile
    M tests/socket_zep/Makefile
    M tests/ssp/Makefile
    M tests/stdin/Makefile
    M tests/struct_tm_utility/Makefile
    M tests/thread_basic/Makefile
    M tests/thread_cooperation/Makefile
    M tests/thread_exit/Makefile
    M tests/thread_flags/Makefile
    M tests/thread_flags_xtimer/Makefile
    M tests/thread_flood/Makefile
    M tests/thread_msg/Makefile
    M tests/thread_msg_block_race/Makefile
    M tests/thread_msg_block_w_queue/Makefile
    M tests/thread_msg_block_wo_queue/Makefile
    M tests/thread_race/Makefile
    M tests/trace/Makefile
    M tests/trickle/Makefile
    M tests/unittests/Makefile
    M tests/warn_conflict/Makefile
    M tests/xtimer_hang/Makefile
    M tests/xtimer_msg/Makefile
    M tests/xtimer_msg_receive_timeout/Makefile
    M tests/xtimer_mutex_lock_timeout/Makefile
    M tests/xtimer_now64_continuity/Makefile
    M tests/xtimer_periodic_wakeup/Makefile
    M tests/xtimer_remove/Makefile
    M tests/xtimer_reset/Makefile
    M tests/xtimer_usleep/Makefile
    M tests/xtimer_usleep_short/Makefile

  Log Message:
  -----------
  Merge pull request #11680 from cladmi/pr/ci/change_testing_policy

makefiles/murdock.inc.mk: change policy to run tests by default


Compare: https://github.com/RIOT-OS/RIOT/compare/8e08748c60e6...8f7009e4f949


More information about the commits mailing list