Test Infrastructure Sprint

  • drop the samba3/samba4 distinction?
  • randomize test order [mat]
  • statistics!
    • measure total run time and per test run time
    • prevent slow test addition
    • record env startup time [jelmer]
  • make testsuite output top X [mat]
  • reduce the cardinality of RPC tests
  • parallelize with testr [jelmer]
    • migrate to subunit2
    • make all tests support --list
    • require all tests output subunit
    • reduce selftest run overhead
      • make symbol deduplication a test, not a build phase
  • documentation
  • simplification of test run infrastructure