Difference between revisions of "The Samba Selftest System"

(Presentation Introduction and overview)
(more links to help everyone find stuff)
Line 5: Line 5:
 
Also see Andreas Schneider's [https://www.samba.org/~asn/sambaxp-2015-andreas_schneider-selftest.pdf SambaXP 2015 presentation] [https://sambaxp.org/archive_data/SambaXP2015-AUDIO1/thu/track3/sambaxp2015-thu-track3-Andreas_Schneider-HowToUseTheSambaSelftestSuite.mp3 Audio]
 
Also see Andreas Schneider's [https://www.samba.org/~asn/sambaxp-2015-andreas_schneider-selftest.pdf SambaXP 2015 presentation] [https://sambaxp.org/archive_data/SambaXP2015-AUDIO1/thu/track3/sambaxp2015-thu-track3-Andreas_Schneider-HowToUseTheSambaSelftestSuite.mp3 Audio]
  
=Public CI=
+
=[[Autobuild]]=
As of 2018 there's now also a Samba CI instance on gitlab, available for Samba team members and outside contributors: [[Samba CI on gitlab]].
+
 
 +
[[Autobuild]] is the top *Pure Samba* layer in the selftest system.
 +
 
 +
=Public CI using GitLab CI=
 +
There's now also a Samba CI instance on gitlab, available for Samba team members and outside contributors: [[Samba CI on gitlab]].  This is the next layer up, controlled by the <code>.gitlab-ci.yml</code> file in the repository, this runs [[Autobuild]].
 +
 
 +
=[[Understanding make test|make test]]=
 +
 
 +
The next layer is <code>make test</code> which invokes <code>selftest.pl</code> and filters the results via [[subunit]].
  
 
=Subunit=
 
=Subunit=
  
Samba's selftest system is based on [[Subunit]]
+
Samba's selftest system is based on [[Subunit]] output streams, to describe tests that pass, fail and are flapping.

Revision as of 23:20, 4 June 2020

Presentation Introduction and overview

Andrew Bartlett's Two years with Samba's autobuild presentation at Linux.conf.au 2012 is a good place to start understanding our automated test and CI infrastructure. Youtube.

Also see Andreas Schneider's SambaXP 2015 presentation Audio

Autobuild

Autobuild is the top *Pure Samba* layer in the selftest system.

Public CI using GitLab CI

There's now also a Samba CI instance on gitlab, available for Samba team members and outside contributors: Samba CI on gitlab. This is the next layer up, controlled by the .gitlab-ci.yml file in the repository, this runs Autobuild.

make test

The next layer is make test which invokes selftest.pl and filters the results via subunit.

Subunit

Samba's selftest system is based on Subunit output streams, to describe tests that pass, fail and are flapping.