The Samba Selftest System: Difference between revisions

From SambaWiki
(Add link to subunit page in Presentation Introduction and overview)
(3 intermediate revisions by 2 users not shown)
Line 4: Line 4:


Also see Andreas Schneider's [https://www.samba.org/~asn/sambaxp-2015-andreas_schneider-selftest.pdf SambaXP 2015 presentation] [https://sambaxp.org/archive_data/SambaXP2015-AUDIO1/thu/track3/sambaxp2015-thu-track3-Andreas_Schneider-HowToUseTheSambaSelftestSuite.mp3 Audio]
Also see Andreas Schneider's [https://www.samba.org/~asn/sambaxp-2015-andreas_schneider-selftest.pdf SambaXP 2015 presentation] [https://sambaxp.org/archive_data/SambaXP2015-AUDIO1/thu/track3/sambaxp2015-thu-track3-Andreas_Schneider-HowToUseTheSambaSelftestSuite.mp3 Audio]

=[[Autobuild]]=

[[Autobuild]] is the top ''Pure Samba'' layer in the selftest system.

=Public CI using GitLab CI=
There's now also a Samba CI instance on gitlab, available for Samba team members and outside contributors: [[Samba CI on gitlab]]. This is the next layer up, controlled by the <code>.gitlab-ci.yml</code> file in the repository, this runs [[Autobuild]].

=[[Understanding make test|make test]]=

The next layer is <code>make test</code> which invokes <code>selftest.pl</code> and filters the results via [[subunit]].


=Subunit=
=Subunit=


Samba's selftest system is based on [Subunit].
Samba's selftest system is based on [[Subunit]] output streams, to describe tests that pass, fail and are flapping.

Revision as of 20:57, 18 June 2020

Presentation Introduction and overview

Andrew Bartlett's Two years with Samba's autobuild presentation at Linux.conf.au 2012 is a good place to start understanding our automated test and CI infrastructure. Youtube.

Also see Andreas Schneider's SambaXP 2015 presentation Audio

Autobuild

Autobuild is the top Pure Samba layer in the selftest system.

Public CI using GitLab CI

There's now also a Samba CI instance on gitlab, available for Samba team members and outside contributors: Samba CI on gitlab. This is the next layer up, controlled by the .gitlab-ci.yml file in the repository, this runs Autobuild.

make test

The next layer is make test which invokes selftest.pl and filters the results via subunit.

Subunit

Samba's selftest system is based on Subunit output streams, to describe tests that pass, fail and are flapping.