Samba4/Andrew and Jelmers Fantasy Page/2010: Difference between revisions

From SambaWiki
(update for last fortnight)
(Typo)
 
(110 intermediate revisions by 5 users not shown)
Line 1: Line 1:
=Plans for fortnight ending 18 October 2008=
=Plans for fortnight ending 11th October 2010=
*Use separate structure for gensec settings (Jelmer)
* Work on supporting waf in Heimdal (Jelmer)
*Share DEBUG() code between Samba 3 and Samba 4 (Jelmer)
* Resolve circular links issues in waf for Debian package (Jelmer)
* Integrate land.py and autobuild.py (Jelmer)
**In preparation of merging my libutil-share branch
==Achievements==
*More work getting WMI back to work (Jelmer)
* Removed circular dependencies (Jelmer)
=Plans for fortnight ending 4 October 2008=
=Plans for fortnight ending 27th September 2010=
*Implement a 'unicode' password pass-down mechanism in LDB, or otherwise avoid UCS2 -> UTF8 -> UCS2 problems
==Achievements==
*Trusted domain support (LSA and KDC portions) (Andrew)
*Merge some of Wilco's registry patches (Jelmer)
==Achied so far==
*Avoid aborting on environment setup problems without printing proper subunit errors (Jelmer)
*Separate out and add tests for Subunit (Jelmer)
*Release alpha13 (Jelmer)
*Remove global_loadparm use in a couple more places (Jelmer)
*Several selftest improvements (running individual tests) (Jelmer)
*Restructure some of the installation bits together with Matthias (Jelmer)
*Uploaded newer versions to Sid (Jelmer)
=Plans for fortnight ending 20 september 2008=
*Support for aborting selftest early on failure (Tridge, Jelmer)
*wmi integration (Jelmer)
*hdb_samba4 (Jelmer)
*eliminate last EJS (minschema.js, samba3sam.js (Jelmer))
*Trusted domain support (LSA and KDC portions) (Andrew)
==Achieved so far==
*Committed merged build patch to Samba 3 (Jelmer)
*Made Samba 3 and Samba 4 use the same copy of tdb, talloc, compression, replace, nss_wrapper, socket_wrapper, popt (Jelmer)
*Committed WMI support to the repository (doesn't compile completely yet though) (Jelmer)
*Fixed samba3sam.js and removed remaining JavaScript support. (Jelmer)
*Implemented WSGI standard (http://www.python.org/dev/peps/pep-0333/) support in web_server.


=Plans for fortnight ending 6 september 2008=
=Plans for fortnight ending 19th July 2010=
*Start hacking around [http://msdn.microsoft.com/en-us/library/cc224123%28v=PROT.13%29.aspx MS-BKRP] aka protected storage (Matthieu)
*wmi integration (Jelmer)
==Achievements==
*upload samba-gtk into Debian (Jelmer)
* Made a page about [[UpgradeprovisionPlans | upgradeprovision plans]] (Matthieu)
*hdb_samba4 (Jelmer)
* Finished all the patches about upgradeprovision to keep up with the pace of current development (Matthieu)
*send out patch for merged franky build (Jelmer)
* Add options to net to manipulate service principal names (a bit like addspn): net spn (Matthieu)
*Use franky build for personal Samba4 development (Andrew)
*eliminate last EJS (minschema.js, samba3sam.js (Jelmer))
*Trusted domain support (LSA and KDC portions) (Andrew)
==Achieved so far==
*Update NTP patch (Andrew)
*Respond to comments and suggestions on RPMs for Fedora (Andrew)
*(partial) Trusted domain support (LSA and KDC portions) (Andrew)
*PAC Verification support over NETLOGON (Andrew)
*Sent out franky merged build patch, more prerequisites fixed for Franky (Jelmer)


=Plans for fortnight ending 23 august 2008=
=Plans for fortnight ending 5th July 2010=
*Make upgradeprovision able to change synchronize msds-keyversionnumber (Matthieu)
==Achieved so far==
*Start hacking around [http://msdn.microsoft.com/en-us/library/cc224123%28v=PROT.13%29.aspx MS-BKRP] aka protected storage (Matthieu)
* slacking off (Jelmer)
*Review Andrews s3compat auth patches. (Jelmer)
* Lots of questions to Microsoft on trusted domains and PAC validation (Andrew)
*Infrastructure for testing net from within Python. (Jelmer)
* Build indexes and attributes directly from the schema, not a hard-coded list (Andrew)
==Achievements==
* Generate the cn=Aggregate schema in Samba4, rather than in minschema.js
*Make upgradeprovision is now able to change synchronize msds-keyversionnumber (Matthieu)
**This prepares us for adding arbitrary schema into Samba4
=Plans for fortnight ending 19 June 2010=
* Integrate patches for multi-master OpenLDAP configuration (Andrew)
*Upload Debian packages (Jelmer)
** This allows a Samba4 provision-backend to create a multi-master backend, without hand-manipulation by the admin
*Fix build against system Heimdal (Jelmer)
* Start of work on trusted domains
==Achievements==
**In our KDC, start with a special case for handling the trusted domains principals
*More Python cleanups (Jelmer)
**In the drsblobs.idl, parse the trustAuthIncoming and trustAuthOutgoing blobs
*Fix Samba 4 build to install everything necessary for OpenChange again (Jelmer)
*Review Matthieu's patches (Jelmer)
*Push major update for upgradeprovision both in terms of update capacity and reliability (Matthieu)
*Use standard python logging infrastructure in Python code (Jelmer)
*Re-upload Debian packages based on waf build (Jelmer)
*Started [[MergeRequests]] page (Jelmer)


=Plans for fortnight ending 9 August 2008=
=Plans for fortnight ending 5 June 2010=
*Make the whole redesign of upgradeprovision go in Master (Matthieu)
*Fix AES compatability with Windows 2008/Vista. (Andrew)
*Develop more unit tests around upgradeprovision (Matthieu)
**It turns out that Metze was starting to chase the same bug
==Achievements==
**The fix is to implement gss_wrap_ex() - ie AEAD, the signing of headers in DCE/RPC packets.
=Plans for fortnight ending 22 May 2010=
**Earlier 'use Heimdal for SPNEGO' work is forming a very useful basis for this work
*Make client DFS referral support for sysvol go in Master (Matthieu)
*Look at smartcard login again (Andrew)
*Develop torture test for DFS (at least for the domain referral part) (Matthieu)
**Bugs in Dogtag have been allegedly fixed.
*Make the whole redesign of upgradeprovision go in Master (Matthieu)
*Trusted domains (Andrew)
*Develop more unit tests around upgradeprovision (Matthieu)
**Add support for trusted domains in our KDC
*Merged some waf patches from Thomas. (Jelmer)
==Achieved so far==
*Cherry-picked some of the patches I pair-programmed with Matthieu during SambaXP (Jelmer)
==Achievements==
*DFS responses to client referral request are ok for Domain, DC and SYSVOL/NETLOGON (Matthieu)
*Torture tests ok (Matthieu)
*Update Debian packages for talloc, tdb, ldb and tevent. (Jelmer)


=Plans for fortnight ending 26 July 2008=
=Plans for fortnight ending 24 Apr 2010=
SambaXP!
==Achieved so far==
==Achievements==
*Fix LDAP backend to be secure (not anonymous access) (Andrew)
*Played with the waf build (Jelmer)
*Partially Fix vista join bugs due to AES and GSSAPI CFX (Andrew with Tridge)
*Pair-programmed on upgradeprovision unit tests (Jelmer, Matthieu)
**Session keys for smb signing are original length (ie, 32 in this case)
*Initial Python bindings for libpolicy (Jelmer)
**Session keys for SAMR encryption are 16 (ie, truncated)
=Plans for fortnight ending 10 Apr 2010=
**Still need to fix GSSAPI encryption for the AES case (it uses AEAD, as seen in NTLM2)
Slacking
*Phone calls with Microsoft (Andrew)
=Plans for fortnight ending 27 Mar 2010=
**I now have a regular phone hookup with Microsoft to go over pending issues in the WSPP process
Slacking.
*Fix 'file not found' errors from clients (Andrew with Tridge)
=Plans for fortnight ending 13 Mar 2010=
**Due to an uninitialised variable, introduced in some recent SMB2 work
Slacking.
**shows up on systems with extended attributes (typically those using SeLinux, such as Fedora)
=Plans for fortnight ending 27 Feb 2010=
**Perhaps a good reason to push out a new alpha soon
==Achievements==
*More work to automate the correct setup of BIND for DNS (Andrew)
*Work with tridge to demonstrate 'waf' as a build system for Samba (Andrew)
=Plans for fortnight ending 13 Feb 2010=
==Achievements==
*Work with Tridge on Samba HOWTO (Andrew)
*More work to automate the correct setup of BIND for DNS (Andrew)
*Improve Samba4 RPC proxy to handle a non-zero if_version (Andrew)
**This is needed to ensure we proxy the full if_version from an RPC bind to the endpoint mapper and subsequent bind on another RPC server.
**Add testsuite to ensure the RPC proxy (rpc_server/remote) does not bitrot further.


=Plans for fortnight ending 12 July 2008=
=Plans for fortnight ending 30 January 2010=
==Achievements==
*wmi integration (Jelmer)
*Successful presentation at linux.conf.au Sysadmin mini-conf (Andrew)
*upload openchange and samba-gtk into Debian (Jelmer)
*Holiday on South Island of NZ (Andrew)
*hdb_samba4 (Jelmer)
*eliminate last EJS (minschema.js, samba3sam.js)
*Improve LDAP backend from a technology preview to a deployable system (Andrew)
==Achieved so far==
*Continue packaging of OpenChange and Samba4 for Fedora
*Start work on smart card login (Andrew)
**Including setting up DogTag certificate system (Andrew)
**At least to the stage of the first crashes...
*Rework schema handling to know about auxillary classes (Andrew)
**Try to do this in common between ad2OLschema and the kludge_acl and objectclass modules.


=Plans for fortnight ending 28 June 2008=
=Plans for fortnight ending 16 January 2010=
*external Heimdal use (Andrew)
==Achievements==
==Achievements==
*Created Samba 4 and OpenChange RPM packages (Andrew)
*Samba4 Alpha 11 release (Andrew)
*test TEST_LDAP=yes (Andrew)
*DRS pair programming with Tridge (Andrew)
*Preparation for linux.conf.au SysAdmin mini-conf presentation
*Fixed Franky build for odd make versions (Jelmer)


=Plans for fortnight ending 14 June 2008=
=Plans for fortnight ending 2 January 2010=
==Achievements==
*Linked attributes for 'net vampire' (Andrew)
*AES Key support (check with docs and Win2008 on format) in samdb (Andrew)
*DRS pair programming with Tridge (Andrew)
**Success with replicating with Windows 2008 again (mostly Tridge)
*Work to make ldb merge easier for Simo (andrew)
*Christmas Holidays (Andrew)
*Any work required to merge NTP patch with ntp.org distribution (Andrew)
*Work with alpha testers on any issues that come up in production deployments of Samba4 (Andrew)
==Achieved so far==
*Samba4 alpha4 release (andrew)
**without LDB merge, which seems a while off yet
*Sync ldap.py test with it's (now obsolete) ldap.js predecessor (andrew)
*Add python bindings for NetBIOS (Jelmer)
*Improve portability of Franky build (Jelmer)
*Asked Microsoft about AES key formats (Andrew)
**Just getting the data from Win2008 failed due to other reasons
*Continued the battle with Microsoft over NTP documentation (Andrew)
*Worked on package of Heimdal for Fedora (Andrew)
**As a preview to packaging Samba4 for Fedora


= Older entries =
=Plans for fortnight ending 31 May 2008=
*Linked attributes for 'net vampire' (andrew)
*Make a Samba 4.0 alpha4 release if the ldb branch gets merged
http://packages.debian.org/testing/python/python-wmi (Jelmer)
==Achieved so far==
*Implement NTP signing (andrew)
**Patch posted to ntp.org for consideration: [http://bugs.ntp.org/1028 NTP bugzilla item with patch]
**ntp_signd now started by default in samba4
*Finish CLDAP and NBT netlogon parsing. (Andrew)
**Including expected value tests (critical to ensuring we return the *right* answer)
**This should help things like Group Policy, which rely on this 'DC ping' functionality
*Merge Simo's ldb branch with current v4-0-test (abartlet)
**Should make Simo's merge task easier.
*Removed smbpython and restructured Python modules hierarchy to not clutter Python namespace (Jelmer)
*Merged improvements made by Wilco and Jelmer to the registry during SambaXP (Jelmer)
*Added documentation to most Python modules and improved descriptions. (Jelmer)
*Fixed memory bug in autogenerated DCE/RPC Python bindings (Jelmer)
*Several test infrastructure improvements. (Jelmer)
**Print full test path for easy inclusion in knownfail lists
**Make test case name part of test name to allow a test to have different results against different test cases
**Set PYTHONPATH during test runs
*Removed unused old EJS DCE/RPC bindings and testscripts (Jelmer)
*Make it easier to use various libraries externally without including all of Samba 4's build system (Jelmer)
*Updated Samba 4, OpenChange and Samba-Gtk Debian packages, now passes lintian. (Jelmer)
** Announced on the OpenChange website (http://www.openchange.org/index.php?option=com_content&task=blogsection&id=7&Itemid=77)
*Added Python bindings for IRPC / Messaging interfaces (Jelmer)
**Rewrote smbstatus in Python
*Added mechanism for doing "raw" DCE/RPC requests from Python (Jelmer)
**Also initial work on a script that should attempt to figure out IDL by probing
*Exposed more DCE/RPC internals from Python bindings (Jelmer)
*Initial work on [http://www.python.org/dev/peps/pep-0333/ WSGI] implementation in web_server/ (Jelmer)
*Added combined buildsystem for [[Franky]]


For the 2009 entries, see [[Samba4/Andrew_and_Jelmers_Fantasy_Page/2009]].
=Plans for fortnight ending 17 May 2008=
*Fix our CLDAP netlogon processing to match description in [MS-ADTS] 7.3.3 (andrew)
**Use this to fix and test group policy handling on Win2000 and WinXP clients
==Achieved so far==
*Partial security=server implementation, awaiting VFS proxy merge for testing (Andrew)
*Removed a large number of dead build farm hosts in response to automated mails (Andrew)
*Brought back old (D)COM code and made it compile again (Jelmer)
*Merged GNU make branch (Jelmer)
**Now allows using system Python with Samba Python modules
*Finished Samba 4 Debian package together with Christian (Jelmer)
*Updated Debian packages for OpenChange and Samba-Gtk (Jelmer)
*Most of the parsing work towards the CLDAP/NBT netlogon consolidation (Andrew)


For the 2008 entries, see [[Samba4/Andrew_and_Jelmers_Fantasy_Page/2008]].
=Plans for fortnight ending 3 May 2008=
*Build Farm improvements
**See if we can use SQLite to get a bit more done
**make build farm summary page use sqlite
**host list, by last reported time
**last reported time on host individual page
*Finish security=server re-implementation in Samba4
*Finish ncacn_http implementation
==Achieved so far==
*Very useful Visit to Sam's home company for 2 days
**Chat with principals to encourage them
**Jelmer prepared WAFS branch for merging
***Looks like further development will be upstream, which is great
**Jelmer did some initial work on tests for proxy code
**Andrew Started work on 'security=server' re-implementation for Samba4
***This will allow WAFS to hijack an unsigned connection as a man in the middle attack.
**Andrew fixed 'make test' to fail if PIDL tests fail
*Build Farm
**make build farm send e-mails to dead hosts (based on SQLite database)
=Achievements for fortnight ending ending 19 April 2008=
==SambaXP==
*Successfully gave 3 presentations
**Samba4 status report (Both)
**Samba4 and the LDAP backend / Little barber shop of horrors (Andrew)
**RPC Scripting using Python (Jelmer)
*Worked with Sam Liddicott
**He has implemented the start of a WAFS (latency reducing) proxy for Samba4
**Organised to visit his companies office
*Improved code coverage to give better 'headline' figure for presentation (Andrew)
**Working with Kai's winbind work to run metze's structure based tests
**Kai worked on blackbox tests
**Required fixing up parts of winbind (untested code is broken code, Andrew)
*Fixed bugs in Pidl reported by Volker (Jelmer)
*Added knownfailure support in test code (Jelmer)
*Split out policy library into separate git repository (Jelmer)
*Worked with Wilco on more registry tests (Jelmer)
*Fixed several Python usability bits (Jelmer)
*Fixed duplication in blackbox tests (Jelmer)
*Initial work on ncacn_http support (Jelmer)
*Discussions with Guenther, Michael about reconciling registry, libsmbdotconf and smbdotconf in Samba 3 and 4 (Jelmer)

Latest revision as of 19:37, 1 April 2012

Plans for fortnight ending 11th October 2010

  • Work on supporting waf in Heimdal (Jelmer)
  • Resolve circular links issues in waf for Debian package (Jelmer)
  • Integrate land.py and autobuild.py (Jelmer)

Achievements

  • Removed circular dependencies (Jelmer)

Plans for fortnight ending 27th September 2010

Achievements

  • Merge some of Wilco's registry patches (Jelmer)
  • Avoid aborting on environment setup problems without printing proper subunit errors (Jelmer)
  • Release alpha13 (Jelmer)
  • Several selftest improvements (running individual tests) (Jelmer)
  • Uploaded newer versions to Sid (Jelmer)
  • Support for aborting selftest early on failure (Tridge, Jelmer)

Plans for fortnight ending 19th July 2010

  • Start hacking around MS-BKRP aka protected storage (Matthieu)

Achievements

  • Made a page about upgradeprovision plans (Matthieu)
  • Finished all the patches about upgradeprovision to keep up with the pace of current development (Matthieu)
  • Add options to net to manipulate service principal names (a bit like addspn): net spn (Matthieu)

Plans for fortnight ending 5th July 2010

  • Make upgradeprovision able to change synchronize msds-keyversionnumber (Matthieu)
  • Start hacking around MS-BKRP aka protected storage (Matthieu)
  • Review Andrews s3compat auth patches. (Jelmer)
  • Infrastructure for testing net from within Python. (Jelmer)

Achievements

  • Make upgradeprovision is now able to change synchronize msds-keyversionnumber (Matthieu)

Plans for fortnight ending 19 June 2010

  • Upload Debian packages (Jelmer)
  • Fix build against system Heimdal (Jelmer)

Achievements

  • More Python cleanups (Jelmer)
  • Fix Samba 4 build to install everything necessary for OpenChange again (Jelmer)
  • Review Matthieu's patches (Jelmer)
  • Push major update for upgradeprovision both in terms of update capacity and reliability (Matthieu)
  • Use standard python logging infrastructure in Python code (Jelmer)
  • Re-upload Debian packages based on waf build (Jelmer)
  • Started MergeRequests page (Jelmer)

Plans for fortnight ending 5 June 2010

  • Make the whole redesign of upgradeprovision go in Master (Matthieu)
  • Develop more unit tests around upgradeprovision (Matthieu)

Achievements

Plans for fortnight ending 22 May 2010

  • Make client DFS referral support for sysvol go in Master (Matthieu)
  • Develop torture test for DFS (at least for the domain referral part) (Matthieu)
  • Make the whole redesign of upgradeprovision go in Master (Matthieu)
  • Develop more unit tests around upgradeprovision (Matthieu)
  • Merged some waf patches from Thomas. (Jelmer)
  • Cherry-picked some of the patches I pair-programmed with Matthieu during SambaXP (Jelmer)

Achievements

  • DFS responses to client referral request are ok for Domain, DC and SYSVOL/NETLOGON (Matthieu)
  • Torture tests ok (Matthieu)
  • Update Debian packages for talloc, tdb, ldb and tevent. (Jelmer)

Plans for fortnight ending 24 Apr 2010

SambaXP!

Achievements

  • Played with the waf build (Jelmer)
  • Pair-programmed on upgradeprovision unit tests (Jelmer, Matthieu)
  • Initial Python bindings for libpolicy (Jelmer)

Plans for fortnight ending 10 Apr 2010

Slacking

Plans for fortnight ending 27 Mar 2010

Slacking.

Plans for fortnight ending 13 Mar 2010

Slacking.

Plans for fortnight ending 27 Feb 2010

Achievements

  • More work to automate the correct setup of BIND for DNS (Andrew)
  • Work with tridge to demonstrate 'waf' as a build system for Samba (Andrew)

Plans for fortnight ending 13 Feb 2010

Achievements

  • Work with Tridge on Samba HOWTO (Andrew)
  • More work to automate the correct setup of BIND for DNS (Andrew)
  • Improve Samba4 RPC proxy to handle a non-zero if_version (Andrew)
    • This is needed to ensure we proxy the full if_version from an RPC bind to the endpoint mapper and subsequent bind on another RPC server.
    • Add testsuite to ensure the RPC proxy (rpc_server/remote) does not bitrot further.

Plans for fortnight ending 30 January 2010

Achievements

  • Successful presentation at linux.conf.au Sysadmin mini-conf (Andrew)
  • Holiday on South Island of NZ (Andrew)

Plans for fortnight ending 16 January 2010

Achievements

  • Samba4 Alpha 11 release (Andrew)
  • DRS pair programming with Tridge (Andrew)
  • Preparation for linux.conf.au SysAdmin mini-conf presentation

Plans for fortnight ending 2 January 2010

Achievements

  • DRS pair programming with Tridge (Andrew)
    • Success with replicating with Windows 2008 again (mostly Tridge)
  • Christmas Holidays (Andrew)

Older entries

For the 2009 entries, see Samba4/Andrew_and_Jelmers_Fantasy_Page/2009.

For the 2008 entries, see Samba4/Andrew_and_Jelmers_Fantasy_Page/2008.