Reproducible FreeBSD ?

Reproducible builds enable anyone to reproduce bit by bit identical binary packages from a given source, so that anyone can verify that a given binary derived from the source it was said to be derived. There is more information about reproducible builds on the Debian wiki and on https://reproducible-builds.org. These pages explain in more depth why this is useful, what common issues exist and which workarounds and solutions are known.

Reproducible FreeBSD is an effort to apply this to FreeBSD. Thus FreeBSD is build twice, with a few variations added and then the resulting filesystems from the two builds are put into a compressed tar archive, which is finally compared using diffoscope. Please note that the toolchain is not varied at all as the rebuild happens on exactly the same system. More variations are expected to be seen in the wild.

There is a weekly run jenkins job to test the main branch of freebsd.git. The jenkins job is running reproducible_freebsd.sh, which via ssh triggers a build on a FreeBSD system and this script is solely responsible for creating this page. Feel invited to join #reproducible-builds (on irc.oftc.net) to request job runs whenever sensible. Patches and other feedback are very much appreciated - if you want to help, please start by looking at the ToDo list for FreeBSD, you might find something easy to contribute.
Thanks to IONOS for donating the virtual machines this is running on!

0 (0%) out of 0 FreeBSD files were reproducible in our test setup . These tests were last run on 2024-04-18 for the branch main at commit 9e54973fc using diffoscope 264.

variation	first build	second build
hostname	osuosl1-amd64 or osuosl2-amd64	the other one
domainname	is not yet varied between rebuilds of FreeBSD.
env TZ	TZ="/usr/share/zoneinfo/Etc/GMT+12"	TZ="/usr/share/zoneinfo/Etc/GMT-14"
env LANG	LANG="en_GB.UTF-8"	LANG="et_EE.UTF-8"
env LC_ALL	not set	LC_ALL="et_EE.UTF-8"
env PATH	is not yet varied between rebuilds of FreeBSD.
env USER	is not yet varied between rebuilds of FreeBSD.
uid	is not yet varied between rebuilds of FreeBSD.
gid	is not yet varied between rebuilds of FreeBSD.
FreeBSD kernel version	is not yet varied between rebuilds of FreeBSD.
umask	is not yet varied between rebuilds of FreeBSD.
CPU type	AMD Opteron 62xx class CPU	same for both builds
/bin/sh	is not yet varied between rebuilds of FreeBSD.
year, month, date	osuosl1-amd64: today (2024-04-18) or osuosl1-amd64: 398 days in the future (2025-05-21)	the other one
year, month, date	today (2024-04-18)	the 2nd build is done with the build node set 1 year, 1 month and 1 day in the future
hour, minute	hour and minute will vary between two builds	additionally the "future build" also runs 6h and 23min ahead
filesystem of the build directory	ufs	same for both builds
Filesystem	tmpfs	same for both builds (currently, this could be varied using disorderfs)
everything else...	is likely the same. There will be more variations in the wild.

Artifacts for `freebsd_main_git9e54973fc`
freebsd_main_git9e54973fc failed to build from source.

commit 9e54973fc33aa44b77d1c851cb36fcd82dc44cda
Author: Eric Joyner 
Date:   Mon Feb 12 22:26:26 2024 -0800

    ice(4): Update to 1.39.13-k
    
    - Adds mirror interface functionality
    - Remove unused virtchnl headers
    
    Signed-off-by: Eric Joyner 
    
    MFC-with:       768329961dc0c041f7647f1c4549944a2ca168aa
    MFC after:      3 days
    Sponsored by:   Intel Corporation
    Tested by:      jeffrey.e.pieper@intel.com
    Differential Revision:  https://reviews.freebsd.org/D44004