FreeBSD 14.0-RELEASE on Ten64

FreeBSD 14.0 was released recently, and the good news is that it includes all the relevant device drivers for the Ten64, including DPAA2 Ethernet, PCIe, real time clock, SD/MMC.

Many, many thanks to the hard work of @dsl, bz and others that made this possible!

However, a few bug fixes did not make it in FreeBSD in time for the release, so you should update your kernel as soon as possible (or install an image with the fixes included).


  • There was an issue with no traffic flowing on PHY-managed Ethernet ports (1GBase-T) until the cable was re-inserted (see Github issue and D42643)
  • There was an issue with VLANs not working (see D42645)

Options to install FreeBSD

  1. Use the freebsd-14-ten64 appliance with baremetal-deploy
    This is an image I have compiled that includes the relevant fixes.

    You should do a discard/TRIM (blkdiscard -f) on your storage device first, to ensure any secondary GPTs/old partition tables are wiped.

    root@recovery000afa24306:/# appstore-list
    community       |freebsd-14-ten64                |FreeBSD 14.0-RELEASE + DPAA2/Ten64 fixes
    # Wipe your storage device
    root@recovery000afa24306f:/# blkdiscard -f /dev/nvme0n1
    root@recovery000afa24306f:/# baremetal-deploy freebsd-14-ten64 /dev/nvme0n1
  2. Install FreeBSD 14.0-RELEASE from the ISO installer
    This gives you more configuration options, like setting up ZFS as the root file system.

    You can write FreeBSD-14.0-RELEASE-arm64-aarch64-dvd1.iso to a USB drive and boot the system from it.

  3. Deploy the official release image using baremetal deploy
    Similar to option 1, you can deploy the official FreeBSD 14.0-RELEASE image:

    baremetal-deploy freebsd-14 /dev/nvme0n1

Installing fixed kernel (for FreeBSD official images)

If you are familiar with compiling your own FreeBSD kernels, you an either update to the latest stable/14 or my branch (used in image 1 above).

If not, you can download a pre-built kernel and install it like so:

mv /boot/kernel /boot/kernel.old
tar -C /boot -zxvf freebsd-14-kernel-with-dpaa2fix.tar.gz
# After reboot into the new kernel, uname -a reads:
FreeBSD ten64-freebsd 14.0-RELEASE FreeBSD 14.0-RELEASE #0 14_0_releng-n265385-7eacc6ca558: Tue Nov 21 08:50:06 UTC 2023     matt@freebsd:/usr/obj/usr/src/freebsd-src/arm64.aarch64/sys/GENERIC arm64

Tips and tricks

Ethernet bridging

I have found that I need to use autobridge to get an Ethernet bridge (between multiple dpniX) working reliably on startup:

$ cat /etc/rc.conf
ifconfig_bridge0="inet netmask up"
autobridge_bridge0="dpni0 dpni1 dpni2 dpni3"
ifconfig_dpni6="DHCP inet6 accept_rtadv"
network_interfaces="bridge0 dpni6"


Firstly, you will need to ensure that your Ten64 is in legacy SFP mode.
In U-Boot:

setenv sfpmode legacy
reset # reboot to apply this setting

FreeBSD does not (yet) have the ability to control SFPs like Linux does, so if you have an “active” SFP (fiber optic, or XBase-T, but not a DAC), you will need to assert the SFP’s TXDISABLE line to make them link up.
Like so:

# Lower SFP
gpioctl -f /dev/gpioc4 -c 1 OUT PP
gpioctl -f /dev/gpioc4 1 0
# Upper SFP
gpioctl -f /dev/gpioc4 -c 5 OUT PP
gpioctl -f /dev/gpioc4 5 0
1 Like

It’s a pleasure of mine to work on FreeBSD, DPAA2 and Ten64 together :slight_smile: This is how a sane cooperation between open source projects and commercial companies should look like, I think. @mcbridematt Thank you for all of your support!

1 Like

Are the changes in reviews D42643 and D42645 the only ones needed? We could issue an erratum update to bring them into a future 14.0-p# patch update (via freebsd-update).

@emaste Nothing else is needed from my side.