Bringing up a 10G link between 2 Ten64s

Ten64 Forum
1

I have 2 Ten64 boxes that I have updated to the latest firmware (v0.8.10 /2022-03-15) and I am trying to experiment with a direct 10G link between them. I have a 1 meter FS copper DAC cable that I have verified works on other 10G interfaces that I have here. I can see the cable being detected when I plug it in:

[ 1898.758155] sfp dpmac2_sfp: module FS               SFPP-PC01        rev P    sn F2032555161-1    dc 211228

I have configured the interface in /etc/config/network with:

config interface 'flan8'
	option device 'eth8'
	option proto 'static'
	option ipaddr '100.84.88.1'
	option netmask '255.255.255.0'

When I bring the interface up with ifup flan8 I see:

[ 4065.180405] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode

On the other Ten64 box, I have configured it the same way but with 100.84.88.2 as the IP address. I see the same messages about detecting the cable and configuring the link.

However, ethtool shows:

root@OpenWrt:/# ethtool eth8
Settings for eth8:
	Supported ports: [ ]
	Supported link modes:   1000baseX/Full 
	                        10000baseCR/Full 
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full 
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Auto-negotiation: on
	Link detected: no

I have tried bringing the interface up with ifconfig eth8 up and ifup flan8 to no avail.

Other commands show:

root@OpenWrt:/# ifconfig eth8
eth8      Link encap:Ethernet  HWaddr 00:0A:FA:24:25:2E  
          inet addr:100.84.88.1  Bcast:100.84.88.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

root@OpenWrt:/# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:2e brd ff:ff:ff:ff:ff:ff

I have tried connecting one of the Ten64’s to a 10G switch and directly to a 10G Intel interface on one of my other machines and the carrier never comes up.

I figure I have forgotten something obvious.

1 Like
2

Can you see if changing to legacy SFP mode makes the link work? This bypasses the Linux SFP management and makes the link status based purely on the physical connection.

The other thing to look (in the normal mode) is the SFP status in debugfs:

# use dpmac2_sfp for the lower (XG0) port
cat /sys/kernel/debug/dpmac1-sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0
3

I am still in normal mode. There is no /sys/kernel/debug/dpmac1-sfp directory. This is what I do see.

root@OpenWrt:/# ls -l /sys/kernel/debug
drwxr-xr-x    3 root     root             0 May 12 23:48 8000000.crypto
drwxr-xr-x   16 root     root             0 Jan  1  1970 bdi
drwxr-xr-x   14 root     root             0 Jan  1  1970 block
--w-------    1 root     root             0 Jan  1  1970 clear_warn_once
drwxr-xr-x   48 root     root             0 Jan  1  1970 clk
-rw-r--r--    1 root     root             0 Jan  1  1970 debug_enabled
drwxr-xr-x    2 root     root             0 Jan  1  1970 device_component
-r--r--r--    1 root     root             0 Jan  1  1970 devices_deferred
drwxr-xr-x    2 root     root             0 Jan  1  1970 dma_pools
drwxr-xr-x    2 root     root             0 Jan  1  1970 dmaengine
drwxr-xr-x   12 root     root             0 Jan  1  1970 dpaa2-eth
drwxr-xr-x    2 root     root             0 May 12 23:48 dpseci.0
drwxr-xr-x    2 root     root             0 Jan  1  1970 dynamic_debug
drwxr-xr-x    2 root     root             0 Jan  1  1970 extfrag
drwxr-xr-x    2 root     root             0 Jan  1  1970 f2fs
-rw-r--r--    1 root     root             0 Jan  1  1970 fault_around_bytes
-r--r--r--    1 root     root             0 Jan  1  1970 gpio
drwxr-xr-x    2 root     root             0 May 12 23:48 ieee80211
drwxr-xr-x    2 root     root             0 May 12 23:48 iwlwifi
drwxr-xr-x    2 root     root             0 Jan  1  1970 kvm
drwxr-xr-x    2 root     root             0 Jan  1  1970 memblock
drwxr-xr-x    2 root     root             0 Jan  1  1970 mmc0
drwxr-xr-x   13 root     root             0 Jan  1  1970 mtd
drwxr-xr-x    2 root     root             0 Jan  1  1970 pinctrl
drwxr-xr-x    2 root     root             0 Jan  1  1970 pm_genpd
drwxr-xr-x    3 root     root             0 Jan  1  1970 regmap
-r--r--r--    1 root     root             0 Jan  1  1970 sleep_time
drwxr-xr-x    2 root     root             0 Jan  1  1970 swiotlb
drwxr-xr-x    3 root     root             0 Jan  1  1970 ubi
drwxr-xr-x    3 root     root             0 Jan  1  1970 ubifs
drwxr-xr-x    5 root     root             0 Jan  1  1970 usb

root@OpenWrt:/# ls -l /sys/kernel/debug/dpaa2-eth
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth0
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth1
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth2
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth3
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth4
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth5
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth6
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth7
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth8
drwxr-xr-x    2 root     root             0 Jan  1  1970 eth9

root@OpenWrt:/# ls -l /sys/kernel/debug/dpaa2-eth/eth8
-r--r--r--    1 root     root             0 Jan  1  1970 ch_stats
-r--r--r--    1 root     root             0 Jan  1  1970 cpu_stats
-r--r--r--    1 root     root             0 Jan  1  1970 fq_stats

root@OpenWrt:/# cat /sys/kernel/debug/dpaa2-eth/eth8/ch_stats
Channel stats for eth8:
CHID             CPU        Deq busy          Frames           CDANs    Avg Frm/CDAN       Buf count
   6               0               0               0               0               0            1281
   5               1               0               0               0               0            1281
   4               2               0               0               0               0            1281
   3               3               0               0               0               0            1281
   2               4               0               0               0               0            1281
   1               5               0               0               0               0            1281
  80               6               0               0               0               0            1281
  79               7               0               0               0               0            1281

root@OpenWrt:/# cat /sys/kernel/debug/dpaa2-eth/eth8/cpu_stats
Per-CPU stats for eth8
CPU              Rx          Rx Err           Rx SG              Tx          Tx Err         Tx conf           Tx SGTx converted to SG        Enq busy
  0               0               0               0               0               0               0               0               0               0
  1               0               0               0               0               0               0               0               0               0
  2               0               0               0               0               0               0               0               0               0
  3               0               0               0               0               0               0               0               0               0
  4               0               0               0               0               0               0               0               0               0
  5               0               0               0               0               0               0               0               0               0
  6               0               0               0               0               0               0               0               0               0
  7               0               0               0               0               0               0               0               0               0

root@OpenWrt:/# cat /sys/kernel/debug/dpaa2-eth/eth8/fq_stats
FQ stats for eth8:
VFQID             CPU              TC            Type          Frames  Pending frames

I’ll see what happens when I get some time to try out legacy mode.

1 Like
4

Apologies, the OpenWrt images didn’t have the debugfs feature enabled

These have it:
Index of /pub/traverse/ls1088firmware/openwrt/branches/arm64_2102/540621433/image/ (21.02)
Index of /pub/traverse/ls1088firmware/openwrt/branches/22_03/540640949/image/ (22.03)

Other things to check:

  1. Do you see Retimer: DS110DF410 found in the U-Boot console on startup?

Retimer: DS110DF410 found (cold boot)

or

Retimer: (retimer on, resetting...) DS110DF410 found (restart)

  1. If you insert the SFP at runtime, does it work?

We do have a microcontroller update (not published yet) which fixes startup issues for certain SFPs when present at power on or reboot. But we haven’t seen any of those issues with passive cables.

5

I do see the Retimer line on a cold boot with the DAC plugged in:

Using SERDES1 Protocol: 29 (0x1d)
Using SERDES2 Protocol: 20 (0x14)
PCIe0: pcie@3400000 Root Complex: no link
PCIe1: pcie@3500000 Root Complex: x1 gen2
PCIe2: pcie@3600000 Root Complex: x2 gen3
Retimer: DS110DF410 found
OK

I see the exact same lines on a cold boot with the DAC removed.

When I insert the DAC after the boot has completed, I see on the console:

[  100.225389] sfp dpmac2_sfp: module FS               SFPP-PC01        rev P    sn Y2105169778-2    dc 210621

Checking the link with ip and ifconfig shows:

root@OpenWrt:/# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff

root@OpenWrt:/# ifconfig eth8
eth8      Link encap:Ethernet  HWaddr 00:0A:FA:24:25:1A  
          inet addr:100.84.88.2  Bcast:100.84.88.255  Mask:255.255.255.0
          UP BROADCAST MULTICAST  MTU:1500  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

Attempting to bring the link up:

root@OpenWrt:/# ifup flan8
[  355.843466] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode

root@OpenWrt:/# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff

root@OpenWrt:/# ethtool eth8
Settings for eth8:
	Supported ports: [ ]
	Supported link modes:   1000baseX/Full 
	                        10000baseCR/Full 
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full 
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Auto-negotiation: on
	Link detected: no

I’ll experiment with the firmware images you mentioned above and let you know how it goes.

6

I have updated both of my Ten64s with openwrt-armvirt-64-ten64-mtd-squashfs-sysupgrade.tar. With my DAC in the lower port, I can now see the information in /sys/kernel/debug/dpmac2-sfp/state.

root@OpenWrt:/# cat /sys/kernel/debug/dpmac2_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

I am still in managed state. ethtool shows:

root@OpenWrt:/# ethtool eth8
Settings for eth8:
	Supported ports: [  ]
	Supported link modes:   1000baseX/Full
	                        10000baseCR/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Link detected: no

I have tried switching to legacy mode and still did not have the link come up.

=> setenv sfpmode legacy
=> printenv sfpmode     
sfpmode=legacy
=> saveenv
Saving Environment to SPI Flash... Erasing SPI flash...Writing to SPI flash...done
OK
=> reset

Skipping reboot output

root@OpenWrt:/# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff

root@OpenWrt:/# ethtool eth8
Settings for eth8:
	Supported ports: [  ]
	Supported link modes:   Not reported
	Supported pause frame use: No
	Supports auto-negotiation: No
	Supported FEC modes: Not reported
	Advertised link modes:  Not reported
	Advertised pause frame use: No
	Advertised auto-negotiation: No
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Full
	Auto-negotiation: off
	Port: Twisted Pair
	PHYAD: 0
	Transceiver: internal
	MDI-X: Unknown
	Link detected: no

root@OpenWrt:/# cat /sys/kernel/debug/dpmac2-sfp/state
cat: can't open '/sys/kernel/debug/dpmac2-sfp/state': No such file or directory

I have gone back to managed mode.

I will continue experimenting with things.

7

Another bit of information. When I try to use restool, it gives me the following message:

root@OpenWrt# restool
error: Did not find a device file

Was the kernel built with CONFIG_FSL_MC_UAPI_SUPPORT=y ?

8

It wasn’t, the 22.03 images I posted had the minimum patchset intended for upstreaming.

This one does:
https://archive.traverse.com.au/pub/traverse/ls1088firmware/openwrt/branches/22_03/545310966/image/

Note that the DPMAC IDs for the top and bottom slots are in reverse order:

Bottom (XG0/eth8) is dpmac.2:

$ restool dpmac info dpmac.2
dpmac version: 4.5
dpmac object id/portal id: 2
plugged state: plugged
endpoint state: 1
endpoint: dpni.1, link is up
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:06
maximum supported rate 10000 Mbps

top (XG1/eth9) is dpmac.1:

$ restool dpmac info dpmac.1
dpmac version: 4.5
dpmac object id/portal id: 1
plugged state: plugged
endpoint state: 1
endpoint: dpni.0, link is up
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:05
maximum supported rate 10000 Mbps

The other suggestions I have:

  1. If you connect a cable between the two SFP+ ports on a Ten64 (“loopback”), does it work?
[  327.711204] sfp dpmac2_sfp: module FS               SFPP-PC01        rev R    sn F1930247305-1    dc 200917
[  329.119032] sfp dpmac1_sfp: module FS               SFPP-PC01        rev R    sn F1930247305-2    dc 200917
[  329.748009] fsl_dpaa2_eth dpni.1 eth8: Link is Up - 10Gbps/Full - flow control off

# ifconfig eth8 up
# ifconfig eth9 up
[  337.982799] fsl_dpaa2_eth dpni.0 eth9: configuring for inband/10gbase-r link mode
[  337.992332] fsl_dpaa2_eth dpni.0 eth9: Link is Up - 10Gbps/Full - flow control off
  1. Have you tried any other SFP transceivers/cables?
9

I have updated one of the Ten64s with https://archive.traverse.com.au/pub/traverse/ls1088firmware/openwrt/branches/22_03/545310966/image/openwrt-armvirt-64-ten64-mtd-squashfs-sysupgrade.tar

I have 4 different cables that I have tried. All 4 cables work on other equipment I have here so I am reasonably sure that it isn’t the cable. I believe I have not configured something correctly.

I am including a large amount of console output in order to provide as much information as possible. I apologize for the size.

Cable #1, 1 meter pasive DAC FS P/N SFPP-PC01 Product ID 74617
When I plug it in to eth8 and eth9 I see the following messages on the console:

[2724.207925] sfp dpmac2_sfp: module FS        SFPP-PC01.     rev P.    sn F2032555189-2.  dc 211228
[2732.274901] sfp dpmac1_sfp: module FS        SFPP-PC01.     rev P.    sn F2032555189-1.  dc 211228

root@OpenWrt:~# ifup eth8
[3373.828574] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode
root@OpenWrt:~# ifup eth9
[3388.205593] fsl_dpaa2_eth dpni.0 eth9: configuring for inband/10gbase-r link mode

The link does not come up.

root@OpenWrt:~# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff
root@OpenWrt:~# ip link show eth9
11: eth9: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:19 brd ff:ff:ff:ff:ff:ff

root@OpenWrt:~# cat /sys/kernel/debug/dpmac2_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0
root@OpenWrt:~# cat /sys/kernel/debug/dpmac1_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# restool dpmac info dpmac.2
dpmac version: 4.5
dpmac object id/portal id: 2
plugged state: plugged
endpoint state: 0
endpoint: dpni.1, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:1a
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# restool dpmac info dpmac.1
dpmac version: 4.5
dpmac object id/portal id: 1
plugged state: plugged
endpoint state: 0
endpoint: dpni.0, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:19
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# ethtool -m eth8
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : FS
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFPP-PC01
	Vendor rev                                : P
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : F2032555189-2
	Date code                                 : 211228

root@OpenWrt:~# ethtool -m eth9
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : FS
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFPP-PC01
	Vendor rev                                : P
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : F2032555189-1
	Date code                                 : 211228

Removing the cable shows the following on the console:

[4191.480600] sfp dpmac1_sfp: module removed
[4198.064537] sfp dpmac2_sfp: module removed

Cable #2, Identical to Cable #1 with Cisco firmware programmed into it using the FS Box diagnostic tool.

[4255.935535] sfp dpmac2_sfp: module FS        SFPP-PC01.     rev P.    sn Y2105169767-1.  dc 210621
[2732.274901] sfp dpmac1_sfp: module FS        SFPP-PC01.     rev P.    sn Y2105169767-2.  dc 210621

root@OpenWrt:~# ifup eth8
[4654.588355] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode
root@OpenWrt:~# ifup eth9
[4663.023389] fsl_dpaa2_eth dpni.0 eth9: configuring for inband/10gbase-r link mode

The link does not come up.

root@OpenWrt:~# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff
root@OpenWrt:~# ip link show eth9
11: eth9: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:19 brd ff:ff:ff:ff:ff:ff

root@OpenWrt:~# cat /sys/kernel/debug/dpmac2_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# cat /sys/kernel/debug/dpmac1_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# restool dpmac info dpmac.2
dpmac version: 4.5
dpmac object id/portal id: 2
plugged state: plugged
endpoint state: 0
endpoint: dpni.1, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:1a
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# restool dpmac info dpmac.1
dpmac version: 4.5
dpmac object id/portal id: 1
plugged state: plugged
endpoint state: 0
endpoint: dpni.0, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:19
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# ethtool -m eth8
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : FS
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFPP-PC01
	Vendor rev                                : P
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : Y2105169767-1
	Date code                                 : 210621

root@OpenWrt:~# ethtool eth8
Settings for eth8:
	Supported ports: [  ]
	Supported link modes:   1000baseX/Full
	                        10000baseCR/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Link detected: no

root@OpenWrt:~# ethtool -m eth9
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : FS
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFPP-PC01
	Vendor rev                                : P
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : Y2105169778-2
	Date code                                 : 210621

root@OpenWrt:~# ethtool eth9
Settings for eth9:
	Supported ports: [  ]
	Supported link modes:   1000baseX/Full
	                        10000baseCR/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Link detected: no

Removing the cable shows the following on the console:

[7395.617738] sfp dpmac1_sfp: module removed
[7362.253355] sfp dpmac2_sfp: module removed

Cable #3, 1 meter pasive DAC 10Gtek CAB-10GSFP-P1M
When I plug it in to eth8 and eth9 I see the following messages on the console:

[7897.170402] sfp dpmac2_sfp: module OEM        SFP-H10GB-CU1M     rev R    sn CSC191101450032  dc 191114
[7905.165162] sfp dpmac1_sfp: module OEM        SFP-H10GB-CU1M     rev R    sn CSC191101450032  dc 191114

root@OpenWrt:~# ifup eth8
[8281.723491] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode
root@OpenWrt:~# ifup eth9
[8288.066803] fsl_dpaa2_eth dpni.0 eth9: configuring for inband/10gbase-r link mode

The link does not come up.

root@OpenWrt:~# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff
root@OpenWrt:~# ip link show eth9
11: eth9: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:19 brd ff:ff:ff:ff:ff:ff

root@OpenWrt:~# cat /sys/kernel/debug/dpmac2_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# cat /sys/kernel/debug/dpmac1_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# restool dpmac info dpmac.2
dpmac version: 4.5
dpmac object id/portal id: 2
plugged state: plugged
endpoint state: 0
endpoint: dpni.1, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:1a
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# restool dpmac info dpmac.1
dpmac version: 4.5
dpmac object id/portal id: 1
plugged state: plugged
endpoint state: 0
endpoint: dpni.0, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:19
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# ethtool -m eth8
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : OEM
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFP-H10GB-CU1M
	Vendor rev                                : R
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : CSC191101450032
	Date code                                 : 191114

root@OpenWrt:~# ethtool eth8
Settings for eth8:
	Supported ports: [  ]
	Supported link modes:   1000baseX/Full
	                        10000baseCR/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Link detected: no

root@OpenWrt:~# ethtool -m eth9
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x21 (Copper pigtail)
	Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x04 0x00 0x00 0x00
	Transceiver type                          : Passive Cable
	Encoding                                  : 0x00 (unspecified)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 0m
	Length (62.5um)                           : 0m
	Length (Copper)                           : 1m
	Length (OM3)                              : 0m
	Passive Cu cmplnce.                       : 0x01 (SFF-8431 appendix E) [SFF-8472 rev10.4 only]
	Vendor name                               : OEM
	Vendor OUI                                : 00:40:20
	Vendor PN                                 : SFP-H10GB-CU1M
	Vendor rev                                : R
	Option values                             : 0x00 0x00
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : CSC191101450032
	Date code                                 : 191114

root@OpenWrt:~# ethtool eth9
Settings for eth9:
	Supported ports: [  ]
	Supported link modes:   1000baseX/Full
	                        10000baseCR/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseCR/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: Direct Attach Copper
	PHYAD: 0
	Transceiver: internal
	Link detected: no

Removing the cable shows the following on the console:

[8850.638285] sfp dpmac1_sfp: module removed
[8854.115967] sfp dpmac2_sfp: module removed

Cable #4, 1 meter fiber FS P/N SFP-10GLRM-31 GE transceivers
When I plug it in to eth8 and eth9 I see the following messages on the console:

[9147.873806] sfp dpmac2_sfp: module FS        SFP-10GLRM-31     rev A    sn S2202155110  dc 220309
[9147.901328] hwmon hwmon5: temp1_input not attached to any thermal zone
[9154.844997] sfp dpmac1_sfp: module FS        SFP-10GLRM-31     rev A    sn S2202155109 dc 220309
[9154.072410] hwmon hwmon6: temp1_input not attached to any thermal zone


root@OpenWrt:~# ifup eth8
[9522.651271] fsl_dpaa2_eth dpni.1 eth8: configuring for inband/10gbase-r link mode
root@OpenWrt:~# ifup eth9
[9529.333020] fsl_dpaa2_eth dpni.0 eth9: configuring for inband/10gbase-r link mode

The link does not come up.

root@OpenWrt:~# ip link show eth8
10: eth8: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:1a brd ff:ff:ff:ff:ff:ff
root@OpenWrt:~# ip link show eth9
11: eth9: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000
    link/ether 00:0a:fa:24:25:19 brd ff:ff:ff:ff:ff:ff

root@OpenWrt:~# cat /sys/kernel/debug/dpmac2_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# cat /sys/kernel/debug/dpmac1_sfp/state
Module state: present
Module probe attempts: 0 0
Device state: up
Main state: link_up
Fault recovery remaining retries: 5
PHY probe remaining retries: 12
moddef0: 1
rx_los: 0
tx_fault: 0
tx_disable: 0

root@OpenWrt:~# restool dpmac info dpmac.2
dpmac version: 4.5
dpmac object id/portal id: 2
plugged state: plugged
endpoint state: 0
endpoint: dpni.1, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:1a
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# restool dpmac info dpmac.1
dpmac version: 4.5
dpmac object id/portal id: 1
plugged state: plugged
endpoint state: 0
endpoint: dpni.0, link is down
DPMAC link type: DPMAC_LINK_TYPE_PHY
DPMAC ethernet interface: DPMAC_ETH_IF_XFI
MAC address: 00:0a:fa:24:25:19
maximum supported rate 10000 Mbps
Counters: 
--- all 0 ---

root@OpenWrt:~# ethtool -m eth8
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x07 (LC)
	Transceiver codes                         : 0x40 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
	Transceiver type                          : 10G Ethernet: 10G Base-LRM
	Encoding                                  : 0x06 (64B/66B)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 220m
	Length (62.5um)                           : 110m
	Length (Copper)                           : 0m
	Length (OM3)                              : 0m
	Laser wavelength                          : 1310nm
	Vendor name                               : FS
	Vendor OUI                                : 64:9d:99
	Vendor PN                                 : SFP-10GLRM-31
	Vendor rev                                : A
	Option values                             : 0x01 0x1a
	Option                                    : RX_LOS implemented
	Option                                    : TX_FAULT implemented
	Option                                    : TX_DISABLE implemented
	Option                                    : Linear receiver output implemented
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : S2202155110
	Date code                                 : 220309
	Optical diagnostics support               : Yes
	Laser bias current                        : 45.390 mA
	Laser output power                        : 0.9382 mW / -0.28 dBm
	Receiver signal average optical power     : 0.8911 mW / -0.50 dBm
	Module temperature                        : 45.44 degrees C / 113.79 degrees F
	Module voltage                            : 3.2351 V
	Alarm/warning flags implemented           : Yes
	Laser bias current high alarm             : Off
	Laser bias current low alarm              : Off
	Laser bias current high warning           : Off
	Laser bias current low warning            : Off
	Laser output power high alarm             : Off
	Laser output power low alarm              : Off
	Laser output power high warning           : Off
	Laser output power low warning            : Off
	Module temperature high alarm             : Off
	Module temperature low alarm              : Off
	Module temperature high warning           : Off
	Module temperature low warning            : Off
	Module voltage high alarm                 : Off
	Module voltage low alarm                  : Off
	Module voltage high warning               : Off
	Module voltage low warning                : Off
	Laser rx power high alarm                 : Off
	Laser rx power low alarm                  : Off
	Laser rx power high warning               : Off
	Laser rx power low warning                : Off
	Laser bias current high alarm threshold   : 100.000 mA
	Laser bias current low alarm threshold    : 10.000 mA
	Laser bias current high warning threshold : 80.000 mA
	Laser bias current low warning threshold  : 20.000 mA
	Laser output power high alarm threshold   : 1.4125 mW / 1.50 dBm
	Laser output power low alarm threshold    : 0.0955 mW / -10.20 dBm
	Laser output power high warning threshold : 1.1220 mW / 0.50 dBm
	Laser output power low warning threshold  : 0.1514 mW / -8.20 dBm
	Module temperature high alarm threshold   : 100.00 degrees C / 212.00 degrees F
	Module temperature low alarm threshold    : -50.00 degrees C / -58.00 degrees F
	Module temperature high warning threshold : 85.00 degrees C / 185.00 degrees F
	Module temperature low warning threshold  : -40.00 degrees C / -40.00 degrees F
	Module voltage high alarm threshold       : 4.0000 V
	Module voltage low alarm threshold        : 3.0000 V
	Module voltage high warning threshold     : 3.5000 V
	Module voltage low warning threshold      : 3.1000 V
	Laser rx power high alarm threshold       : 1.4125 mW / 1.50 dBm
	Laser rx power low alarm threshold        : 0.0145 mW / -18.39 dBm
	Laser rx power high warning threshold     : 1.1220 mW / 0.50 dBm
	Laser rx power low warning threshold      : 0.0363 mW / -14.40 dBm

root@OpenWrt:~# ethtool eth8
Settings for eth8:
	Supported ports: [ FIBRE ]
	Supported link modes:   10000baseLRM/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseLRM/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: FIBRE
	PHYAD: 0
	Transceiver: internal
	Link detected: no

root@OpenWrt:~# ethtool -m eth9
	Identifier                                : 0x03 (SFP)
	Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
	Connector                                 : 0x07 (LC)
	Transceiver codes                         : 0x40 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
	Transceiver type                          : 10G Ethernet: 10G Base-LRM
	Encoding                                  : 0x06 (64B/66B)
	BR, Nominal                               : 10300MBd
	Rate identifier                           : 0x00 (unspecified)
	Length (SMF,km)                           : 0km
	Length (SMF)                              : 0m
	Length (50um)                             : 220m
	Length (62.5um)                           : 110m
	Length (Copper)                           : 0m
	Length (OM3)                              : 0m
	Laser wavelength                          : 1310nm
	Vendor name                               : FS
	Vendor OUI                                : 64:9d:99
	Vendor PN                                 : SFP-10GLRM-31
	Vendor rev                                : A
	Option values                             : 0x01 0x1a
	Option                                    : RX_LOS implemented
	Option                                    : TX_FAULT implemented
	Option                                    : TX_DISABLE implemented
	Option                                    : Linear receiver output implemented
	BR margin, max                            : 0%
	BR margin, min                            : 0%
	Vendor SN                                 : S2202155109
	Date code                                 : 220309
	Optical diagnostics support               : Yes
	Laser bias current                        : 46.664 mA
	Laser output power                        : 0.5983 mW / -2.23 dBm
	Receiver signal average optical power     : 1.2240 mW / 0.88 dBm
	Module temperature                        : 50.63 degrees C / 123.13 degrees F
	Module voltage                            : 3.1742 V
	Alarm/warning flags implemented           : Yes
	Laser bias current high alarm             : Off
	Laser bias current low alarm              : Off
	Laser bias current high warning           : Off
	Laser bias current low warning            : Off
	Laser output power high alarm             : Off
	Laser output power low alarm              : Off
	Laser output power high warning           : Off
	Laser output power low warning            : Off
	Module temperature high alarm             : Off
	Module temperature low alarm              : Off
	Module temperature high warning           : Off
	Module temperature low warning            : Off
	Module voltage high alarm                 : Off
	Module voltage low alarm                  : Off
	Module voltage high warning               : Off
	Module voltage low warning                : Off
	Laser rx power high alarm                 : Off
	Laser rx power low alarm                  : Off
	Laser rx power high warning               : On
	Laser rx power low warning                : Off
	Laser bias current high alarm threshold   : 100.000 mA
	Laser bias current low alarm threshold    : 10.000 mA
	Laser bias current high warning threshold : 80.000 mA
	Laser bias current low warning threshold  : 20.000 mA
	Laser output power high alarm threshold   : 1.4125 mW / 1.50 dBm
	Laser output power low alarm threshold    : 0.0955 mW / -10.20 dBm
	Laser output power high warning threshold : 1.1220 mW / 0.50 dBm
	Laser output power low warning threshold  : 0.1514 mW / -8.20 dBm
	Module temperature high alarm threshold   : 100.00 degrees C / 212.00 degrees F
	Module temperature low alarm threshold    : -50.00 degrees C / -58.00 degrees F
	Module temperature high warning threshold : 85.00 degrees C / 185.00 degrees F
	Module temperature low warning threshold  : -40.00 degrees C / -40.00 degrees F
	Module voltage high alarm threshold       : 4.0000 V
	Module voltage low alarm threshold        : 3.0000 V
	Module voltage high warning threshold     : 3.5000 V
	Module voltage low warning threshold      : 3.1000 V
	Laser rx power high alarm threshold       : 1.4125 mW / 1.50 dBm
	Laser rx power low alarm threshold        : 0.0145 mW / -18.39 dBm
	Laser rx power high warning threshold     : 1.1220 mW / 0.50 dBm
	Laser rx power low warning threshold      : 0.0363 mW / -14.40 dBm

root@OpenWrt:~# ethtool eth9
Settings for eth9:
	Supported ports: [ FIBRE ]
	Supported link modes:   10000baseLRM/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: Yes
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseLRM/Full
	Advertised pause frame use: Symmetric Receive-only
	Advertised auto-negotiation: Yes
	Advertised FEC modes: Not reported
	Speed: Unknown!
	Duplex: Unknown! (255)
	Auto-negotiation: on
	Port: FIBRE
	PHYAD: 0
	Transceiver: internal
	Link detected: no

Removing the cable shows the following on the console:

[11350.377752] sfp dpmac1_sfp: module removed
[11358.375424] sfp dpmac2_sfp: module removed
1 Like
10

Hmm… I think everything on the Linux side is setup correctly.
It could be a lower level setting that isn’t in sync.

Just to double check, can you post the boot output from these lines:

INFO:    SPSR = 0x3c9

U-Boot 2020.07-rc1-ga94e0d21 (Mar 15 2022 - 03:55:15 +0000)

SoC:  LS1088AE Rev1.0 (0x87030010)

through to

Hit any key to stop autoboot:  0

(redact any MAC addresses/serials if you wish, I can grab them from you from a PM)

11

No problem.

INFO:    SPSR = 0x3c9


U-Boot 2020.07-rc1-ga94e0d21 (Mar 15 2022 - 03:55:15 +0000)

SoC:  LS1088AE Rev1.0 (0x87030010)
Clock Configuration:
       CPU0(A53):1600 MHz  CPU1(A53):1600 MHz  CPU2(A53):1600 MHz  
       CPU3(A53):1600 MHz  CPU4(A53):1600 MHz  CPU5(A53):1600 MHz  
       CPU6(A53):1600 MHz  CPU7(A53):1600 MHz  
       Bus:      700  MHz  DDR:      2100 MT/s
Reset Configuration Word (RCW):
       00000000: 4000541c 00000040 00000000 00000000
       00000010: 00000000 000a0000 00300000 00000000
       00000020: 010011a0 00002580 00000000 00000000
       00000030: 013fe60b 00000000 00002c03 00000000
       00000040: 00000000 00000000 00000000 00000000
       00000050: 00000000 00000000 00000000 00000000
       00000060: 00000000 00000000 00000089 000009e7
       00000070: 44110000 0d007755
DRAM:  7.9 GiB
DDR    7.9 GiB (DDR4, 64-bit, CL=15, ECC on)
	7.4 GiB available for userspace

Using SERDES1 Protocol: 29 (0x1d)
Using SERDES2 Protocol: 20 (0x14)
PCIe0: pcie@3400000 Root Complex: no link
PCIe1: pcie@3500000 Root Complex: x1 gen2
PCIe2: pcie@3600000 Root Complex: x2 gen3
Retimer: (retimer on, resetting...) DS110DF410 found
OK
USB Hub:    No PCI card found in Key B
OK
Fan controller: OK
MMC:   FSL_SDHC: 0
Loading Environment from SPI Flash... SF: Detected en25s64 with page size 256 Bytes, erase size 64 KiB, total 8 MiB
OK
uC:    MACADDR: 00:0A:FA:24:25:11
DPMAC7: 00:0A:FA:24:25:11
DPMAC8: 00:0A:FA:24:25:12
DPMAC9: 00:0A:FA:24:25:13
DPMAC10: 00:0A:FA:24:25:14
DPMAC3: 00:0A:FA:24:25:15
DPMAC4: 00:0A:FA:24:25:16
DPMAC5: 00:0A:FA:24:25:17
DPMAC6: 00:0A:FA:24:25:18
DPMAC1: 00:0A:FA:24:25:19
DPMAC2: 00:0A:FA:24:25:1A
In:    serial
Out:   serial
Err:   serial
Model: Traverse Ten64
Board: 1064-0201C, boot from QSPI
Net:   eth0: DPMAC1@xgmii, eth1: DPMAC2@xgmii, eth2: DPMAC3@qsgmii, eth3: DPMAC4@qsgmii, eth4: DPMAC5@qsgmii, eth5: DPMAC6@qsgmii, eth6: DPMAC7@qsgmii [PRIME], eth7: DPMAC8@qsgmii, eth8: DPMAC9@qsgmii, eth9: DPMAC10@qsgmii
SF: Detected en25s64 with page size 256 Bytes, erase size 64 KiB, total 8 MiB
device 0 offset 0x300000, size 0x200000
SF: 2097152 bytes @ 0x300000 Read: OK
device 0 offset 0x5c0000, size 0x40000
SF: 262144 bytes @ 0x5c0000 Read: OK
crc32+ 
fsl-mc: Booting Management Complex ... SUCCESS
fsl-mc: Management Complex booted (version: 10.20.4, boot status: 0x1)
Hit any key to stop autoboot:  0
12

Have PM’ed you - it looks like you have a pre-production board and it’s possible a fault in the SFPs may not have been detected (there was no in-factory testing for these boards). We will organize a swap for production ones.