Ethernet not working on Orin Nano 4G

[fre-wolf]

Hello,
I have an Orin Nano 4G (P3767-0004) on a custom carrier board booting from USB. I am working with the Tegra-demo-distro (core image minimal with an edit to tegra-bootfiles to set the cvb_eeprom_read_size to 0) and I'm trying to get the onboard ethernet working. An ethernet cable is plugged in and the LEDs show link.
I got the ethernet working on the same hardware setup with the xavier nx emmc using meta-tegra layer on a poky-based system (I've already tried the exact same metadata with the p3768-0000-p3767-0004 machine on orin nano, but no success).

On the Orin System:

root@p3768-0000-p3767-0004:~# cat /proc/net/dev
Inter-|   Receive                                                |  Transmit
 face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:     608       8    0    0    0     0          0         0      608       8    0    0    0     0       0          0
dummy0:       0       0    0    0    0     0          0         0        0       0    0    0    0     0       0          0
root@p3768-0000-p3767-0004:~# dmesg | grep eth
[    0.000000] psci: probing for conduit method from DT.
[    2.438476] usbcore: registered new interface driver cdc_ether
[    4.232114] optee: probing for conduit method.
root@p3768-0000-p3767-0004:~# dmesg | grep net
[    0.000000] Kernel command line: mminit_loglevel=4 console=ttyTCU0,115200 firmware_class.path=/etc/firmware fbcon=map:0 net.ifnames=0 nospectre_bhb 
[    0.253635] audit: initializing netlink subsys (disabled)
[    2.368518] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    2.391223] igb: Intel(R) Gigabit Ethernet Network Driver
[    2.444407] usbcore: registered new interface driver net1080
[    4.314360] Initializing XFRM netlink socket
[    4.335443] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    4.369177] 9pnet: Installing 9P2000 support
[   10.863279] systemd[1]: Starting Generate network units from Kernel command line...

same command on the xavier nx:

root@illuminati:~# cat /proc/net/dev
Inter-|   Receive                                                |  Transmit
 face |bytes    packets errs drop fifo frame compressed multicast|bytes    packets errs drop fifo colls carrier compressed
    lo:  144437    1419    0    0    0     0          0         0   144437    1419    0    0    0     0       0          0
dummy0:       0       0    0    0    0     0          0         0   347570    1098    0    0    0     0       0          0
  eth0: 6368880   93293    0    0    0     0          0         0  1721139    9428    0    0    0     0       0          0
root@illuminati:~# dmesg | grep net
[    0.296821] audit: initializing netlink subsys (disabled)
[    2.555933] hns3: Hisilicon Ethernet Network Driver for Hip08 Family - version
[    2.579199] igb: Intel(R) Gigabit Ethernet Network Driver
[    2.632643] usbcore: registered new interface driver net1080
[    4.049445] Initializing XFRM netlink socket
[    4.054438] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[    4.056733] 9pnet: Installing 9P2000 support
[    7.298969] nvethernet 2490000.ethernet: Adding to iommu group 28
[    7.307201] nvethernet 2490000.ethernet: failed to read skip mac reset flag, default 0
[    7.320672] nvethernet 2490000.ethernet: failed to read MDIO address
[    7.320680] nvethernet 2490000.ethernet: setting to default DMA bit mask
[    7.320690] nvethernet 2490000.ethernet: set default TXQ to TC mapping
[    7.334956] nvethernet 2490000.ethernet: Setting default PTP RX queue
[    7.388143] nvethernet 2490000.ethernet: Failed to read DMA Tx ring size, using default [1024]
[    7.433392] nvethernet 2490000.ethernet: Failed to read DMA Rx ring size, using default [1024]
[    7.446642] nvethernet 2490000.ethernet: missing nvidia,pad_auto_cal_pu_offset, setting default 0
[    7.459752] nvethernet 2490000.ethernet: missing nvidia,pad_auto_cal_pd_offset, setting default 0
[    7.714065] nvethernet 2490000.ethernet: failed to get eqos_rx_m clk
[    7.714259] nvethernet 2490000.ethernet: failed to get eqos_rx_input clk
[    7.714441] nvethernet 2490000.ethernet: failed to get eqos_tx_divider clk
[    7.721934] nvethernet 2490000.ethernet: Ethernet MAC address: 48:b0:2d:76:20:a1
[    7.728578] nvethernet 2490000.ethernet: Macsec not supported/Not enabled in DT
[    7.736359] nvethernet 2490000.ethernet: eth0 (HW ver: 50) created with 1 DMA channels
[   10.218933] systemd[1]: Starting Generate network units from Kernel command line...
[   10.364719] systemd[1]: Finished Generate network units from Kernel command line.
[   15.590375] nvethernet 2490000.ethernet eth0: Link is Up - 1Gbps/Full - flow control off

What do I have to do to get the ethernet running?

[fre-wolf]

update: On Nvidias Ubuntu, everything works. so the problem is definitely not the SOM.

[joekale]

One thing I see in the machine conf is the bpmp dtb references 3509. I don't know that the two nvidia carrier cards were different in ethernet but it's worth checking if this is the same file that the JetPack release uses. if it's not try replacing it with what JetPack uses and see if that helps.

[madisongh]

Do you see the entry in the device tree for the interface, and is it marked with status = "okay"? The nvethernet driver should be built into the kernel by default, but it wouldn't hurt to check on that, too.

[fre-wolf]

Solved. I somehow thought the core-image-minimal would be ok as my base. Changing to core-image-base solved the issue. Also see #1506 (reply in thread)