iperf3 and Chelsio T6225-CR

I ran four tests yesterday using iperf3. The T6225-CR NIC still runs with Chelsio’s SM10G-SR optics. It’s amazing that receiving TCP streams runs at full speed. Sending TCP streams limps away only at a few megabits per second. This wasn’t expected at all. Even IPv6 runs faster than IPv4 for these particular tests. The Cisco switch at the other end uses Fiberworks’ SFP-10G-SR optics. Does anyone have any clues? Continue reading iperf3 and Chelsio T6225-CR

Chelsio T6225-CR and TOE

After upgrading to a recent base/stable/11, I noticed ifconfig -m now displays two more bits:

cc0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
             options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,          VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        capabilities=ecc7bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,TOE4,TOE6,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:XX:XX:X0
        hwaddr 00:07:43:XX:XX:X0
        nd6 options=8021<PERFORMNUD,AUTO_LINKLOCAL,DEFAULTIF>
        media: Ethernet 10Gbase-SR <full-duplex,rxpause,txpause>
        status: active
        supported media:
                media 10Gbase-SR mediaopt full-duplex,rxpause,txpause
                media 10Gbase-SR mediaopt full-duplex,rxpause
                media 10Gbase-SR mediaopt full-duplex,txpause
                media 10Gbase-SR mediaopt full-duplex
                media 1000baseSX mediaopt full-duplex,rxpause,txpause
                media 1000baseSX mediaopt full-duplex,rxpause
                media 1000baseSX mediaopt full-duplex,txpause
                media 1000baseSX mediaopt full-duplex

TOE4 and TOE6 appear in the capabilities word, but not in the options word. (TOE in this case being TCP Offload Engine.) Continue reading Chelsio T6225-CR and TOE

Chelsio T6225-CR and SM10G-SR

I finally got my two Chelsio SM10G-SR SFP+ optical modules. First light have finally been achieved.

cc0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:07:43:XX:XX:X0
        hwaddr 00:07:43:XX:XX:X0
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet 10Gbase-SR <full-duplex,rxpause,txpause>
        status: active

Continue reading Chelsio T6225-CR and SM10G-SR

Chelsio T6225-CR has arrived

Boot messages for stable/11:

t6nex0: <Chelsio T6225-CR> mem 0xfac80000-0xfacfffff,0xf9000000-0xf9ffffff,0xfaff6000-0xfaff7fff irq 16 at device 0.4 on pci6
t6nex0: firmware on card (1.16.63.0) is older than the version bundled with this driver, installing firmware 1.19.1.0 on card.
cc0: <port 0> on t6nex0
cc0: Ethernet address: 00:07:43:XX:XX:X0
cc0: 4 txq, 4 rxq (NIC); 4 txq, 2 rxq (TOE)
cc1: <port 1> on t6nex0
cc1: Ethernet address: 00:07:43:XX:XX:X8
cc1: 4 txq, 4 rxq (NIC); 4 txq, 2 rxq (TOE)
t6nex0: PCIe gen2 x4, 2 ports, 14 MSI-X interrupts, 31 eq, 13 iq
pci6: <mass storage, SCSI> at device 0.5 (no driver attached)
pci6: <serial bus, Fibre Channel> at device 0.6 (no driver attached)

The firmware was in need of an upgrade. Continue reading Chelsio T6225-CR has arrived

Chelsio T6225-CR and SM25G-SR

I recently ordered a Chelsio T6225-CR network interface card and a couple of SM25G-SR SFP28 optical modules.

The aim is to get a 10 Gbit/s connection to the LAN, utilise the off-load capabilities of the NIC, and of course utilise the on-board crypto accelerator. The latter will not be useable until the system moves to the upcoming stable/12 branch.

Speaking of stable/12, I look forward to encrypted crash dumps and linear ZFS scrubbing.

I hope both OpenSSH and OpenSSL will be able to use the crypto accelerator by ways of crypto(4). Imagine a crypto speed in excess of 30 Gbit/s. That’s pretty neat. If all goes well, another T6225-CR may find its way to a VPN router.