NVIDIA Mellanox MCX653105A-HDAT + MTMK0012 bundle - ConnectX-6 VPI single-port QSFP56 adapter (HDR 200Gb/s InfiniBand or 200GbE, PCIe 3.0/4.0 x16, tall bracket) supplied with the MTMK0012 ConnectX-6 Extension Kit (PCIe Gen 3.0 x16 auxiliary card, two 350 mm harnesses). Condition: Refurbished, tested by T.E.S IT-SOLUTIONS.
Technical Identity
This is a two-part bundle, not a single NVIDIA OPN. Item 1 is the MCX653105A-HDAT, a single-port ConnectX-6 VPI host channel adapter - NVIDIA's description is "ConnectX-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, single-port QSFP56, PCIe4.0 x16, tall bracket" - a half-height half-length 167.65 x 68.90 mm board on the MT28908A0-XCCF-HVM device. Item 2 is MTMK0012, catalogued through the NVIDIA/Mellanox channel as the ConnectX-6 Extension Kit: a PCIe Gen 3.0 x16 Auxiliary PCIe Connection Card plus two 350 mm I-PEX harness cables (HPE lists it as spare P/N P10234-001). Those parts match the auxiliary half NVIDIA documents inside its ConnectX-6 Socket Direct kits. No transceivers or QSFP56 cables are included.
Stated plainly: NVIDIA does not publish MTMK0012 as a standalone ordering part number, and does not list MCX653105A-HDAT among its Socket Direct parts - the documented single-port HDR Socket Direct kit is MCX654105A-HCAT. We therefore make no claim that NVIDIA qualifies this pairing as a Socket Direct configuration.
Engineering Context
HDR InfiniBand is four lanes at 53.125 Gb/s line rate with 64b/66b encoding for 200 Gb/s effective on the QSFP56 port; in Ethernet mode the same lanes carry 200GBASE-CR4/KR4/SR4. ConnectX-6 is IBTA v1.4 compliant, sub-600 ns latency, up to 200 million messages per second. NVIDIA states a ConnectX-6 in one PCIe x16 slot supports up to 100Gb/s in a Gen 3.0 slot and up to 200Gb/s in a Gen 4.0 slot, so HDR line rate needs Gen 4. Typical adapter power is 19.3 W passive with 5 W to the module; airflow 350 LFM at 55 deg C heatsink-to-port. An auxiliary PCIe path runs Gen 3.0 x16 only - never Gen 4 - and exists to give a second CPU its own root-complex route to the adapter instead of crossing the QPI/UPI link. Offloads: RDMA, RoCEv2, GPUDirect RDMA, MPI tag matching, NVMe-oF, T10-DIF, SR-IOV, ASAP2.
Deployment & Use Cases
Dual-socket HPC and AI compute nodes: MPI over NVIDIA HPC-X or OpenMPI on HDR InfiniBand; NCCL collectives with GPUDirect RDMA and GPUDirect Storage; NVMe-over-Fabrics endpoints pinned per NUMA node; Lustre and Spectrum Scale (GPFS) clients; 200GbE RoCEv2 uplinks in Spectrum fabrics.
Technical Specifications
Bundle item 1: NVIDIA Mellanox MCX653105A-HDAT ConnectX-6 VPI adapter
Bundle item 2: MTMK0012 ConnectX-6 Extension Kit - PCIe Gen 3.0 x16 auxiliary card + 2 x 350 mm harnesses
Ports: 1 x QSFP56, copper and optical
Port speed: HDR 200Gb/s InfiniBand or 200GbE Ethernet
InfiniBand: SDR/DDR/QDR/FDR/EDR/HDR100/HDR, IBTA v1.4
Ethernet: 1/10/25/40/50/100/200 GbE
Adapter host interface: PCIe Gen 3.0/4.0 @ 8.0/16.0 GT/s, x16
Auxiliary card interface: PCIe Gen 3.0 @ 8.0 GT/s, x16
Adapter form factor: half-height half-length, 167.65 x 68.90 mm, tall bracket
Power / airflow: 19.3 W typical passive; 350 LFM at 55 deg C heatsink-to-port
Condition: Refurbished - tested by T.E.S IT-SOLUTIONS
Compatibility & Parent Systems
InfiniBand switches: NVIDIA Quantum HDR QM8700 (managed) and QM8790 (externally managed), 40 x HDR 200Gb/s QSFP56. Down-negotiates to EDR 100Gb/s against Switch-IB 2 SB7800 / SB7890.
Ethernet switches: Spectrum-2 SN3700 (32 x 200GbE QSFP56) and Spectrum-3 SN4600 (64 x 200GbE QSFP56); SN3700C, SN3800, SN4600C and SN2700 at 100GbE.
Cabling: QSFP56 - NVIDIA LinkX MCP1650-H DAC, MFS1S00-H AOC, MMA1T00-HS transceiver, MCP7H50-H HDR-to-2x-HDR100 splitters.
Host requirement: one PCIe x16 slot for the adapter (Gen 4.0 for 200Gb/s). To use the auxiliary card you need a second free PCIe x16 slot in the same chassis, ideally on the second CPU, within 350 mm of the first. Typical hosts: Dell PowerEdge R740/R750, HPE ProLiant DL380 Gen10, Lenovo ThinkSystem SR650, Supermicro 2U GPU nodes.
Drivers and port mode: MLNX_OFED (Linux), WinOF-2 (Windows), ESXi builds. Set protocol with mlxconfig -d <device> set LINK_TYPE_P1=<IB or ETH>, then reboot.
What This Is NOT
NOT a factory NVIDIA Socket Direct kit. NVIDIA's single-port HDR Socket Direct product is MCX654105A-HCAT, shipped as one OPN.
NOT a guaranteed Socket Direct pairing. We do not claim NVIDIA qualifies this combination; ask us to verify the specific boards if Socket Direct is a requirement.
NOT usable in a single-slot chassis for the auxiliary path. The auxiliary card needs its own x16 slot within 350 mm of the adapter.
NOT Multi-Host. Socket Direct on ConnectX-6 serves one OS image across two PCIe paths, not two independent hosts.
NOT PCIe Gen 4 on the auxiliary path. ConnectX-6 auxiliary cards are Gen 3.0 x16 at 8.0 GT/s.
NOT NDR capable, and NOT supplied with transceivers, DAC/AOC cables or risers.
Frequently Asked Questions
Q. What is MTMK0012?
MTMK0012 is catalogued through the NVIDIA/Mellanox channel as a ConnectX-6 Extension Kit: a PCIe Gen 3.0 x16 auxiliary connection card plus two 350 mm I-PEX harness cables. HPE lists it as spare P/N P10234-001. It matches the auxiliary components NVIDIA documents inside ConnectX-6 Socket Direct kits.
Q. Does MCX653105A-HDAT plus MTMK0012 give a certified Socket Direct configuration?
We cannot state that it does. NVIDIA documents MCX653105A-HDAT as a single PCIe x16 edge-connector card and lists MCX654105A-HCAT as the single-port HDR Socket Direct kit. Whether a given board accepts the auxiliary harness depends on revision and connector population. If Socket Direct is a hard requirement, specify MCX654105A-HCAT or ask us to verify the exact units first.
Q. What does the host server need for this bundle?
One PCIe x16 slot for the adapter, Gen 4.0 for 200Gb/s line rate. To use the auxiliary card, a second free PCIe x16 slot in the same chassis within 350 mm of the first, ideally mapped to the second CPU of a dual-socket server.
Q. What switch models does this bundle connect to?
InfiniBand: NVIDIA Quantum HDR QM8700 and QM8790 (40 x HDR 200Gb/s QSFP56), and EDR Switch-IB 2 SB7800/SB7890 at 100Gb/s. Ethernet: Spectrum-2 SN3700 and Spectrum-3 SN4600 at 200GbE, SN3700C/SN3800/SN4600C/SN2700 at 100GbE.
Q. What condition is supplied by T.E.S IT-SOLUTIONS?
Refurbished. The adapter is bench-tested for PCIe x16 lane training, QSFP56 link-up and firmware integrity; the MTMK0012 auxiliary card and harnesses are inspected for continuity and connector condition. Packed anti-static, EU stock.
Why T.E.S IT-SOLUTIONS
T.E.S IT-SOLUTIONS (tes-itsolutions.com) supplies NVIDIA Mellanox networking hardware from EU stock and states plainly what is verified and what is not. Handling 1-3 business days, international shipping, plus consultation on HDR fabric design and slot mapping.