NVIDIA Mellanox MCX653105A-HDAT + MTMK0012 bundle - ConnectX-6 VPI single-port QSFP56 adapter (HDR 200Gb/s InfiniBand or 200GbE, PCIe 3.0/4.0 x16, tall bracket) supplied with the MTMK0012 ConnectX-6 Extension Kit (PCIe Gen 3.0 x16 auxiliary card, two 350 mm harnesses). Condition: Refurbished, tested by T.E.S IT-SOLUTIONS.
Technical Identity
This is a two-part bundle, not a single NVIDIA OPN. Item 1 is the MCX653105A-HDAT, a single-port ConnectX-6 VPI host channel adapter - NVIDIA's description is "ConnectX-6 InfiniBand/Ethernet adapter card, HDR IB (200Gb/s) and 200GbE, single-port QSFP56, PCIe4.0 x16, tall bracket" - a half-height half-length 167.65 x 68.90 mm board on the MT28908A0-XCCF-HVM device. Item 2 is MTMK0012, catalogued through the NVIDIA/Mellanox channel as the ConnectX-6 Extension Kit: a PCIe Gen 3.0 x16 Auxiliary PCIe Connection Card plus two 350 mm I-PEX harness cables (HPE lists it as spare P/N P10234-001). Those parts match the auxiliary half NVIDIA documents inside its ConnectX-6 Socket Direct kits. No transceivers or QSFP56 cables are included.
Stated plainly: NVIDIA does not publish MTMK0012 as a standalone ordering part number, and does not list MCX653105A-HDAT among its Socket Direct parts - the documented single-port HDR Socket Direct kit is MCX654105A-HCAT. We therefore make no claim that NVIDIA qualifies this pairing as a Socket Direct configuration.
Engineering Context
HDR InfiniBand is four lanes at 53.125 Gb/s line rate with 64b/66b encoding for 200 Gb/s effective on the QSFP56 port; in Ethernet mode the same lanes carry 200GBASE-CR4/KR4/SR4. ConnectX-6 is IBTA v1.4 compliant, sub-600 ns latency, up to 200 million messages per second. NVIDIA states a ConnectX-6 in one PCIe x16 slot supports up to 100Gb/s in a Gen 3.0 slot and up to 200Gb/s in a Gen 4.0 slot, so HDR line rate needs Gen 4. Typical adapter power is 19.3 W passive with 5 W to the module; airflow 350 LFM at 55 deg C heatsink-to-port. An auxiliary PCIe path runs Gen 3.0 x16 only - never Gen 4 - and exists to give a second CPU its own root-complex route to the adapter instead of crossing the QPI/UPI link. Offloads: RDMA, RoCEv2, GPUDirect RDMA, MPI tag matching, NVMe-oF, T10-DIF, SR-IOV, ASAP2.
Deployment & Use Cases
Dual-socket HPC and AI compute nodes: MPI over NVIDIA HPC-X or OpenMPI on HDR InfiniBand; NCCL collectives with GPUDirect RDMA and GPUDirect Storage; NVMe-over-Fabrics endpoints pinned per NUMA node; Lustre and Spectrum Scale (GPFS) clients; 200GbE RoCEv2 uplinks in Spectrum fabrics.
Technical Specifications
Manufacturer documentation: NVIDIA ConnectX-6 VPI adapter card user manual: introduction. T.E.S IT-SOLUTIONS is independent of NVIDIA.
Compatibility & Parent Systems
InfiniBand switches: NVIDIA Quantum HDR QM8700 (managed) and QM8790 (externally managed), 40 x HDR 200Gb/s QSFP56. Down-negotiates to EDR 100Gb/s against Switch-IB 2 SB7800 / SB7890.
Ethernet switches: Spectrum-2 SN3700 (32 x 200GbE QSFP56) and Spectrum-3 SN4600 (64 x 200GbE QSFP56); SN3700C, SN3800, SN4600C and SN2700 at 100GbE.
Cabling: QSFP56 - NVIDIA LinkX MCP1650-H DAC, MFS1S00-H AOC, MMA1T00-HS transceiver, MCP7H50-H HDR-to-2x-HDR100 splitters.
Host requirement: one PCIe x16 slot for the adapter (Gen 4.0 for 200Gb/s). To use the auxiliary card you need a second free PCIe x16 slot in the same chassis, ideally on the second CPU, within 350 mm of the first. Typical hosts: Dell PowerEdge R740/R750, HPE ProLiant DL380 Gen10, Lenovo ThinkSystem SR650, Supermicro 2U GPU nodes.
Drivers and port mode: MLNX_OFED (Linux), WinOF-2 (Windows), ESXi builds. Set protocol with mlxconfig -d <device> set LINK_TYPE_P1=<IB or ETH>, then reboot.
What This Is NOT
NOT a factory NVIDIA Socket Direct kit. NVIDIA's single-port HDR Socket Direct product is MCX654105A-HCAT, shipped as one OPN.
NOT a guaranteed Socket Direct pairing. We do not claim NVIDIA qualifies this combination; ask us to verify the specific boards if Socket Direct is a requirement.
NOT usable in a single-slot chassis for the auxiliary path. The auxiliary card needs its own x16 slot within 350 mm of the adapter.
NOT Multi-Host. Socket Direct on ConnectX-6 serves one OS image across two PCIe paths, not two independent hosts.
NOT PCIe Gen 4 on the auxiliary path. ConnectX-6 auxiliary cards are Gen 3.0 x16 at 8.0 GT/s.
NOT NDR capable, and NOT supplied with transceivers, DAC/AOC cables or risers.
Frequently Asked Questions
What is MTMK0012?
MCX653105A-HDAT& MTMK0012: MTMK0012 is catalogued through the NVIDIA/Mellanox channel as a ConnectX-6 Extension Kit: a PCIe Gen 3.0 x16 auxiliary connection card plus two 350 mm I-PEX harness cables. HPE lists it as spare P/N P10234-001. It matches the auxiliary components NVIDIA documents inside ConnectX-6 Socket Direct kits.
Does MCX653105A-HDAT plus MTMK0012 give a certified Socket Direct configuration?
MCX653105A-HDAT& MTMK0012: We cannot state that it does. NVIDIA documents MCX653105A-HDAT as a single PCIe x16 edge-connector card and lists MCX654105A-HCAT as the single-port HDR Socket Direct kit. Whether a given board accepts the auxiliary harness depends on revision and connector population. If Socket Direct is a hard requirement, specify MCX654105A-HCAT or ask us to verify the exact units first.
What does the host server need for this bundle?
MCX653105A-HDAT& MTMK0012: One PCIe x16 slot for the adapter, Gen 4.0 for 200Gb/s line rate. To use the auxiliary card, a second free PCIe x16 slot in the same chassis within 350 mm of the first, ideally mapped to the second CPU of a dual-socket server.
What switch models does this bundle connect to?
MCX653105A-HDAT& MTMK0012: InfiniBand: NVIDIA Quantum HDR QM8700 and QM8790 (40 x HDR 200Gb/s QSFP56), and EDR Switch-IB 2 SB7800/SB7890 at 100Gb/s. Ethernet: Spectrum-2 SN3700 and Spectrum-3 SN4600 at 200GbE, SN3700C/SN3800/SN4600C/SN2700 at 100GbE.
What condition is supplied by T.E.S IT-SOLUTIONS?
MCX653105A-HDAT& MTMK0012: Refurbished. The adapter is checked before shipment (see Inspection and checks). Packed anti-static.
Why T.E.S IT-SOLUTIONS
T.E.S IT-SOLUTIONS (tes-itsolutions.com) supplies NVIDIA Mellanox networking hardware from Haifa, Israel and states plainly what is verified and what is not. Handling 1-3 business days, international shipping, plus consultation on HDR fabric design and slot mapping.