(completely unrelated parts of the origional quote has been omitted)PCIe slot, riser, and add-in cards :
The biggest differentiator for the Lenovo Tiny vs other Project TMM machines is that it has the ability to accommodate one half height, up to x16 PCIe card, although note the slot itself is x8. The slot on the board is not standard PCIe, you require a proprietary Lenovo riser card to make it usable and you need the right riser for your Tiny model. Also please note not all Tinys have the slot, refer to the table above for which models do.
- You can install most x1/x2/x4/x8/x16 PCIe cards as long as they are half height and shorter than 150mm (M720q and M920q) or 167mm (M90q and later), but bear in mind there is no direct airflow around the card and little space, so avoid anything too hot.
- Please note the PCIe slot's bandwidth limitations for the different series (thanks to @cadillac ).
- Note that if you are having issues with the system seeing or properly recognising your PCIe card, you can try this fix (no soldering required). Thanks @cromo !
- The slot does not natively support bifurcation, but a small modification involving soldering a resistor onto the board may work to allow x4/x4. See here for example.
Riser cards.Remember the slot is really PCIe x8. Make sure you use the correct riser for your Tiny model; if you don't, powering on will fry the motherboard.* We have reports of problems with PCIe card detection and speed with the 01AJ902 (x8) riser so I would recommend you avoid it and use 01AJ940 instead.
Tiny series Speed FRU Notes Tiny5 (eg Mx20q, etc) x4 01AJ929 x8 01AJ902 Can have issues, avoid. * x16 (electrical x8) 01AJ940 Tiny6, Tiny7 (eg M90q Gen 1, Gen 2) x4 5C50W00876 x16 (electrical x8) 5C50W00877 Tiny8 (eg M90q Gen 3) x4 5C50W00909 x16 (electrical x8) 5C50W00910 Might not work with older PCIe cards but may have a workaround **
** Thanks @Vorwrath for this important information.
Baffle/rear bracket. Note that the PCIe card bracket at the rear, which Lenovo calls a baffle, is proprietary. A baffle exists for the Intel i350-T4 four port NIC, the Intel i350-T2 two port NIC (5M10U50349 for the Mx20q - thanks @snowylake), and the Lenovo Thunderbolt card (see below) only, and nothing else that I have seen. If you are installing anything else you will therefore need to work out how to support it physically in the case without its rear bracket or somehow use/adapt the baffles that do exist, or print them.
- Please note that the baffles for the Mx20q and prior are different from those for the M90q and later. You must buy the right baffle or make sure the one you receive in the FRU is correct for your Tiny.
- M720q/920q style baffle has a larger and more square attachment on the left, the M90q and later style baffle has a curved, round lug bottom left instead. See third page of the thread for photos.
- If you have a 10GbE card, there is a thread on Reddit where a kind user has several baffles they will 3D print for you on demand for $5 (!) each plus shipping. Thanks to @adman_c he will now also do Tiny6 baffles for the SuperMicro AOC-STGN-i2s and the Mellanox CX311A. I bought some myself, the service was very prompt indeed (I'm in the UK) and the quality excellent. I have included some photos of my build in the thread.
- Here is a Tiny5 Thingiverse model for a AOC-STGN-I2S, with and without SATA cable passthrough.
PCIe add-in cards : 4x 1GbE, 4x 2.5GbE, 1x 10GbE, 2x 10GbE and Thunderbolt.
- 10GbE cards that are less than the maximum size (see above) should fit, but heat could be an issue on cards with more than two ports.
- @cptcrunch gives some great photos below on adding a 2x 10GbE Intel X-520 NIC to an M720q but note this will require the metal support on the card to be cut.
- According to the specification sheet, Mellanox MCX311A, MCX312A/B, MCX313A, and MCX314A cards will fit but I have not tried them myself.
- The Mellanox ConnectX-3 CX322A dual SFP+ card has been confirmed working on Reddit without significant effect on the heat. The user notes that it does not work with pfSense out of the box but is fine if virtualised from Proxmox.
- The Supermicro AOC-STG-I2T does not work - fan gets caught on chassis lid.
- The Supermicro AOC-STGN-I2S v1 and v2 do work and use the same chipset as the Intel X-520. Also works natively in pfSense.
- For the baffle for 10GbE cards, please see the "Baffle/rear bracket" section above.
- You can add a Lenovo Thunderbolt PCIe card which has the FRU 01AJ968 for M720q/M920q, which should come with a baffle to fit the Tiny. There's also a DP loopback cable and GPIO control cable that would be required as well and seem to be included in the FRU.
- Also please note that anecdotally you must use only the x4 PCIe riser (01AJ929) when adding specifically the Thunderbolt card, since the x8 and x16 risers stop this particular card working (other cards have no reported issues).
- Note you can use the Thunderbolt port to attach external 10GbE/SFP+ adaptors.
- There are also configurations for Thunderbolt 3 on later Tinys - M90q Gen 2 and later get Thunderbolt 4 - but I can't find the parts for sale anywhere.
- You can also add an Ethernet card to the m.2/miniPCIe wireless slot, thanks @joeribl for this! They used this kit from AliExpress which uses an Intel i210 and thus is recognised natively in vSphere 7. There are also 2.5GbE cards starting to appear (as of January 2023) but so far these only use Realtek chipsets. Remember you need an A/E key card, the far more common B/M key cards will not work in this slot.
Hi all.
I recently jumped into this adventure and is trying to putting things together and would like your input to check if my findings are correct.
Case: Adding dual 10g SFP+ to my Lenovo M720q, which is supposed to run Proxmox (this specific model: Lenovo site for the specific model, it was bought second hand, but it seems quite unlikely that anything have been altered on it since it was shipped from the factory. So far I haven't come across a way to verify the specifics, even though I'm sure there is a way, I just haven't found out how yet). I'm trying to avoid RJ-45 interfaces due to heating internally, however I haven't landed on if I will use DAC cables (due to ultra short distance) or SFP+ to RJ-45 (still 10g speed) adapters. Currently it is intended for at least one of the ports to go straight into a storage device, but due to compatability with cards on that, I haven't landed on a PCI(e) card for that yet, which is why I'm heading for both should be SFP+, even though I may end up converting it, then it will still be future proof once I eventually end up expanding in the future.
As far as I understood:
- I need the proprietary riser. Since my unit as far as I know is the Tiny5 and x8, then the table says "01AJ902". However since it comes with a warning and is adviced to go for the x16 instead, I should then see if I can track down the "01AJ940". Am I right on this, or am I wrong already?
- I've seen warnings that having dual 10g SFP+ NICs comes with heating risks. While I haven't picked the specific PCIe card yet, I am taking this into consideration. I've also seen others adding small fans and cutting ventilation holes to either deal with or prevent heating buildup in the first place, which I'm open to do as well.
- Since I haven't picked the actual dual 10g SFP+ NIC yet, I'm also interested in perhaps going with the Thunderbolt route and then connect the dual 10g SFP+ NIC PCI(e) card externally. However I suspect the PCI(e) version and generation may be too old for that to be possible. But it would open up to several advantages, like bifurcation (the hack, since it isn't natively supported, only if it still allows for the dual 10g SFP+ NIC), many more options for picking a dual 10g SFP+ NIC PCI(e) card (and cooling solutions for it as well).
- I'm aware that some PCI(e) cards may only fit if cutting some parts of either the PCI card and/or the pc case. Likewise that the bracket/"baffle" that is shipped with the PCI(e) card may not fit at all. In that case I can get a bracket/baffle 3d printed or manufactored if I either can find or create a fitting 3d model for a working bracket/baffle.
- These are some of the dual 10g SFP+ NIC PCI(e) cards that I have been considering (random order):
- "Intel X-520" (I have found some named "Intel X-520-DA2", which as I get is due to the SFP+ interfaces rather than T-BASE (RJ-45) interfaces. Heat maybe an unknown factor with this (since it is dual and not single NIC), and it is known that I should expect to be doing some cutting/3d modeling and printing to get at working bracket/baffle. Sadly they are a bit pricy in my region, but not much to do about that. Buying outside my reagion may apply ridiculous tarrifs, taxes, and multiple fees if Ido find one that seem to have a fair price.
- "Mellanox ConnectX-3 CX322A" seems to be perfect for my case. Heat should be fine as is and the issues with pfsense doesn't apply to mesince the pc would be running Proxmox anyways. Supply and pricing is a bit difficult at the moment, but I'm still trying to source a trusty and legit seller or reseller.
- "Supermicro AOC-STGN-I2S" (version 1 & 2), heat is unknown, the pfsense thing is not a factor, but both versions seems to be hard to find from a trysty and legit seller or reseller for me at this moment, price is therefore also relatively unknown.
- If Thunderbolt where to be an option (or perhaps just an PCI(e) extention cable to outside the pc case and then do something there), then it opens up many more possibilities of dual 10g SFP+ NIC PCI(e) cards, however, since I haven't been able to confirm that route yet, then I haven't looked further into that, but it would be quite a price difference, compared to what I have looked into.
Thanks for all your help in advance, have a nice day.
Regards


