Naptastic

User Tools

Site Tools

Trace:
nndocs:initial

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
nndocs:initial [2024/11/22 17:22] – [Sanitize network interface names] Improve IB/Eth explanation. naptasticnndocs:initial [2024/12/05 18:16] (current) – stub out thing naptastic
Line 3: Line 3:
 Partitioning: The most recent rebuild was shark, for which I took Debian's default EFI setup for the 2TB OS drive. I only changed / to BTRFS instead of ext4. Debian installs itself to a subvolume named @root and makes that subvolume the default, so it's ready for snapshotting backups. Partitioning: The most recent rebuild was shark, for which I took Debian's default EFI setup for the 2TB OS drive. I only changed / to BTRFS instead of ext4. Debian installs itself to a subvolume named @root and makes that subvolume the default, so it's ready for snapshotting backups.
  
-Remember to add /mnt/snapshots in fstab.+Add /mnt/snapshots in fstab. 
 + 
 +====Move ~ to a BTRFS subvolume==== 
 +Separate snapshotting the OS from snapshotting your files.
  
 ====SSH key for root==== ====SSH key for root====
Line 60: Line 63:
    bison flex libssl-dev ncurses-dev libelf-dev    bison flex libssl-dev ncurses-dev libelf-dev
  
-====Sanitize network interface names====+====Networking==== 
 +===Device Names===
   ln -s /dev/null /etc/systemd/network/99-default.link   ln -s /dev/null /etc/systemd/network/99-default.link
  
Line 80: Line 84:
   * mlxX for Mellanox devices in Ethernet mode   * mlxX for Mellanox devices in Ethernet mode
  
 +===Port Conventions===
 X is 0-indexed. Port 0 on a stand-up card is the farthest from the motherboard. On a motherboard, it's the left-most port if there's more than one port. I configure ConnectX-3 cards to be InfiniBand on port 0 and Ethernet on port 1, so a system ends up with interfaces named ib0 and mlx1. X is 0-indexed. Port 0 on a stand-up card is the farthest from the motherboard. On a motherboard, it's the left-most port if there's more than one port. I configure ConnectX-3 cards to be InfiniBand on port 0 and Ethernet on port 1, so a system ends up with interfaces named ib0 and mlx1.
 +
 +===InfiniBand===
 +  * [[infiniband]]
 +  * mst* installer
 +  * copy production opensm configuration in case you have take over as SM
 +  * (what needs to change here for VMs using virtual functions?)
 +
 +Comment out svcrdma in /etc/rdma/modules/rdma.conf or nfs-kernel-server won't start. I'm not sure what's **actually** needed to make NFS/RDMA work.
 +
 +===Ethernet configuration===
 +Is a total mess right now. I don't know what I'm doing or how I want to do it.
 +
 ====Hugepages==== ====Hugepages====
 Useful for databases, PHP, Factorio, and probably other things! Add something like this to /etc/sysctl.conf: Useful for databases, PHP, Factorio, and probably other things! Add something like this to /etc/sysctl.conf:
Line 91: Line 108:
  
 Make sure your locked memory limit is equal to or greater than the amount of RAM you're reserving for hugepages. Make sure your locked memory limit is equal to or greater than the amount of RAM you're reserving for hugepages.
- 
-====Network configuration==== 
-if I ever figure out how I want to do this, I will certainly let you know! 
  
 ====Shell profile==== ====Shell profile====
Line 104: Line 118:
 ====Email==== ====Email====
 lol, not yet lol, not yet
- 
-====InfiniBand==== 
-[[infiniband]] 
-  * mst* installer 
-  * copy production opensm configuration in case you have take over as SM 
-  * (what needs to change here for VMs using virtual functions?) 
- 
-Comment out svcrdma in /etc/rdma/modules/rdma.conf or nfs-kernel-server won't start. I'm not sure what's **actually** needed to make NFS/RDMA work. 
  
 ====Disable TTY screen blanking==== ====Disable TTY screen blanking====
nndocs/initial.1732296126.txt.gz · Last modified: 2024/11/22 17:22 by naptastic