User Tools

Site Tools


nndocs:initial

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
nndocs:initial [2024/11/22 15:53] – add hugepages info naptasticnndocs:initial [2024/12/05 18:16] (current) – stub out thing naptastic
Line 3: Line 3:
 Partitioning: The most recent rebuild was shark, for which I took Debian's default EFI setup for the 2TB OS drive. I only changed / to BTRFS instead of ext4. Debian installs itself to a subvolume named @root and makes that subvolume the default, so it's ready for snapshotting backups. Partitioning: The most recent rebuild was shark, for which I took Debian's default EFI setup for the 2TB OS drive. I only changed / to BTRFS instead of ext4. Debian installs itself to a subvolume named @root and makes that subvolume the default, so it's ready for snapshotting backups.
  
-Remember to add /mnt/snapshots in fstab.+Add /mnt/snapshots in fstab
 + 
 +====Move ~ to a BTRFS subvolume==== 
 +Separate snapshotting the OS from snapshotting your files.
  
 ====SSH key for root==== ====SSH key for root====
Line 60: Line 63:
    bison flex libssl-dev ncurses-dev libelf-dev    bison flex libssl-dev ncurses-dev libelf-dev
  
-====Sanitize network interface names====+====Networking==== 
 +===Device Names===
   ln -s /dev/null /etc/systemd/network/99-default.link   ln -s /dev/null /etc/systemd/network/99-default.link
  
Line 77: Line 81:
   * emoX for ports on the motherboard   * emoX for ports on the motherboard
   * enX for (multi-)gigabit stand-up cards   * enX for (multi-)gigabit stand-up cards
-  * mlxX for Mellanox devices in Ethernet mode 
   * ibX for InfiniBand IPoIB devices (these do not need .link files though)   * ibX for InfiniBand IPoIB devices (these do not need .link files though)
 +  * mlxX for Mellanox devices in Ethernet mode
 +
 +===Port Conventions===
 +X is 0-indexed. Port 0 on a stand-up card is the farthest from the motherboard. On a motherboard, it's the left-most port if there's more than one port. I configure ConnectX-3 cards to be InfiniBand on port 0 and Ethernet on port 1, so a system ends up with interfaces named ib0 and mlx1.
 +
 +===InfiniBand===
 +  * [[infiniband]]
 +  * mst* installer
 +  * copy production opensm configuration in case you have take over as SM
 +  * (what needs to change here for VMs using virtual functions?)
 +
 +Comment out svcrdma in /etc/rdma/modules/rdma.conf or nfs-kernel-server won't start. I'm not sure what's **actually** needed to make NFS/RDMA work.
  
-X is 0-indexed. Port 0 on stand-up card is the farthest from the motherboardOn a motherboard, it's the left-most port if there's more than one port.+===Ethernet configuration=== 
 +Is total mess right nowI don't know what I'm doing or how I want to do it.
  
 ====Hugepages==== ====Hugepages====
Line 92: Line 108:
  
 Make sure your locked memory limit is equal to or greater than the amount of RAM you're reserving for hugepages. Make sure your locked memory limit is equal to or greater than the amount of RAM you're reserving for hugepages.
- 
-====Network configuration==== 
-if I ever figure out how I want to do this, I will certainly let you know! 
  
 ====Shell profile==== ====Shell profile====
Line 105: Line 118:
 ====Email==== ====Email====
 lol, not yet lol, not yet
- 
-====InfiniBand==== 
-[[infiniband]] 
-  * mst* installer 
-  * copy production opensm configuration in case you have take over as SM 
-  * (what needs to change here for VMs using virtual functions?) 
- 
-Comment out svcrdma in /etc/rdma/modules/rdma.conf or nfs-kernel-server won't start. I'm not sure what's **actually** needed to make NFS/RDMA work. 
  
 ====Disable TTY screen blanking==== ====Disable TTY screen blanking====
nndocs/initial.1732290792.txt.gz · Last modified: 2024/11/22 15:53 by naptastic