User Tools

Site Tools


nndocs:sandbox

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
nndocs:sandbox [2025/11/04 22:25] – [Networks] add management network; updates naptasticnndocs:sandbox [2025/11/06 00:13] (current) – update hard drive locations naptastic
Line 84: Line 84:
 I'm not currently using InfiniBand subnets for anything. They weren't helpful in partitioning SRP or iSCSI traffic. I'm not currently using InfiniBand subnets for anything. They weren't helpful in partitioning SRP or iSCSI traffic.
  
-VLAN and VNI can match the third octet.+VLAN and VNI can match the third octet. 0 is not valid, so use the largest number in the subnet.
  
 ^ Network ^ IPv4 Range ^ IPv6 Range ^ IB Subnet ^ VLAN ^ VXLAN IP ^ VXLAN ID ^ ^ Network ^ IPv4 Range ^ IPv6 Range ^ IB Subnet ^ VLAN ^ VXLAN IP ^ VXLAN ID ^
Line 100: Line 100:
       * .96-103: shark       * .96-103: shark
       * .104-111: southpark (cudapark, )       * .104-111: southpark (cudapark, )
-  * 4/24: "mgmt": IPMI and other "out-of-band" management+  * 4: "mgmt": IPMI and other "out-of-band" management
   * Unused: 5 (/24)   * Unused: 5 (/24)
   * Unused: 6-7 (/23) (if security cameras ever get a network, it should come from this range.)   * Unused: 6-7 (/23) (if security cameras ever get a network, it should come from this range.)
Line 106: Line 106:
   * Unused: 16-31 (/20)   * Unused: 16-31 (/20)
   * Unused: 32-63 (/19)   * Unused: 32-63 (/19)
-  * RDMA networks (/19): IP over InfiniBand and Ethernet can't be bridged, so they need to be separate subnets.+  * RDMA networks (/19): IP over InfiniBand and Ethernet can't be bridged, so they need to be separate subnets. I'm not sure if ib0/ib1 is a useful division.
     * 64: ib0     * 64: ib0
     * 65: ib1     * 65: ib1
 +    * 66-67 (/23): Reserved
     * 68-79 (/22): Reserved     * 68-79 (/22): Reserved
     * 80-95 (/21): Reserved     * 80-95 (/21): Reserved
Line 159: Line 160:
 ===Storage=== ===Storage===
   * Production volumes:   * Production volumes:
-    * janet: 4TB Samsung QVO. 
-    * Crucial 120GB SATA SSD boot volume 
-      * southpark's boot volume 
     * Samsung 850 512GB NVMe     * Samsung 850 512GB NVMe
       * installed in southpark on the motherboard, I think?       * installed in southpark on the motherboard, I think?
     * Western Digital Black 2TB NVMe     * Western Digital Black 2TB NVMe
-      * installed in southpark on the x16 riser card +      * installed in shark on the motherboard
-      * confusingly mounted at /mnt/sabrent +
-    * black: Three 4TB Western Digital enterprise drives in a RAID-5 holding backups; currently cold. +
-  * ZFS pool "truck"+
     * Two Sabrent 1TB NVMe drive     * Two Sabrent 1TB NVMe drive
       * installed in southpark on the x16 riser card       * installed in southpark on the x16 riser card
-      * Partitioned partly for don't rememberbut it makes sense +      * Partitioned unfortunately; I'd like to move everything off them. 
-    * four 4TB drives that should really just get recycled+    * janet: 4TB Samsung QVO. 
 +    * Crucial 120GB SATA SSD boot volume 
 +      * southpark's boot volume 
 +    * 512GB Crucial SATA SSD 
 +      * duckling boot, swapand local snapshots 
 +    * black: Three 4TB drives in a RAID-5 holding backups; currently in shark.
   * Not installed:   * Not installed:
-    * 512GB Crucial SATA SSD (probably for duckling) 
     * 2TB Vulcan Z SATA SSD (probably for shark as a backup)     * 2TB Vulcan Z SATA SSD (probably for shark as a backup)
  
 ===So Where Does Shit Live?=== ===So Where Does Shit Live?===
   * VM Images:   * VM Images:
-    * southpark:/mnt/sabrent/images 
-      * exported over NFS-RDMA 
   * TV shows, movies, software, stuff like that: janet   * TV shows, movies, software, stuff like that: janet
   * Home directories:   * Home directories:
-  * OS volumes:+  * OS volumes: In their respective hosts
  
 I am still struggling with the fact that things really have to boot off local storage. Fibre Channel without a switch isn't worth it and a switch isn't worth it. I am still struggling with the fact that things really have to boot off local storage. Fibre Channel without a switch isn't worth it and a switch isn't worth it.
nndocs/sandbox.1762295118.txt.gz · Last modified: 2025/11/04 22:25 by naptastic