nndocs:sandbox
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| nndocs:sandbox [2025/07/08 18:41] – naptastic | nndocs:sandbox [2025/11/06 00:13] (current) – update hard drive locations naptastic | ||
|---|---|---|---|
| Line 81: | Line 81: | ||
| ====Networks==== | ====Networks==== | ||
| + | |||
| + | I'm not currently using InfiniBand subnets for anything. They weren' | ||
| + | |||
| + | VLAN and VNI can match the third octet. 0 is not valid, so use the largest number in the subnet. | ||
| ^ Network ^ IPv4 Range ^ IPv6 Range ^ IB Subnet ^ VLAN ^ VXLAN IP ^ VXLAN ID ^ | ^ Network ^ IPv4 Range ^ IPv6 Range ^ IB Subnet ^ VLAN ^ VXLAN IP ^ VXLAN ID ^ | ||
| - | | green | 172.20.0/22 | fd20: | + | | green | 172.20.0/22 | fd20: |
| + | | mgmt | 172.20.4/24 | - | ffff | 4 | 225.172.20.64 | 4 | | ||
| - | * 0-3/22: " | + | * 0-3/22: " |
| * 0: .1 is the network controller (router, DHCP, DNS); .2+ is for assigned hosts | * 0: .1 is the network controller (router, DHCP, DNS); .2+ is for assigned hosts | ||
| * 1: .0-255 contains IPMI interfaces and nothing else right now | * 1: .0-255 contains IPMI interfaces and nothing else right now | ||
| Line 95: | Line 100: | ||
| * .96-103: shark | * .96-103: shark | ||
| * .104-111: southpark (cudapark, ) | * .104-111: southpark (cudapark, ) | ||
| - | * Unused: | + | |
| + | | ||
| + | * Unused: 6-7 (/23) (if security cameras ever get a network, it should come from this range.) | ||
| * Future Multipath: 8-15 (/21 in /24's) | * Future Multipath: 8-15 (/21 in /24's) | ||
| * Unused: 16-31 (/20) | * Unused: 16-31 (/20) | ||
| * Unused: 32-63 (/19) | * Unused: 32-63 (/19) | ||
| - | * RDMA networks (/19): IP over InfiniBand and Ethernet can't be bridged, so they need to be separate subnets. | + | * RDMA networks (/19): IP over InfiniBand and Ethernet can't be bridged, so they need to be separate subnets. I'm not sure if ib0/ib1 is a useful division. |
| * 64: ib0 | * 64: ib0 | ||
| * 65: ib1 | * 65: ib1 | ||
| - | * 66: mlx0 | + | * 66-67 (/23): Reserved |
| - | * 67: mlx1 | + | |
| * 68-79 (/22): Reserved | * 68-79 (/22): Reserved | ||
| * 80-95 (/21): Reserved | * 80-95 (/21): Reserved | ||
| Line 126: | Line 132: | ||
| there might be other san* VLANs defined. I don't remember. | there might be other san* VLANs defined. I don't remember. | ||
| - | I am no longer able to manage the TP-link switch. It's fixed configuration. | + | I am no longer able to manage the TP-link switch. It's fixed configuration. I don't know how it would handle traffic |
| ====Host Numbers==== | ====Host Numbers==== | ||
| Line 154: | Line 160: | ||
| ===Storage=== | ===Storage=== | ||
| * Production volumes: | * Production volumes: | ||
| - | * janet: 4TB Samsung QVO. | ||
| - | * Crucial 120GB SATA SSD boot volume | ||
| - | * southpark' | ||
| * Samsung 850 512GB NVMe | * Samsung 850 512GB NVMe | ||
| * installed in southpark on the motherboard, | * installed in southpark on the motherboard, | ||
| * Western Digital Black 2TB NVMe | * Western Digital Black 2TB NVMe | ||
| - | * installed in southpark | + | * installed in shark on the motherboard |
| - | * confusingly mounted at / | + | |
| - | * black: Three 4TB Western Digital enterprise drives in a RAID-5 holding backups; currently cold. | + | |
| - | * ZFS pool " | + | |
| * Two Sabrent 1TB NVMe drive | * Two Sabrent 1TB NVMe drive | ||
| * installed in southpark on the x16 riser card | * installed in southpark on the x16 riser card | ||
| - | * Partitioned | + | * Partitioned |
| - | * four 4TB drives | + | * janet: 4TB Samsung QVO. |
| + | * Crucial 120GB SATA SSD boot volume | ||
| + | * southpark' | ||
| + | * 512GB Crucial SATA SSD | ||
| + | * duckling boot, swap, and local snapshots | ||
| + | * black: Three 4TB drives | ||
| * Not installed: | * Not installed: | ||
| - | * 512GB Crucial SATA SSD (probably for duckling) | ||
| * 2TB Vulcan Z SATA SSD (probably for shark as a backup) | * 2TB Vulcan Z SATA SSD (probably for shark as a backup) | ||
| ===So Where Does Shit Live?=== | ===So Where Does Shit Live?=== | ||
| * VM Images: | * VM Images: | ||
| - | * southpark:/ | ||
| - | * exported over NFS-RDMA | ||
| * TV shows, movies, software, stuff like that: janet | * TV shows, movies, software, stuff like that: janet | ||
| * Home directories: | * Home directories: | ||
| - | * OS volumes: | + | * OS volumes: |
| I am still struggling with the fact that things really have to boot off local storage. Fibre Channel without a switch isn't worth it and a switch isn't worth it. | I am still struggling with the fact that things really have to boot off local storage. Fibre Channel without a switch isn't worth it and a switch isn't worth it. | ||
| Line 184: | Line 186: | ||
| ---- | ---- | ||
| =====Big Idea Dumping Ground===== | =====Big Idea Dumping Ground===== | ||
| + | ===SSH tunnel=== | ||
| + | ssh -D 1337 -q -C -N david@do.naptastic.com | ||
| + | |||
| ====SoC on a PCI card==== | ====SoC on a PCI card==== | ||
| Mostly this is to enable other projects. It needs at least these features: | Mostly this is to enable other projects. It needs at least these features: | ||
nndocs/sandbox.1752000107.txt.gz · Last modified: 2025/07/08 18:41 by naptastic