nndocs:initial
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| nndocs:initial [2024/02/15 16:32] – add infiniband info naptastic | nndocs:initial [2026/04/01 22:21] (current) – [Move ~ to a BTRFS subvolume] fix thinko naptastic | ||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ===== Naptastic Network Playbook ===== | ===== Naptastic Network Playbook ===== | ||
| - | + | ====Partition drives==== | |
| - | == Pre-install | + | |
| Partitioning: | Partitioning: | ||
| - | apt -y install curl vim whois | + | Add / |
| - | Make sure to enable contrib, non-free, non-free-firmware in /etc/apt/sources.list. | + | ====Disable resume from hibernate messages==== |
| + | echo ' | ||
| + | update-initramfs -u | ||
| - | Comment out svcrdma in / | + | ====Move ~ to a BTRFS subvolume==== |
| + | Separate snapshotting the OS from snapshotting your files. | ||
| - | ==== All systems | + | ====SSH key for root==== |
| - | | + | |
| - | | + | |
| - | | + | |
| - | * disable journald; configure logging for everything. | + | |
| - | * Make a list of things that need to log | + | |
| - | * How exactly do I want logging set up? | + | |
| - | === All systems with Mellanox adapters | + | ====Reconfigure SSH==== |
| - | * mst* installer | + | Configure ssh for a high-numbered port, and not to allow password-based logins. Restart sshd. Verify that 'ssh root@localhost' |
| - | * copy production opensm configuration in case you have take over as SM | + | |
| - | * (what needs to change here for VMs using virtual functions?) | + | |
| - | If your host is going to do audio stuff, follow the LAD playbook. Which also badly need an update. | + | ====Backups==== |
| + | Create / | ||
| - | If your host is going to host web stuff, follow the LAMP playbook but keep in mind it's badly out-of-date. Be prepared to search, read docs, look for a better way. | + | # / was on / |
| - | ===== Getting Started ===== | + | UUID=some-long-string / |
| + | UUID=some-long-string / | ||
| - | Perform | + | ====Install Shorewall==== |
| + | * customize interfaces, rules, policy...? | ||
| + | * / | ||
| + | * / | ||
| + | * systemctl enable | ||
| + | * reboot | ||
| - | run the naptastic installer if it didn't run as part of the installer: | + | ====Pick |
| + | If the repo is installed or mounted locally: | ||
| + | deb file:/// | ||
| + | deb-src file:/// | ||
| - | curl https://naptastic.com/initial.sh | /bin/bash | + | If you have to get it via HTTP: |
| + | deb http://mirror.narf.rocks/debian/ bookworm main contrib non-free non-free-firmware | ||
| + | deb-src http:// | ||
| - | # This is not necessary unless the installer failed | + | If you have to use public mirrors (RIP): |
| - | | + | |
| - | chmod 700 /root/.ssh | + | |
| - | | + | |
| - | Configure ssh for a high-numbered port, and not to allow password-based logins. Restart sshd. Verify that 'ssh root@localhost' | + | ====Remove crap==== |
| + | apt -y remove update-notifier pulseaudio-module-bluetooth bluez blueman bluez-cups bluez-obexd modemmanager rtkit | ||
| - | ==== Networking | + | ====Install extra packages==== |
| + | (This is set up so you can triple-click each block you need, copy/paste or middle-paste into your terminal, then press enter at the end and install everything in one transaction.) | ||
| - | | + | |
| - | Here is what a link file looks like for an Ethernet device: | + | Hardware hosts add: |
| + | | ||
| - | $ cat / | + | Desktops: |
| - | # | + | |
| - | # Remember to `update-initramfs -u` after changing this file! | + | |
| - | # | + | |
| - | [Match] | + | |
| - | MACAddress=b4: | + | |
| - | + | ||
| - | [Link] | + | |
| - | Name=emo0 | + | |
| - | MTUBytes=9000 | + | |
| - | Also update the interface names in / | + | Audio workstations: |
| - | * emoX for ports on the motherboard | + | qjackctl alsa-tools-gui eq10q jalv jamin lilv-utils |
| - | * enX for gigabit stand-up cards | + | |
| - | * mlxX for Mellanox devices in Ethernet mode (It could happen!) | + | |
| - | ==== InfiniBand ==== | + | If you plan to compile your own kernel: |
| + | bison flex libssl-dev ncurses-dev libelf-dev | ||
| - | Just make a page for this please. | + | ====Networking==== |
| + | ===Device Names=== | ||
| + | ln -s /dev/null / | ||
| - | apt -y install ibutils infiniband-diags libvma mstflint rdma-core qperf | + | Here is what a link file looks like for an Ethernet device: |
| + | $ cat / | ||
| + | # | ||
| + | # Remember to `update-initramfs | ||
| + | # | ||
| + | [Match] | ||
| + | MACAddress=b4: | ||
| + | |||
| + | [Link] | ||
| + | Name=emo0 | ||
| + | MTUBytes=9000 | ||
| - | * opensm config--the defaults are awful | + | * emoX for ports on the motherboard |
| - | * partitions--the default config is awful | + | * enX for (multi-)gigabit stand-up cards |
| - | * Subnet speeds listed below. | + | * ibX for InfiniBand IPoIB devices (these do not need .link files though) |
| - | * the iSCSI page should mention iSER | + | * mlxX for Mellanox devices in Ethernet mode |
| - | * NFS-RDMA needs info | + | |
| - | * **DO NOT** restart nfsd if there are active RDMA mounts. They will not recover. | + | |
| - | * export needs ' | + | |
| - | * echo 'rdma 20049' > / | + | |
| - | * edit / | + | |
| - | Here are the speeds for partitions.conf: | + | ===Port Conventions=== |
| + | X is 0-indexed. Port 0 on a stand-up card is the farthest from the motherboard. On a motherboard, | ||
| - | # | + | ===InfiniBand=== |
| - | # | + | |
| - | # | + | |
| - | # | + | |
| - | # | + | |
| - | # | + | |
| - | # | + | |
| - | # | + | |
| - | # 10 = 120 | + | |
| - | # 11 = 14 Gbit/s FDR | + | |
| - | # 12 = 56 Gbit/s FDR x4 | + | |
| - | # there are more, faster, in a weird order. Grep opensm' | + | |
| - | ===== Options ===== | + | Comment out svcrdma in / |
| - | maybe you feel like it, maybe you don't. idk. | + | ===Ethernet configuration=== |
| + | Is a total mess right now. I don' | ||
| - | == Disable TTY screen blanking (Only necessary on Debian Jessie and older) | + | ====Hugepages==== |
| + | Useful for databases, PHP, Factorio, and probably other things! Add something like this to / | ||
| - | Add this to ''/ | + | vm.nr_hugepages=512 |
| - | sh -c ' | + | To make a non-persistent change, |
| - | == For all systems == | + | sysctl -w vm.nr_hugepages=512 |
| - | apt -y remove update-notifier pulseaudio-module-bluetooth bluez blueman bluez-cups bluez-obexd modemmanager rtkit | + | Make sure your locked memory limit is equal to or greater than the amount of RAM you're reserving for hugepages. |
| - | == For hardware boxes == | + | ====Shell profile==== |
| + | * Profile stuff: Bash, Vim, ? Can I automate this? (Of course I can.) | ||
| - | apt -y install smartmontools qemu-kvm gparted | + | ====Logging==== |
| + | * disable journald; configure logging for everything. | ||
| + | * Make a list of things that need to log | ||
| - | == If you are using a graphical desktop environment | + | ====Email==== |
| + | lol, not yet | ||
| - | (this needs an update: not sure about fonts packages. Also some network-manager-*-gnome packages might be useful depending on what kind of networking you're doing.) | + | ====Disable TTY screen blanking==== |
| + | I don't know when this is necessary anymore. Add this to ''/ | ||
| - | | + | |
| - | == If you plan to do audio work == | + | ====Audio workstations==== |
| - | + | ||
| - | apt -y install qjackctl alsa-tools-gui eq10q jalv jamin lilv-utils | + | |
| cat >> / | cat >> / | ||
| default-sample-format = s24le | default-sample-format = s24le | ||
| Line 126: | Line 134: | ||
| ^D | ^D | ||
| - | == If you plan to compile your own kernel == | + | More on [[lad]]. |
| - | + | ||
| - | apt -y install bison flex libssl-dev ncurses-dev libelf-dev | + | |
nndocs/initial.1708014723.txt.gz · Last modified: 2024/02/15 16:32 by naptastic