User Tools

Site Tools


nndocs:nvme-of

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
nndocs:nvme-of [2024/02/24 21:28] – [Initiator] add disconnect info naptasticnndocs:nvme-of [2024/09/08 22:00] (current) – Move NQN info to sandbox naptastic
Line 1: Line 1:
 TODO Please put storage traffic on its own IB subnet and limit things sanely. TODO Please put storage traffic on its own IB subnet and limit things sanely.
- 
-NQNs: nqn.2014-08.rocks.narf.hostname is the whole thing. No :01 or any of that jazz, at least not yet. 
  
 The goal is to run everything over RDMA (InfiniBand specifically) and maybe have TCP as a fallback. (If TCP, then I probably want to try VMA... which I don't want to do.) The goal is to run everything over RDMA (InfiniBand specifically) and maybe have TCP as a fallback. (If TCP, then I probably want to try VMA... which I don't want to do.)
Line 21: Line 19:
 NVMe uses "namespaces" (which are numbers) instead of LUNs. Good for them. NVMe uses "namespaces" (which are numbers) instead of LUNs. Good for them.
  
-Create and share namespace:+Create, set, and enable namespace:
     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces create 1     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces create 1
     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces/1 set device path=/dev/nvme0n1     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces/1 set device path=/dev/nvme0n1
-    Parameter path is now '/dev/nvme0n1'. 
     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces/1 enable     /> subsystems/nqn.2014-08.rocks.narf.southpark/namespaces/1 enable
-    The Namespace has been enabled. 
  
 You can use a file as a backstore. The syntax is not at all obvious. Why "group=device"? Whatever: You can use a file as a backstore. The syntax is not at all obvious. Why "group=device"? Whatever:
     />subsystems/nqn.2014-08.rocks.narf.hostname/namespaces/1 set group=device path=/path/to/some/host.img     />subsystems/nqn.2014-08.rocks.narf.hostname/namespaces/1 set group=device path=/path/to/some/host.img
  
-I haven't checked if this works for partitions or SATA drives.+I haven't checked if this works for partitions or SATA drives, but I think it should?
  
 I haven't figured out ramdisks yet. There isn't a built-in system like in LIO. I haven't figured out ramdisks yet. There isn't a built-in system like in LIO.
Line 52: Line 48:
 Log in: Log in:
     # nvme connect -t rdma -n nqn.2014-08.rocks.narf.southpark -a 172.20.64.13 -s 4420     # nvme connect -t rdma -n nqn.2014-08.rocks.narf.southpark -a 172.20.64.13 -s 4420
 +
 +Rescan:
 +    # nvme ns-rescan /dev/nvme1
 +
 +  * If a namespace you expect to appear isn't appearing, check the target to see if you forget to enable it
  
 Disconnect a subsystem: Disconnect a subsystem:
nndocs/nvme-of.1708810097.txt.gz · Last modified: 2024/02/24 21:28 by naptastic