qp.backline.Node

class Node(*, name=None, hardware='cpu', backend=None, remote=False, executor_options=None, executor=None, init_args=<factory>)[source]

Bases: object

A node in a backline fabric.

Base class for Controller and Coprocessor. It carries the node’s name and hardware, how its code is deployed, and any backend-specific initialization arguments. Nodes are assembled into a device with Backline.

Warning

Backline is experimental and only usable through the Catalyst compiler.

Keyword Arguments:
  • name (str, None) – A name identifying this node. Defaults to None, letting the compiler derive one from the node’s role.

  • hardware (str) – The hardware this node executes on. Defaults to "cpu"; other allowed values are gpu and ``fpga`. The compiler combines this with the placement’s Transport to select the runtime backend.

  • backend (str, None) – The name of the transport backend to run this node on. Defaults to None, letting the compiler pick the default backend for the transport and hardware.

  • remote (bool) – Whether this node runs on another machine. Defaults to False.

  • executor_options (dict, None) – Options for the executor to launch for this node. Defaults to None, which runs the node in this process. See the executor_options attribute below for every option it accepts.

  • executor (object, None) – An already-launched executor to attach. Defaults to None, in which case the compiler builds one from executor_options.

  • init_args (dict) – Backend-specific initialization arguments. Empty by default. See the init_args attribute below for the keys it accepts.

backend

The name of the transport backend to run this node on, out of those in Catalyst's transport backend registry that implement the placement's transport on this node's hardware.

executor

The launched executor this node runs on.

executor_options

Options for the executor to launch for this node, passed to it as keyword arguments.

hardware

The hardware this node executes on.

name

An optional name used to reference this node.

remote

Whether this node runs on another machine, so that the libraries it loads are the ones installed beside it there rather than the ones in this installation.

init_args

Backend-specific initialization arguments, forwarded to the transport backend.

backend = None

The name of the transport backend to run this node on, out of those in Catalyst’s transport backend registry that implement the placement’s transport on this node’s hardware. Defaults to None, letting the compiler pick the default one. Naming one selects a backend that is not a default, such as "fpga_verbs", or one installed by a backend package.

executor = None

The launched executor this node runs on. Created automatically by the compiler from executor_options; set it directly to attach one that is already launched, in which case executor_options is ignored.

executor_options = None

Options for the executor to launch for this node, passed to it as keyword arguments. None (the default) requests no executor, leaving the node in this process.

Which machine, and how it is reached

  • "host" (str) - deploy the executor to this host over ssh. Requires "port", so that the address is known without having to reach the host at compile time.

  • "address" (str) - "host:port" of an executor whose lifetime is managed elsewhere. Attach to it rather than launching one.

  • "port" (int) - the port the executor binds on the target, and the local end of the ssh tunnel reaching it. Omit it for a local executor and the compiler picks a free port.

  • "user" (str) - the ssh account on the remote host. Defaults to the local username.

Naming neither "host" nor "address" runs the executor as a subprocess on this machine.

What is placed on the target

  • "workspace" (str) - the directory the executor runs in. Defaults to a generated catalyst-exec-* directory removed on teardown; one named here is left in place.

  • "deploy" (list[str]) - files and directories copied into the workspace before the executor starts. A directory contributes the files inside it, which is how a cross-built set of artifacts travels.

  • "plugins" (list[str]) - shared libraries the executor loads at startup, in order. They share one symbol namespace, so the first definition wins. The compiler appends the libraries this node implies - a coprocessor’s decode function, a controller’s device runtime - if they are not already listed.

  • "executor_bin" (str) - the command that starts the executor, for wrapping it in something like numactl.

How the process runs

  • "env" (dict[str, str]) - environment variables for the executor process.

  • "sudo" (bool) - run it as root, for a target whose devices are not world-accessible. Defaults to False.

  • "sudo_password_env" (str) - name of the environment variable holding the password to pipe to sudo -S, e.g. "MY_HOST_SUDO_PW". If unset and sudo is required, a prompt will launch for the password; unnecessary with passwordless sudo.

  • "ready_timeout" (float) - seconds to wait for the executor to report that it bound its port. Defaults to 60.0.

  • "verbose" (int) - how much the launcher logs: 0 quiet, 1 normal, 2 per-command detail.

Code generation and identity

  • "triple" (str) - the LLVM target triple to compile this node’s code for. Omit it and the executor detects it from the target’s uname, which requires reaching the host.

  • "name" (str) - the executor’s own label, used in its log filenames. Defaults to this node’s name.

Note that "port" here is the executor’s, on the channel that ships compiled code. It is unrelated to port, which is the transport’s handshake port. An unrecognized key raises.

Warning

These options are defined by the Catalyst compiler, and may not be stable.

hardware = 'cpu'

The hardware this node executes on. The compiler combines this with the placement’s Transport to select the runtime backend.

name = None

An optional name used to reference this node.

remote = False

Whether this node runs on another machine, so that the libraries it loads are the ones installed beside it there rather than the ones in this installation. Defaults to False.

This is about the machine, not the process: it says where the node’s libraries are resolved, and executor_options independently says whether its code runs in a process of its own. The three valid combinations are:

  • remote=True with executor_options: out-of-process on another machine, reached by deploying an executor there. A remote node cannot be reached without one.

  • remote=False with executor_options: out-of-process on this machine, in an executor subprocess whose libraries still resolve from this installation.

  • remote=False with no executor_options: in-process, the default.

init_args = <dataclasses._MISSING_TYPE object>

Backend-specific initialization arguments, forwarded to the transport backend. Empty by default (never None). The keys the compiler forwards are

  • "backend_lib" (str) - explicit path to the transport backend library, taking precedence over hardware and over lib_path.

  • "config" (str) - a ;-separated key=value string configuring the backend on this machine, e.g. "dev=mlx5_0;gid=3". dev and gid select the RDMA device and GID index; the remaining keys are backend-specific (a GPU backend takes gpu=, an FPGA engine takes sq_mem=/data_mem=/reply_mem=). An RDMA coprocessor also takes peer=, the kind of controller it answers: catalyst, the default, for the controllers Catalyst ships (cpu_verbs, hwhs, fpga_verbs), hsb for hsb_hwhs, and balboa for balboa_hwhs. For more information about how to build and load the required FPGA images, please refer to the backline and backline-vpk120 repositories.

Keys outside this set are rejected when the program is compiled.