Maxfield Allison maxfield-allison

GPU Support For Docker Swarm

Docker compose has nice support for GPUs, K8s has moved their cluster-wide GPU scheduler from experimental to stable status. Docker swarm has yet to support the device option used in docker compose so the mechanisms for supporting GPUs on swarm are a bit more open-ended.

Basic documentation

NVIDIA container runtime for docker. The runtime is no longer required to run GPU support with the docker cli or compose; however, it appears necessary so that one can set Default Runtime: nvidia for swarm mode.
docker compose GPU support
Good GitHub Gist Reference for an overview on Swarm with GPUs. It is a bit dated, but has good links and conversation.
[Miscellaneous Opt

	#!/bin/sh
	# install tools
	apt update -y && apt install nano wget curl libguestfs-tools -y
	# remove old image
	rm -rfv current/noble-server-cloudimg-amd64.img
	# remove old template container - WILL DESTROY COMPLETELY
	qm destroy 9000 --destroy-unreferenced-disks 1 --purge 1
	# download new image
	wget https://cloud-images.ubuntu.com/noble/current/noble-server-cloudimg-amd64.img
	# add agent to image

	#!/usr/bin/env python3
	#
	# Simple Intel x520 EEPROM patcher
	# Modifies the EEPROM to unlock the card for non-intel branded SFP modules.
	#
	# Copyright 2020,2021,2022 Andreas Thienemann <[email protected]>
	#
	# Licensed under the GPLv3
	#
	# Based on research described at https://forums.servethehome.com/index.php?threads/patching-intel-x520-eeprom-to-unlock-all-sfp-transceivers.24634/