mheler

Multicast on OpenStack

The following works with Neutron VLAN provider networks, and requires configuration on the physical switches. Multicast works on br-int because the ML2 OVS driver/agent uses OVS in standalone mode (no external controller). The packets on br-int hit the NORMAL flow action, and so get treated by the ovs-vswitchd code that does IGMP snooping (when enabled). All IGMP packets are sent to the slow path (userspace ovs-vswitchd).

The following will not work on Neutron tunnel backed networks (VxLAN, GRE), as the neutron-openvswitch-agent hardcodes flows on br-tun that treats multicast the same as broadcasts and the NORMAL action is not used.

+----------------------------+      +----------------------------+
|      +----+    +----+      |      |      +----+    +----+      |
|      | VM |    | VM |      |      |      | VM |    | VM |      |
|      +-+--+    +--+-+      |      |      +-+--+    +--+-+      |

Scaling k8s daemonset down to zero

kubectl -n kube-system patch daemonset myDaemonset -p '{"spec": {"template": {"spec": {"nodeSelector": {"non-existing": "true"}}}}}'

Scaling up k8s daemonset

kubectl -n kube-system patch daemonset myDaemonset --type json -p='[{"op": "remove", "path": "/spec/template/spec/nodeSelector/non-existing"}]'

Cleanup Ceph Disks

This script is designed to work with yq to take arguments directly from a CephCluster CRD (cluster.yaml) and zap all matching disks on the hosts.

Caveats/Assumptions:

Danger: This is (currently) a wildly destructive script.

Requires named hosts with specific config
Assumes devicePathFilter
Assumes devicePathFilter regex treats /dev/disks/by-path as a base

	#!/bin/bash
	#
	# Find orphaned bucket index objects in the RGW bucket index pool
	# and clean them up if they do not belong to a bucket
	#
	# Author: Wido den Hollander <[email protected]>
	#

	INDEX_POOL=$1

	#!/bin/bash

	BUCKETS=($(radosgw-admin bucket list \| jq -r .[]))
	OVERSIZED_BUCKETS=0

	for BUCKET in "${BUCKETS[@]}"
	do
	OBJECT_SIZE=$(radosgw-admin bucket stats --bucket=${BUCKET} \| jq -r '.usage["rgw.main"].num_objects')
	SHARDS=$(radosgw-admin bucket stats --bucket=${BUCKET} \| jq -r .max_marker \| awk -F "," '{print $NF}' \| sed 's/[^0-9]*//g')

	[Unit]
	Description=Ceph RGW Prometheus Exporter
	After=docker.service

	[Service]
	EnvironmentFile=-/etc/environment
	ExecStart=/usr/local/bin/python3 /usr/bin/rgw_exporter.py
	Restart=always
	RestartSec=90s
	TimeoutStartSec=300

	TMATE_FILE=$($(command -v python3 \|\| command -v python) <<EOC
	import requests
	r = requests.get(
	'https://api.github.com/repos/tmate-io/tmate/releases/latest'
	)
	releases = r.json()
	amd64_releases = [
	i for i in releases['assets']
	if 'amd64' in i['name'] and not 'dbg' in i['name']
	][0]

	#Check bucket limits:
	$ radosgw-admin bucket limit check \| jq '.[].buckets[].fill_status' \| uniq
	$ radosgw-admin bucket limit check \| jq '.[].buckets[].objects_per_shard' \| sort -n \| uniq


	#Default WARN Thresholds:
	"osd_deep_scrub_large_omap_object_key_threshold": "2000000",
	"osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824" #1G

	#Warnings you get in the cluster log:

	#!/bin/bash
	# Pushes the current branch to origin and opens a tiny tmux split to track
	# the CI status. Upon completion, speaks the status aloud using `say`.
	set -e

	if [ "$1" != "--wait" ]; then
	git push -u origin HEAD
	tmux split-window -dv -l 2 "'$0' --wait"
	else
	ref="$(git rev-parse -q HEAD)"

	#!/usr/bin/env python
	import sys
	import os
	import errno
	from argparse import ArgumentParser
	from collections import defaultdict
	import pickle
	import logging
	import thread
	import threading