Skip to content

Instantly share code, notes, and snippets.

C:\Users\t1>powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"
Downloading uv 0.5.10 (x86_64-pc-windows-msvc)
Installing to C:\Users\t1\.local\bin
uv.exe
uvx.exe
everything's installed!
To add C:\Users\t1\.local\bin to your PATH, either restart your system or run:
set Path=C:\Users\t1\.local\bin;%Path% (cmd)
C:\Users\t1>pip install dagster
Collecting dagster
Using cached dagster-1.6.6-py3-none-any.whl.metadata (12 kB)
Collecting click>=5.0 (from dagster)
Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting coloredlogs<=14.0,>=6.1 (from dagster)
Using cached coloredlogs-14.0-py2.py3-none-any.whl.metadata (12 kB)
Collecting Jinja2 (from dagster)
Using cached jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting PyYAML>=5.1 (from dagster)
@cmpadden
cmpadden / twitter-unfollow-non-followers.js
Created December 2, 2024 22:07
Twitter unfollow non-followers
Array
.from(document.getElementsByTagName('button'))
.filter(button => ! button.innerHTML.includes('Follows you'))
.map(button => button.querySelector('button'))
.filter(el => el !== null)
.filter(el => el.innerText == 'Following')
.map(button => button.click());
@cmpadden
cmpadden / bsky-follow-back.js
Created November 17, 2024 04:36
Snippet to follow people back on BlueSky Social
if (!/.*\/profile\/.*\/followers/.test(document.URL)) {
console.error(
'Make sure you are on your followers page!'
)
} else {
Array
.from(document.getElementsByTagName('button'))
.filter(el => el.innerText == 'Follow Back')
.map(el => el.click())
}
@cmpadden
cmpadden / duckdb-dagster-graphql-materializations.sql
Last active October 29, 2024 02:55
Dagster Materializations from DuckDB via GraphQL
install http_client from community;
load http_client;
with __input as (
select
http_post(
'http://localhost:3000/graphql',
headers => map {
'content-type': 'application/json',
@cmpadden
cmpadden / nyc-yellow-taxi-duckdb.sql
Last active August 11, 2024 21:57
DuckDB Yellow Taxi Benchmark
-- Computes the NYC zones that have the most (relative) yellow cab disputes
--
-- It is expected that the NYC yellow trip data set has been downloaded to `./data/nyc_yellow_tripdata`
--
-- https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page
--
-- USAGE
-- $ du -sh data/nyc_yellow_tripdata/
-- 1.1G data/nyc_yellow_tripdata/ $ duckdb < nyc-yellow-taxi-duckdb.sql
--
$ python -c "import math; [print(1/(math.sqrt(n))) for n in range(1, 1000)]" | uplot line -t "1/sqrt(n)"
1/sqrt(n)
┌────────────────────────────────────────┐
1 │⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
│⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀│
@cmpadden
cmpadden / dagster-example-map-reduce-graph-asset.py
Created July 2, 2024 15:27
dagster-example-map-reduce-graph-asset.py
"""
dagster dev -f dagster-example-map-reduce-graph-asset.py
"""
from itertools import chain
from dagster import Definitions, DynamicOut, DynamicOutput, asset, graph_asset, op
@asset
@cmpadden
cmpadden / midi-to-audio-backed-mp4.sh
Created June 29, 2024 03:45
Convert midi files to instrument backed video
#!/bin/bash
TARGET_MIDI_FILE="bk_cove.mid"
STATIC_COVER_IMAGE="${HOME}/Downloads/bk_cover_image.jpg"
# open midi file in Logic Pro
open "$TARGET_MIDI_FILE"
# use `osascript` to bounce the project, converting midi tracks to an audio file
osascript \
@cmpadden
cmpadden / example-asset-check-iomanager.py
Created June 25, 2024 19:59
Dagster: Example of `@asset_check` with custom `IOManager`
USAGE
$ dagster dev -f example-asset-check-iomanager.py
"""
from dagster import (
AssetCheckResult,
Definitions,