ryan-williams

[runsascoded/stdlb#2] Snapshot testing, collision fixes, and src/ layout

Summary

This PR adds comprehensive snapshot testing to prevent regressions, fixes name collision issues discovered when comparing to v0.0.4, and reorganizes the codebase with a src/ layout.

Key Changes

• Snapshot testing (scripts/snapshot_exports.py, tests/test_exports_snapshot.py)
• Tracks all 2127 exported symbols with their FQNs

ryan-williams

[marin-community/marin#1773] "Workspace" monorepo plan

(Versioned write-up [here][gist], synced via [ghpr])

Problem

Marin and [Levanter] repos contain components that depend on one another in ways that the current repo split doesn't reflect well, and makes awkward for co-development.

Proposed solution: [uv workspaces][workspaces]

"Workspaces" provide a way to colocate distinct libraries in one repo, such that they can be published and depended on independently (by external users), but naturally depend on each others' HEAD commits (and can easily be updated in lockstep, during common internal / co-development cases).

ryan-williams

[marin-community/marin#1723] "Workspace" step 2: levanter

Second step in the "uv workspace migration plan" ([#1773]): ingests [Levanter] as a workspace member with full Git history preserved.

Builds on: [#1690] (workspace initialization)

Changes

• Merge [Levanter] into lib/levanter/ (preserving full Git history)
• Add Levanter member to workspace root pyproject.toml

ryan-williams

[marin-community/marin#1690] "Workspace" step 1: marin

First step in the "uv workspace migration plan" ([#1773]): initializes a uv workspace and moves the marin package into lib/marin/.

Next step: [#1723] (Levanter integration)

Changes

• Creates workspace root pyproject.toml
• Moves src/ → lib/marin/src/

ryan-williams

[marin-community/marin#1646] Pin levanter[serve] to 775ac7c6

• Since Sept '24[^1], Marin's Levanter dep was a "pin" of the form >=1.2.devNNNN
  • When Levanter PRs land, 1.2.devNNNN versions are published by [publish_dev.yml]
    • e.g. [levanter#1127] → [publish_dev#315] → [1.2.dev1500]
  • If Marin needs the changes, it may bump its pin
    • e.g. [marin#1522][#1522] / [pin][levanter>=1.2.dev1500 pin]
    • Marin may have frequently skipped a Levanter bump, when it actually needed more recent changes, since the convention was use >= rather than ==
• [#1591] moved to a == pin ([levanter==1.2.dev1535])
• [#1616] moved to a "floating" dep (against [levanter@main])

ryan-williams

[ryan-williams/git-helpers#104] 'add-global-file' is not a git command

I took this for a spin and encountered an issue with what I'm guessing is an unported script...

> . .git-rc
git: 'add-global-config-file' is not a git command. See 'git --help'.

I dug into this a bit and ended up provisionally including the config/.gitconfig into my ~/.gitconfig by hand. Then...

ryan-williams

ryan-williams/git-helpers#1 Add issues command, which opens github issues for a repo

Just came up with this command, I think it's gonna be great!

While you're in a git repo on your command line, you run issues and it opens the github issues for that repo in your browser.

ryan-williams

Marin/Levanter Version Tracker

Analyze the [Marin] → [Levanter] dependency over time: [openathena.s3.amazonaws.com/marin-levanter.html][demo]

[![Marin/Levanter Version Tracker][og.png]][demo]

Overview

This tool analyzes the Git history and PyPI releases to visualize:

• 404 commits to [Marin]'s main branch (since [#224], Sept 11, 2024)

ryan-williams

[marin-community/marin#1567] Extract executor code (to marin-community/thalas)

Description

Replaces marin.execution with [marin-community/thalas][thalas].

• Adapted from:
  • Open-Athena/marin#1
  • #1548
• Uses/Tests:

ryan-williams

[marin-community/thalas#4] Factor executor code+history from marin-community/marin

Extend/Replace #3

• Include [more paths][paths] in history replay (instead of adding them de novo on top of replayed history, as [#3] does in https://github.com/marin-community/thalas/pull/3/commits/119ddf8c9e7ee7a3500454a647dfd9d98f28439f)
• Include "Original-Commit: <URL>" line at the end of each replayed commit's body (expand commit msgs below for examples)

Marin test: [#1567][marin#1567]

[marin#1567] uses this branch, and has green CI.