Skip to content

Instantly share code, notes, and snippets.

View aahmed-se's full-sized avatar
🎯
Focusing

Ali Ahmed aahmed-se

🎯
Focusing
View GitHub Profile
#!/bin/bash
# =============================================================================
# 🏎️ NFS STORAGE BENCHMARK — Audio File I/O Profile (PyTorch-Realistic)
# =============================================================================
#
# PURPOSE:
# Benchmarks an NFS (or similar networked) filesystem for ML training pipelines
# that consume large numbers of small WAV/FLAC audio files using PyTorch-style
# dataloaders.
#
#!/bin/bash
# =============================================================================
# 🏎️ NFS STORAGE BENCHMARK — Audio File I/O Profile (PyTorch-Realistic)
# =============================================================================
#
# PURPOSE:
# Benchmarks an NFS (or similar networked) filesystem for ML training pipelines
# that consume large numbers of small WAV/FLAC audio files using PyTorch-style
# dataloaders.
#
#!/bin/bash
# =============================================================================
# 🏎️ NFS STORAGE BENCHMARK — Audio File I/O Profile
# =============================================================================
#
# PURPOSE:
# Benchmarks an NFS (or similar networked) filesystem for a distributed ML
# training pipeline that consumes large volumes of WAV/FLAC audio files.
#
# WHAT THIS TESTS:
#!/bin/bash
# 🏎️ CLUSTER STORAGE AUDIT (Sequential & Random Suite)
# Usage: ./storage_bench.sh /path/to/mount
DIR=${1:-/data_vast/bench_$(hostname)}
JOBS=16 # Number of simultaneous threads
RUNTIME=10s # Duration of each of the 4 tests
RAMP=5s # Warm-up time to saturate controllers
FILE_SIZE=4G # Data per thread (Total per node = 64GB)
#!/bin/bash
# 🏎️ CLUSTER STORAGE AUDIT (Sequential & Random Suite)
# Usage: ./storage_bench.sh /path/to/mount
DIR=${1:-/data_vast/bench_$(hostname)}
JOBS=16 # Number of simultaneous threads
RUNTIME=10s # Duration of each of the 4 tests
RAMP=5s # Warm-up time to saturate controllers
FILE_SIZE=4G # Data per thread (Total per node = 64GB)
class Concurnas < Formula
desc "Concurnas is an open source JVM programming language designed for building reliable, scalable, high performance concurrent, distributed and parallel systems"
homepage "https://concurnas.com"
url "https://github.com/Concurnas/Concurnas/releases/download/1.14.020/Concurnas-1.14.020.zip"
sha256 "721b12c6fa7d87cbf2763d2b7c3ffc0c5395d2cb1f3760e9ae33d6f8c650a064"
version "1.14.020"
bottle :unneeded
depends_on :java => "1.8+"
#!/bin/sh
set -e
# script to install maven
# todo: add method for checking if latest or automatically grabbing latest
mvn_version=${mvn_version:-3.6.1}
url="https://archive.apache.org/dist/maven/maven-3/${mvn_version}/binaries/apache-maven-${mvn_version}-bin.tar.gz"
install_dir="/opt/maven"
class Pulsarctl < Formula
desc "Pulsar admin go cli"
homepage "https://github.com/streamnative/pulsarctl"
url "https://github.com/streamnative/pulsarctl/releases/download/v0.2.0/pulsarctl-amd64-darwin"
version "v0.2.0"
sha256 "a752acbbf044cdb74e27bcb1d6145b0307588961732fbd63fd479cdbd3c9ef24"
def install
mv "pulsarctl-amd64-darwin", "pulsarctl"
bin.install "pulsarctl"
class Pulsarctl < Formula
desc "Pulsar admin go cli"
homepage "https://github.com/streamnative/pulsarctl"
url "https://github.com/streamnative/pulsarctl/archive/v0.1.0.tar.gz"
version "v0.1.0"
sha256 "780e97f5f7a744525ffbb0e68d8e658837bee998269b72456711f034b1532e7d"
depends_on "go" => :build
def install

alahmed

Keybase proof

I hereby claim:

  • I am aahmed-se on github.
  • I am alahmed (https://keybase.io/alahmed) on keybase.
  • I have a public key ASD6PV_6m2tYtgYsxIVsp8KZtfC6LSNnua-pVYDHVfZkdAo

To claim this, I am signing this object: