Skip to content

Instantly share code, notes, and snippets.

@aliellis
aliellis / gist:3714d9c9510fa547e41156c1e1d639de
Last active March 31, 2022 11:30
Hooking up Ganglia to Grafana (all services on a single EMR cluster, different boxes TBC)
Edit the gmetad.conf file of Ganglia to include the following values:
carbon_server: "localhost"
carbon_port: 3000
carbon_protocol udp
carbon_timeout 500
Edit the influxdb.conf file of InfuxDB to include the following values:
Establsh a SOCKS proxy to the master node of the EMR cluster
ssh -i LOCATION-OF-PEM -N -D PORT-THAT-WILL-BE-RESERVED -p PORT-TO-CONNECT-TO-CLUSTER hadoop@MASTER-NODE-PUBLIC-DNS
- ssh -i ~/.ssh/emr.pem -N -D 8160 -p 22 [email protected]
Install foxyproxy extension and import a file containing these values:
Ensure that the port specified on this line:
<manualconf host="localhost" port="PORT-THAT-WILL-BE-RESERVED" socksversion="5" isSocks="true" username="" password="" domain="" />
matches the one specified in the SOCKS connection cmd, so in the above example, 8160
@aliellis
aliellis / subparser.py
Created April 16, 2016 11:14
using subparsers for uploaders
import argparse
def main():
parser = argparse.ArgumentParser()
parser.add_argument('--input-bucket')
parser.add_argument('--segments-path')
parser.add_argument('--localdir')
parser.add_argument('--sentry-uri')