This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Edit the gmetad.conf file of Ganglia to include the following values: | |
carbon_server: "localhost" | |
carbon_port: 3000 | |
carbon_protocol udp | |
carbon_timeout 500 | |
Edit the influxdb.conf file of InfuxDB to include the following values: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Establsh a SOCKS proxy to the master node of the EMR cluster | |
ssh -i LOCATION-OF-PEM -N -D PORT-THAT-WILL-BE-RESERVED -p PORT-TO-CONNECT-TO-CLUSTER hadoop@MASTER-NODE-PUBLIC-DNS | |
- ssh -i ~/.ssh/emr.pem -N -D 8160 -p 22 [email protected] | |
Install foxyproxy extension and import a file containing these values: | |
Ensure that the port specified on this line: | |
<manualconf host="localhost" port="PORT-THAT-WILL-BE-RESERVED" socksversion="5" isSocks="true" username="" password="" domain="" /> | |
matches the one specified in the SOCKS connection cmd, so in the above example, 8160 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import argparse | |
def main(): | |
parser = argparse.ArgumentParser() | |
parser.add_argument('--input-bucket') | |
parser.add_argument('--segments-path') | |
parser.add_argument('--localdir') | |
parser.add_argument('--sentry-uri') |