mojothejojo
patmandenver
/ install_java_scala_sbt.sh
Last active
April 15, 2021 16:30
Script to install Oracle Java 1.8, Scala 2.11.7 and sbt 0.13.9 on Ubuntu 14.04
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # | |
| # Script to Install | |
| # Oracle Java 1.8 | |
| # Scala 2.11.7 | |
| # sbt 0.13.9 | |
| # | |
| ############################## | |
| #Script must be run as root/sudo |
thekensta
/ spark_s3a_instructions.sh
Created
October 14, 2015 20:27
Set up Apache Spark 1.5+ with Hadoop 2.6+ s3a
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # For a local environment | |
| # Install hadoop and apache-spark via homebrew | |
| # Apache Spark conf file | |
| # libexec/conf/spark-defaults.conf | |
| # Make the AWS jars available to Spark | |
| spark.executor.extraClassPath /usr/local/Cellar/hadoop/2.7.1/libexec/share/hadoop/tools/lib/aws-java-sdk-1.7.4.jar:/usr/local/Cellar/hadoop/2.7.1/libexec/share/hadoop/tools/lib/hadoop-aws-2.7.1.jar | |
| spark.driver.extraClassPath /usr/local/Cellar/hadoop/2.7.1/libexec/share/hadoop/tools/lib/aws-java-sdk-1.7.4.jar:/usr/local/Cellar/hadoop/2.7.1/libexec/share/hadoop/tools/lib/hadoop-aws-2.7.1.jar | |
| # Add file |