Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save michaelpomogajko/0ac62a2c30ad91db6244fc4a509b899f to your computer and use it in GitHub Desktop.
Save michaelpomogajko/0ac62a2c30ad91db6244fc4a509b899f to your computer and use it in GitHub Desktop.
Worker logs kill loop
Successfully registered with master spark://spark-master-0.spark-headless.spark.svc.cluster.local:7077
20/03/11 09:57:34 INFO Worker: Asked to launch executor app-20200311095734-0000/0 for sparklyr
20/03/11 09:57:34 INFO SecurityManager: Changing view acls to: spark
20/03/11 09:57:34 INFO SecurityManager: Changing modify acls to: spark
20/03/11 09:57:34 INFO SecurityManager: Changing view acls groups to:
20/03/11 09:57:34 INFO SecurityManager: Changing modify acls groups to:
20/03/11 09:57:34 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
20/03/11 09:57:34 INFO ExecutorRunner: Launch command: "/opt/bitnami/java/bin/java" "-cp" "/opt/bitnami/spark/conf/:/opt/bitnami/spark/jars/*" "-Xmx4096M" "-Dspark.driver.port=32963" "org.apache.spark.executor.CoarseGrainedExecutorBackend" "--driver-url" "spark://CoarseGrainedScheduler@test-spark-stable-2020-03-11-09-57-17-zmws7:32963" "--executor-id" "0" "--hostname" "10.24.3.49" "--cores" "8" "--app-id" "app-20200311095734-0000" "--worker-url" "spark://[email protected]:43361"
20/03/11 09:57:36 INFO Worker: Executor app-20200311095734-0000/0 finished with state EXITED message Command exited with code 1 exitStatus 1
20/03/11 09:57:36 INFO ExternalShuffleBlockResolver: Clean up non-shuffle files associated with the finished executor 0
20/03/11 09:57:36 INFO ExternalShuffleBlockResolver: Executor is not registered (appId=app-20200311095734-0000, execId=0)
20/03/11 09:57:37 INFO Worker: Asked to launch executor app-20200311095734-0000/1 for sparklyr
.
.
(repeats)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment