Apache Spark Setup on LMFDB

Use sbin/start-all.sh to start the master on lmfdb and the workers as configured here and listed in slaves
Open ssh tunnels to 4040 and 8080 to see the status boards.
To confirm its working, run ./bin/spark-shell --master spark://192.168.13.2:7077 where the IP is lmfdb-ib.

Name		Name	Last commit message	Last commit date
LICENSE		LICENSE
README.md		README.md
docker.properties.template		docker.properties.template
fairscheduler.xml.template		fairscheduler.xml.template
log4j.properties.template		log4j.properties.template
metrics.properties.template		metrics.properties.template
slaves		slaves
spark-defaults.conf		spark-defaults.conf
spark-env.sh		spark-env.sh

Navigation Menu