Table of Contents
Spark need driver libraries, download from for instance central.maven.org/maven2/postgresql/postgresql/9.1-901-1.jdbc4/postgresql-9.1-901-1.jdbc4.jar and place in spark-2.4.0-bin-hadoop2.7/jars
My current has no configuration. The only configuration lies in my current startup scripts, which goes:
Plus hadoop.
SPARK_MASTER_IP=0.0.0.0 ./sbin/start-master.sh --webui-port 8090 &
./sbin/start-slave.sh -c 1 -m 1G spark://127.0.0.1:7077 &
One addition is for the jdbc jar.