Your support and inputs will be much appreciated. Please do help us
We would like to get your support on the below points,
• Our prod is of 9 nodes cluster. Where our target/destination connection is trino, is running on one of the prod nodes as docker container.
• All our tools are running on docker containers by the way.
• Installing Apache Spark as cluster setup i.e. drivers and executors
• How can achieve fault tolerant apache spark cluster.
• Can we achieve scalable spark cluster, if yes, how can we.
• Next, we need Integrate Apache spark docker container to jupyter notebook docker container.