Problem: How to check the version of the spark installed in your environment?
Solution:
- Search for “spark-shell” in file system.
- in my case the absolute path of spark-shell is “/usr/lib/spark/bin”
- Open terminal and go to above identified path.
- Run
orSpark-shell
PySpark
.