Apache Spark Rdd persist

0
votes

Once we persist RDD in memory, for how long it will be there in memory? Can we access the same if we come out of spark shell ?

1
apache-sparkrdd
Best way is to query it and find out. - Raghuveer
oh!! gr8 answer - Abhinav Kumar
RDD's are stored as deserialized java objects in spark executor JVM's. They continue to exist as long as the JVM's are active and cease to exist (i.e garbage collected) when exit from spark shell. - sdinesh94
gr8 answer for gr8 question - Raghuveer
@ Raghuveer frm whr did u get such an awesome answer yaar lol........everything u can try out yourself then y r u thr in stackoverflow....... :D - Abhinav Kumar

1 Answers

2
votes

if you come out of your shell then your RDD is no longer accessible or in memory for next instance of spark-shell or any other process.