test(pyspark): simplify clean up by making __del__ a no-op in the spark case

test(pyspark): simplify clean up by making __del__ a no-op in the spark case #26190