Convert a simple one line string to RDD in Spark

python apache-spark pyspark distributed-computing rdd

try using List as parameter:

sc.parallelize(List(line)).collect()

it returns

res1: Array[String] = Array(hello,world)

python apache-spark pyspark distributed-computing rdd

use the following code :

sc.parallelize(Seq(line))

python apache-spark pyspark distributed-computing rdd

The below code works fine in Python

sc.parallelize([line]).collect()['Hello, world']

Here we are passing the parameter "line" as a list.

CodeHunter