Spark: Update to current example standards, add GCS connector

* Pod -> ReplicationController, which also forced me to hack around
hostname issue on the master. (Spark master sees the incoming slave
request to spark-master and assumes it's not meant for it, since it's
name is spark-master-controller-abcdef.)

* Remove service env dependencies (depend on DNS instead).

* JSON -> YAML.

* Add GCS connector.

* Make example do something actually useful: A familiar example to
anyone at Google, implement wordcount of all of Shakespeare's works.

* Fix a minor service connection issue in the gluster example.
This commit is contained in:
Zach Loafman
2015-10-26 13:42:02 -07:00
parent c0fba82da4
commit 777d3a6ec0
25 changed files with 325 additions and 231 deletions

View File

@@ -344,10 +344,11 @@ func TestExampleObjectSchemas(t *testing.T) {
"secret": &api.Secret{},
},
"../examples/spark": {
"spark-driver-controller": &api.ReplicationController{},
"spark-master-controller": &api.ReplicationController{},
"spark-master-service": &api.Service{},
"spark-master": &api.Pod{},
"spark-webui": &api.Service{},
"spark-worker-controller": &api.ReplicationController{},
"spark-driver": &api.Pod{},
},
"../examples/spark/spark-gluster": {
"spark-master-service": &api.Service{},