777d3a6ec0
* Pod -> ReplicationController, which also forced me to hack around hostname issue on the master. (Spark master sees the incoming slave request to spark-master and assumes it's not meant for it, since it's name is spark-master-controller-abcdef.) * Remove service env dependencies (depend on DNS instead). * JSON -> YAML. * Add GCS connector. * Make example do something actually useful: A familiar example to anyone at Google, implement wordcount of all of Shakespeare's works. * Fix a minor service connection issue in the gluster example.
34 lines
787 B
YAML
34 lines
787 B
YAML
kind: ReplicationController
|
|
apiVersion: v1
|
|
metadata:
|
|
name: spark-gluster-worker-controller
|
|
labels:
|
|
component: spark-worker
|
|
spec:
|
|
replicas: 2
|
|
selector:
|
|
component: spark-worker
|
|
template:
|
|
metadata:
|
|
labels:
|
|
component: spark-worker
|
|
uses: spark-master
|
|
spec:
|
|
containers:
|
|
- name: spark-worker
|
|
image: gcr.io/google_containers/spark-worker:1.5.1_v1
|
|
ports:
|
|
- containerPort: 8888
|
|
volumeMounts:
|
|
- mountPath: /mnt/glusterfs
|
|
name: glusterfsvol
|
|
resources:
|
|
requests:
|
|
cpu: 100m
|
|
volumes:
|
|
- name: glusterfsvol
|
|
glusterfs:
|
|
endpoints: glusterfs-cluster
|
|
path: MyVolume
|
|
readOnly: false
|