Skip to content

change kubernetes examples to use Deployment#3909

Merged
robertnishihara merged 2 commits into
ray-project:masterfrom
rongou:k8s-deployment
Jan 31, 2019
Merged

change kubernetes examples to use Deployment#3909
robertnishihara merged 2 commits into
ray-project:masterfrom
rongou:k8s-deployment

Conversation

@rongou

@rongou rongou commented Jan 30, 2019

Copy link
Copy Markdown
Contributor

What do these changes do?

Change the kubernetes examples to use Deployment as this is now recommended over ReplicationControllers.

Also reduce the CPU requirements to make it easier to try this out on a development environment (kubeadm, MicroK8s etc.).

@robertnishihara

Copy link
Copy Markdown
Collaborator

@rongou thanks a lot for the fixes! I'll try it out.

@AmplabJenkins

Copy link
Copy Markdown

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/11320/
Test PASSed.

@robertnishihara

Copy link
Copy Markdown
Collaborator

Thanks a lot @rongou! This seems to work for me. Note that I had to make a small change to the example.

We start a redis server on the head node. Then we try to connect to it by doing

import redis
import socket

redis.StrictRedis(host=socket.gethostbyname("ray-head"), port=6379)

socket.gethostbyname("ray-head") returns something like 10.104.7.64, whereas the "correct" IP address seems to be something more like 172.17.0.6.

The attempt to connect to Redis succeeds when done from a node other than the one that Redis is on, but it fails when done from the same node that Redis is on. That's why I switched to using localhost in the example when we are on the same machine that the Redis servers are on.

Later on it may make sense to simply start all of the Redis servers on a different collection of nodes.

@robertnishihara robertnishihara merged commit 8f6bd6c into ray-project:master Jan 31, 2019
@AmplabJenkins

Copy link
Copy Markdown

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/11337/
Test FAILed.

@rongou rongou deleted the k8s-deployment branch January 31, 2019 16:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

3 participants