-
Notifications
You must be signed in to change notification settings - Fork 0
Staging Debugging Guide
Jorge Silva edited this page Mar 30, 2016
·
11 revisions
So you yell and you yell and no one is fixing staging. Well, now you can debug yourself :)
- Go to runnable.io.
- Ensure rabbitMQ, redis, and mongo are up. If any of these are down, simply click
start container(DO NOT REBUILD THESE CONTAINERS). But if you did .... - mongo flushed
- redis flushed
- Ensure supporting services are up:
- api
-
api-worker WORKER-do-not-delete branch (updated to latest code
git fetch && git merge origin/master) and restart container - runnable-angular
-
mavis
** hit
http://mavis-staging-codenow.runnableapp.com/docksto ensure docks are available - optimus
- to get navi to work you have to do something special using navi on staging To ensure things are up do the following:
- Go to terminal of the service
-
curlthe respective port, example:curl localhost:80for api: 1. If you do not see any output of curl (or it hangs) then start/stop or click latest commit. - Run
ip addr | grep ethweand ensure the output contains ethwe. If not, rebuild container. - Inspect the logs by opening a terminal and running:
1.
npm install bunyan -g2.LOG_LEVEL_STDOUT=trace npm start | bunyan
Things to check:
- Go to the swarm container in runnable.io
- Go to Terminal
- Type
docker info - You should see a list of containers similar to this one:
root@7785a0fe6162:/sauron# docker info
Containers: 156
Images: 54
Storage Driver:
Role: primary
Strategy: spread
Filters: health, port, dependency, affinity, constraint
Nodes: 4
ip-10-8-166-119.2335750: 10.8.166.119:4242
└ Status: Healthy
└ Containers: 60
└ Reserved CPUs: 0 / 2
└ Reserved Memory: 0 B / 8.187 GiB
└ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2335750, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-03-30T18:44:59Z
ip-10-8-174-18.2828361: 10.8.174.18:4242
└ Status: Healthy
└ Containers: 7
└ Reserved CPUs: 0 / 2
└ Reserved Memory: 0 B / 8.187 GiB
└ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2828361, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-03-30T18:44:50Z
ip-10-8-175-27.2335750: 10.8.175.27:4242
└ Status: Healthy
└ Containers: 60
└ Reserved CPUs: 0 / 2
└ Reserved Memory: 488.3 MiB / 8.187 GiB
└ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2335750, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-03-30T18:44:55Z
ip-10-8-176-89.2828361: 10.8.176.89:4242
└ Status: Healthy
└ Containers: 29
└ Reserved CPUs: 0 / 2
└ Reserved Memory: 488.3 MiB / 8.187 GiB
└ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2828361, storagedriver=aufs
└ Error: (none)
└ UpdatedAt: 2016-03-30T18:44:40Z
Execution Driver:
Kernel Version: 3.13.0-79-generic
Operating System: linux
CPUs: 8
Total Memory: 32.75 GiB
Name: db487261fee8
ID:
Http Proxy:
Https Proxy:
No Proxy:
Things to check