Skip to content

Staging Debugging Guide

Jorge Silva edited this page Mar 30, 2016 · 11 revisions

So you yell and you yell and no one is fixing staging. Well, now you can debug yourself :)

  1. Go to runnable.io.
  2. Ensure rabbitMQ, redis, and mongo are up. If any of these are down, simply click start container (DO NOT REBUILD THESE CONTAINERS). But if you did ....
  3. mongo flushed
  4. redis flushed
  5. Ensure supporting services are up:
  • api
  • api-worker WORKER-do-not-delete branch (updated to latest code git fetch && git merge origin/master) and restart container
  • runnable-angular
  • mavis ** hit http://mavis-staging-codenow.runnableapp.com/docks to ensure docks are available
  • optimus
  1. to get navi to work you have to do something special using navi on staging To ensure things are up do the following:
  2. Go to terminal of the service
  3. curl the respective port, example: curl localhost:80 for api: 1. If you do not see any output of curl (or it hangs) then start/stop or click latest commit.
  4. Run ip addr | grep ethwe and ensure the output contains ethwe. If not, rebuild container.
  5. Inspect the logs by opening a terminal and running: 1. npm install bunyan -g 2. LOG_LEVEL_STDOUT=trace npm start | bunyan

Possible Problems

Builds Are Not Working

Things to check:

Is Sauron connected to Swarm?

  1. Go to the swarm container in runnable.io
  2. Go to Terminal
  3. Type docker info
  4. You should see a list of containers similar to this one:
root@7785a0fe6162:/sauron# docker info                                          
Containers: 156                                                                 
Images: 54                                                                      
Storage Driver:                                                                 
Role: primary                                                                   
Strategy: spread                                                                
Filters: health, port, dependency, affinity, constraint                         
Nodes: 4                                                                        
 ip-10-8-166-119.2335750: 10.8.166.119:4242                                     
  └ Status: Healthy                                                             
  └ Containers: 60                                                              
  └ Reserved CPUs: 0 / 2                                                        
  └ Reserved Memory: 0 B / 8.187 GiB                                            
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2335750, storagedriver=aufs                    
  └ Error: (none)                                                               
  └ UpdatedAt: 2016-03-30T18:44:59Z                                             
 ip-10-8-174-18.2828361: 10.8.174.18:4242                                       
  └ Status: Healthy                                                             
  └ Containers: 7                                                               
  └ Reserved CPUs: 0 / 2                                                        
  └ Reserved Memory: 0 B / 8.187 GiB                                            
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2828361, storagedriver=aufs                    
  └ Error: (none)                                                               
  └ UpdatedAt: 2016-03-30T18:44:50Z                                             
 ip-10-8-175-27.2335750: 10.8.175.27:4242                                       
  └ Status: Healthy                                                             
  └ Containers: 60                                                              
  └ Reserved CPUs: 0 / 2                                                        
  └ Reserved Memory: 488.3 MiB / 8.187 GiB                                      
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2335750, storagedriver=aufs                    
  └ Error: (none)                                                               
  └ UpdatedAt: 2016-03-30T18:44:55Z                                             
 ip-10-8-176-89.2828361: 10.8.176.89:4242                                       
  └ Status: Healthy                                                             
  └ Containers: 29                                                              
  └ Reserved CPUs: 0 / 2                                                        
  └ Reserved Memory: 488.3 MiB / 8.187 GiB                                      
  └ Labels: executiondriver=native-0.2, kernelversion=3.13.0-79-generic, operati
ngsystem=Ubuntu 14.04.4 LTS, org=2828361, storagedriver=aufs                    
  └ Error: (none)                                                               
  └ UpdatedAt: 2016-03-30T18:44:40Z                                             
Execution Driver:                                                               
Kernel Version: 3.13.0-79-generic                                               
Operating System: linux                                                         
CPUs: 8                                                                         
Total Memory: 32.75 GiB                                                         
Name: db487261fee8                                                              
ID:                                                                             
Http Proxy:                                                                     
Https Proxy:                                                                    
No Proxy:               

URLs are not being redirect

Things to check

Clone this wiki locally