Skip to main content
Last updated August 12, 2014 21:50, by esaxe
Feedicon  

OpenStack Debugging and Troubleshooting

OpenStack Configuration Files

Cinder

  • /etc/cinder/cinder.conf
  • /etc/cinder/api-paste.ini

Glance

  • /etc/glance/glance-api.conf
  • /etc/glance/glance-cache.conf
  • /etc/glance/glance-registry.conf
  • /etc/glance/glance-api-paste.ini
  • /etc/glance/glance-registry-paste.ini
  • /etc/glance/glance-scrubber.conf

Keystone

  • /etc/keystone/keystone.conf

Horizon

  • /etc/openstack_dashboard/local_settings.py
  • /etc/apache2/2.2/httpd.conf (or any other Apache configuration files)
  • /etc/apache2/2.2/conf.d/openstack-dashboard-http.conf or /etc/apache2/2.2/conf.d/openstack-dashboard-tls.conf

Neutron

  • /etc/neutron/neutron.conf
  • /etc/neutron/api-paste.ini
  • /etc/neutron/l3_agent.ini
  • /etc/neutron/dhcp_agent.ini
  • /etc/neutron/plugins/evs/evs_plugin.ini

Nova

  • /etc/nova/nova.conf
  • /etc/nova/api-paste.ini

Swift

  • /etc/swift/swift.conf
  • /etc/swift/account-server.conf
  • /etc/swift/container-server.conf
  • /etc/swift/object-server.conf
  • /etc/swift/proxy-server.conf
  • /etc/swift/rsyncd.conf

SMF Services

Cinder

  • svc:/application/openstack/cinder/cinder-api:default
  • svc:/application/openstack/cinder/cinder-backup:default
  • svc:/application/openstack/cinder/cinder-db:default
  • svc:/application/openstack/cinder/cinder-scheduler:default
  • svc:/application/openstack/cinder/cinder-volume:default
  • svc:/application/openstack/cinder/cinder-volume:setup

Glance

  • svc:/application/openstack/glance/glance-api:default
  • svc:/application/openstack/glance/glance-db:default
  • svc:/application/openstack/glance/glance-registry:default
  • svc:/application/openstack/glance/glance-scrubber:default

Keystone

  • svc:/application/openstack/keystone:default

Neutron

  • svc:/application/openstack/neutron/neutron-dhcp-agent:default
  • svc:/application/openstack/neutron/neutron-l3-agent:default
  • svc:/application/openstack/neutron/neutron-server:default

Nova

  • svc:/application/openstack/nova/nova-api-ec2:default
  • svc:/application/openstack/nova/nova-api-osapi-compute:default
  • svc:/application/openstack/nova/nova-cert:default
  • svc:/application/openstack/nova/nova-compute:default
  • svc:/application/openstack/nova/nova-conductor:default
  • svc:/application/openstack/nova/nova-objectstore:default
  • svc:/application/openstack/nova/nova-scheduler:default

Swift

  • svc:/application/openstack/swift/swift-account-auditor:default
  • svc:/application/openstack/swift/swift-account-reaper:default
  • svc:/application/openstack/swift/swift-account-replicator:default
  • svc:/application/openstack/swift/swift-account-server:default
  • svc:/application/openstack/swift/swift-container-auditor:default
  • svc:/application/openstack/swift/swift-container-replicator:default
  • svc:/application/openstack/swift/swift-container-server:default
  • svc:/application/openstack/swift/swift-container-sync:default
  • svc:/application/openstack/swift/swift-container-updater:default
  • svc:/application/openstack/swift/swift-object-auditor:default
  • svc:/application/openstack/swift/swift-object-expirer:default
  • svc:/application/openstack/swift/swift-object-replicator:default
  • svc:/application/openstack/swift/swift-object-server:default
  • svc:/application/openstack/swift/swift-object-updater:default
  • svc:/application/openstack/swift/swift-proxy-server:default
  • svc:/application/openstack/swift/swift-replicator-rsync:default

Tips And Tricks for Debugging

  • Setting 'debug = true' and 'verbose = true' in the various conf files helps a bit with trying to diagnose what's gone wrong. Usually there's a placeholder value in the conf file which is commented out that can be used to toggle the log verbosity. When any of the configuration files change, all services for that component will need to be restarted to pick up the change.
  • Usually 'tail -30 `svcs -L <svc name>` will provide enough information from the SMF log to be able to diagnose an issue. Sometimes, with verbose and/or debug = true, we'll need more lines since OpenStack can get pretty chatty.
  • Debugging Horizon can be harder because it goes through Apache. Enabling debug = True in /etc/openstack_dashboard/local_settings.py will dump Django errors to the webpage. Django does a pretty fantastic job of capturing a ton of information about what went wrong with the application itself. Horizon itself doesn't log terribly well. Typically Users will try some operation, hit some kind of failure and report it to the Admins. The Admins will have to try to pull the information from the SMF logs as explained above.
  • Since Nova is built on top of Zones, Admins can find zone logs in /var/log/zones, including the console and install logs.
 
 
Close
loading
Please Confirm
Close