SSVM agent stays in disconnected state after the management service restarts having pending tasks in execution
Problem
SSVM agent stays in disconnected state after the management server restarts when there are pending tasks in execution.
SSVM agents waits for the commands to complete before trying to connect back to the management server. Once the task execution completes, SSVM connects back to the management server.
We could notice that the SSVM's having state 'Disconnected' are having the below message in '/var/log/cloud.log'.
"Cannot connect because we still have 1 commands in progress"
We could restart the SSVM or the cloud agent in SSVM as a workaround, in large deployments having 10 and more SSVMs it would be difficult to perform this workaround manually.
Having SSVM agent in any state other than 'Up' would result is failure to perform tasks like snapshot creation in vmware deployments, uploading and downloading templates etc..
Root Cause
This behaviour is by current design.
Resolution/Workaround
Please find the copy the attached script to any one of the management servers and run it after you restart the management server, this will restart the agents in all SSVMs to make sure they connect to management servers immediately.
syntax: ./ssvm-restart.sh <mysql root password> <mysql DB password>
Steps to Reproduce the problem
1. Perform tasks like creating template from snapshot which requires involvement of ssvm .
2. Restart the cloudstack-management service.
3. Verify the ssvm agent status once the management service is up.
Verification
Once the script is executed successfully , the agent status for SSVM should be 'Up' and we should be able to perform taks like template creation from snapshot.
Impact on Existing System
The solution ensures that the services provided using SSVM are functional by reconnecting the SSVM agent.
Potential Adverse Effect
There is no known adverse effect on the system
Document ID:
115004866926
Product:
CloudPlatform
Version:
4.7.1
Operating System:
Linux
Reference Jira ID:
ES-4721
Comments