OSDir

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

can't start guest VM assigned with new empty affinity group


Hi, list:



My user is creating a bunch of guest VM instances using affinity groups and we started to see InsufficientServerCapacityException errors and new VM instances won’t start, even though this is for a newly created empty affinity group and both my clusters have plenty of CPU/Memory/IP address resources.



This happened after we have created 4 new groups and added 8 instances into each of them. Now the 5th group is acting up and the only errors in the log are the following stack trace.



INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-4:ctx-197fec7e job-20856) Add job-20856 into job monitoring

INFO  [o.a.c.a.c.a.v.StartVMCmdByAdmin] (API-Job-Executor-4:ctx-197fec7e job-20856 ctx-1d550d44) com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-3-393-VM]Scope=interface com.cloud.dc.DataCenter; id=1

INFO  [o.a.c.a.c.a.v.StartVMCmdByAdmin] (API-Job-Executor-4:ctx-197fec7e job-20856 ctx-1d550d44) Unable to create a deployment for VM[User|i-3-393-VM], Please check the affinity groups provided, there may not be sufficient capacity to follow them

com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[User|i-3-393-VM]Scope=interface com.cloud.dc.DataCenter; id=1

        at org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.reserveVirtualMachine(VMEntityManagerImpl.java:214)

        at org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.reserve(VirtualMachineEntityImpl.java:200)

        at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:4100)

        at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2592)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

        at java.lang.reflect.Method.invoke(Method.java:606)

        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)

        at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)

        at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)

        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)

        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)

        at com.sun.proxy.$Proxy197.startVirtualMachine(Unknown Source)

        at org.apache.cloudstack.api.command.admin.vm.StartVMCmdByAdmin.execute(StartVMCmdByAdmin.java:51)

        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150)

        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)

        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:554)

        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)

        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)

        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)

        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)

        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)

        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:502)

        at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)

        at java.util.concurrent.FutureTask.run(FutureTask.java:262)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

INFO  [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-4:ctx-197fec7e job-20856) Remove job-20856 from job monitoring


Any helps are much appreciated,

Thanks

Yiping