After migrating from Windows 5.5 vCenter to VCSA 6.5 Update1 (intermediate step to 6.7) everything was working well. After the migration the vcenter machine cert was soon to be expired so I replaced it, though I did notice https://vc.domain.com:7444 was still using the old cert. I didn't worry about this as the old cert was not expired. A month or so passes by with vcenter being very stable. Completed host upgrades to 6.5U1 using VUM over the weekend - In the mean time the cert bound to 7444 expired, which caused problems with the Migration wizard to 6.7. Also, VUM service had stopped and wouldn't start (perhaps it was ok until I rebooted the VCSA and now VUM wont start)

With the help of VMWare support we fixed this by replacing the cert in the STS_INTERNAL_SSL_CERT. This fixed the expired cert for 7444 but did not help with the VUM issues. I'm pretty well stuck, I am just waiting on VMWare support to help. In the mean time I thought I'd post here in case someone could possible help.

Regards

I get the following errors in the SSH session when executing service-control --start vmware-updatemgr:

Error executing start on service updatemgr. Details {

    "resolution": null,

    "detail": [

        {

            "args": [

                "updatemgr"

            ],

            "id": "install.ciscommon.service.failstart",

            "localized": "An error occurred while starting service 'updatemgr'",

            "translatable": "An error occurred while starting service '%(0)s'"

        }

    ],

    "componentKey": null,

    "problemId": null

}

Service-control failed. Error {

    "resolution": null,

    "detail": [

        {

            "args": [

                "updatemgr"

            ],

            "id": "install.ciscommon.service.failstart",

            "localized": "An error occurred while starting service 'updatemgr'",

            "translatable": "An error occurred while starting service '%(0)s'"

        }

    ],

    "componentKey": null,

    "problemId": null

}

tail -f updatemgr-utility.log give this:

[2018-10-10 23:29:10,255 INFO] Install Key store for Jetty

[2018-10-10 23:29:11,579 INFO] Keystore installed successfully.

[2018-10-10 23:29:11,953 INFO] Updating VUM extension with VC

[2018-10-10 23:29:12,236 INFO] Updating CM service info

[2018-10-10 23:29:12,402 ERROR] CM ReRegisterService failure. Exception is (cis.cm.fault.ComponentManagerFault) {

   dynamicType = <unset>,

   dynamicProperty = (vmodl.DynamicProperty) [],

   msg = '',

   faultCause = <unset>,

   faultMessage = (vmodl.LocalizableMessage) [],

   errorCode = 0,

   errorMessage = 'UNKNOWN'

}

[2018-10-10 23:29:12,402 ERROR] Unable to update CM service info

Tail on cm.log give me this while starting service:

2018-10-10T23:24:35.847Z [pool-2-thread-1 [] WARN  com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore (f15657f3-ac72-40f0-8c90-3e948201000c)] Call to lookup service failed; uri:https://VCENTER.DoMain.int/lookupservice/sdk [(vmodl.fault.InvalidArgument) {

   faultCause = null,

   faultMessage = null,

   invalidProperty = Invalid certificate

}]

2018-10-10T23:24:35.847Z [pool-2-thread-1 [] ERROR com.vmware.cis.services.cm.service.ServiceManagerImplTemplate (f15657f3-ac72-40f0-8c90-3e948201000c)] reRegisterService v1: Failed to re-register c39131ca-cda5-446d-a6ac-44b51348c107 (vpxd-extension-a6f84462-5ea2-11e6-ada6-0050569777b5@vsphere.local, com.vmware.vcIntegrity/vcIntegrity 6.5.0)

com.vmware.vim.binding.vmodl.fault.InvalidArgument: null

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_141]

        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_141]

        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_141]

        at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_141]

        at java.lang.Class.newInstance(Class.java:442) ~[?:1.8.0_141]

        at com.vmware.vim.vmomi.core.types.impl.ComplexTypeImpl.newInstance(ComplexTypeImpl.java:174) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.types.impl.DefaultDataObjectFactory.newDataObject(DefaultDataObjectFactory.java:25) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.ComplexStackContext.<init>(ComplexStackContext.java:30) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.parse(UnmarshallerImpl.java:150) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl$UnmarshallSoapFaultContext.unmarshall(UnmarshallerImpl.java:101) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoapFault(UnmarshallerImpl.java:88) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.core.soap.impl.unmarshaller.UnmarshallerImpl.unmarshalSoapFault(UnmarshallerImpl.java:83) ~[vlsi-core.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.SoapFaultStackContext.setValue(SoapFaultStackContext.java:40) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.processNextElement(ResponseUnmarshaller.java:127) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.ResponseUnmarshaller.unmarshal(ResponseUnmarshaller.java:70) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.unmarshalResponse(ResponseImpl.java:274) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.ResponseImpl.setResponse(ResponseImpl.java:230) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.http.impl.HttpExchangeBase.parseResponse(HttpExchangeBase.java:150) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.http.impl.HttpExchange.run(HttpExchange.java:48) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingBase.executeRunnable(HttpProtocolBindingBase.java:226) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.http.impl.HttpProtocolBindingImpl.send(HttpProtocolBindingImpl.java:110) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$CallExecutor.sendCall(MethodInvocationHandlerImpl.java:613) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl$CallExecutor.executeCall(MethodInvocationHandlerImpl.java:594) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.completeCall(MethodInvocationHandlerImpl.java:345) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.invokeOperation(MethodInvocationHandlerImpl.java:305) ~[vlsi-client.jar:?]

        at com.vmware.vim.vmomi.client.common.impl.MethodInvocationHandlerImpl.invoke(MethodInvocationHandlerImpl.java:179) ~[vlsi-client.jar:?]

        at com.sun.proxy.$Proxy101.set(Unknown Source) ~[?:?]

        at com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore$LsVmomiWrapper$3.execute(LsVmomiSiteStore.java:229) ~[service-cm.jar:?]

        at com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore$LsVmomiWrapper$3.execute(LsVmomiSiteStore.java:226) ~[service-cm.jar:?]

        at com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore$LsVmomiWrapper.callLs(LsVmomiSiteStore.java:302) ~[service-cm.jar:?]

        at com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore$LsVmomiWrapper.set(LsVmomiSiteStore.java:224) ~[service-cm.jar:?]

        at com.vmware.cis.services.cm.service.impl.LsVmomiSiteStore.updateService(LsVmomiSiteStore.java:622) ~[service-cm.jar:?]

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141]

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141]

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141]

        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141]

        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at com.vmware.cis.services.common.perfmon.PerfmonInterceptor.invoke(PerfmonInterceptor.java:31) ~[service-common.jar:?]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) ~[spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at com.sun.proxy.$Proxy67.updateService(Unknown Source) ~[?:?]

        at com.vmware.cis.services.cm.service.ServiceManagerImplTemplate.reRegisterService(ServiceManagerImplTemplate.java:306) [service-cm.jar:?]

        at com.vmware.cis.services.cm.service.ServiceManagerImpl.reRegisterService(ServiceManagerImpl.java:291) [service-cm.jar:?]

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141]

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141]

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141]

        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141]

        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at com.vmware.cis.services.common.perfmon.PerfmonInterceptor.invoke(PerfmonInterceptor.java:31) [service-common.jar:?]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) [spring-aop-4.3.9.RELEASE.jar:4.3.9.RELEASE]

        at com.sun.proxy.$Proxy68.reRegisterService(Unknown Source) [?:?]

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_141]

        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_141]

        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_141]

        at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_141]

        at com.vmware.vim.vmomi.server.impl.InvocationTask.run(InvocationTask.java:65) [vlsi-server.jar:?]

        at com.vmware.vim.vmomi.server.common.impl.RunnableWrapper$1.run(RunnableWrapper.java:47) [vlsi-server.jar:?]

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_141]

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_141]

        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_141]

tcpdump on lo gives:

Request

POST /lookupservice/sdk HTTP/1.1

Content-Type: text/xml; charset=utf-8

SOAPAction: urn:lookup/2.0

Content-Length: 21474

Host: https://VCENTER.DoMain.int/lookupservice/sdk

Connection: Keep-Alive

User-Agent: VMware vim-java 1.0

Cookie: vmware_soap_session=a7600162-79b1-4797-9e7f-4b885dde550b

Accept-Encoding: gzip,deflate

X-Forwarded-For: 127.0.0.1

X-Forwarded-Proto: https

....CERT HASH in XML stream.........

Request

HTTP/1.1 500

Set-Cookie: vmware_soap_session=a7600162-79b1-4797-9e7f-4b885dde550b; HttpOnly

Content-Type: text/xml;charset=utf-8

Content-Length: 558

Date: Wed, 10 Oct 2018 01:45:27 GMT

Connection: close

<?xml version='1.0' encoding='UTF-8'?><soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:soapenc="http://schemas.xmlsoap.org/soap/encoding/" xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"><soapenv:Body><soapenv:Fault><faultcode>ServerFaultCode</faultcode><faultstring/><detail><RuntimeFaultFault xsi:type="InvalidArgument" xmlns="urn:lookup"><invalidProperty>Invalid certificate</invalidProperty></RuntimeFaultFault></detail></soapenv:Fault></soapenv:Body></soapenv:Envelope>

Hi Team, I'm trying to install vcsa 6.7 and I'm having issues with my DNS is there a way I can install without a DNS. I do have a DNS but when I'm in the server room I'm unbale to ping any machines its probably the network connection?

When installing a second vCenter I keep running into the errors:

1. Firstboot script execution error.

2. The supplied System Name vcenter-01.domain.local is not valid.

3. If the supplied system name is a FQDN, then make sure the DNS forward lookup results in at least one valid IP address in the system. If the supplied system name is an IP address, then it should be one of the valid IP address(es) in the system.

This is a second vCenter install I am working on. I installed a vCenter 6 appliance with the psc and vCenter in our DR creating creating the vsphere.local (we are installing new hardware and moving from 5.0) just fine. At our Prod site I am running the appliance iso using a newly setup esxi 6 u1 host. I join the SSO site and create a new site name or join the existing, I am using a dvgroup with a Ephemeral port on the dvSwitch. I have triple checked the DNS settings. There is a host and pointer record for the esxi 6 host and appliance, I can run a nslookup from multiple machines with no issues.

Any thoughts as I am stuck.

Hia

I'm trying to create a local account on the VCSA that is able to run 'service-control --status' in the bash shell. While trying to do this I've come accross a few things I cant really explain.

1. I can create users without any problem using "localaccounts.user.add --username x --role y -- password" but I cant edit or delete them without getting an error that the user is not recognized.

     - localaccounts.user.list only lists the root user. Didn't change after setting the bash shell as default for my custom user.

     - I can see all the users I created in my VCSA Web Interface, but I cant edit or delete useres here.

2. None of the given roles, even superAdmin, seems to have the permissions to run service-control. Do I need a root shell to run those commands?

I'm clearly missing something, overread something.. hoping you can point me in the right direction. I'm running a VCSA V6.7 U3 Build 14367737.

Regards

David

hi,

in order to monitor the VMs ans ESXi, vcenter uses the monitor port from every esxi and those ports form a vlan?

Using vcenter 6.7 Administration - > Certificates have added root CA certificate of Letsencrypt and replaced Machine certificate with signed one provide certificate and key

After reboot vcenter doesn`t start anymore:

2019-12-19T17:22:23.429Z info vpxd[05606] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2019-12-19T17:22:23.430Z info vpxd[05605] [Originator@6876 sub=ThreadPool] Thread enlisted
2019-12-19T17:22:23.430Z info vpxd[05605] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2019-12-19T17:22:23.459Z error vpxd[05321] [Originator@6876 sub=Main opID=CheckCertificateExpiry-6058ed8] Unable to get certificate count for APPLMGMT_PASSWORD from VECS localhost, error: 0
2019-12-19T17:22:23.548Z info vpxd[05332] [Originator@6876 sub=ThreadPool] Spawning additional worker - allocated: 144, idle: 19
2019-12-19T17:22:23.553Z info vpxd[05617] [Originator@6876 sub=ThreadPool] Thread enlisted
2019-12-19T17:22:23.553Z info vpxd[05617] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2019-12-19T17:22:23.572Z warning vpxd[05113] [Originator@6876 sub=LSClient] Caught exception while getting service with Id :e2136204-f25b-4a2b-a5ac-67b473cfd253. N7Vmacore9ExceptionE(Cannot initialize service registration stub)
--> [context]zKq7AVECAAAAAGC34QAOdnB4ZAAA4AArbGlidm1hY29yZS5zbwAAWCUbABWWGAH5kWV2cHhkAAHOlWUB9qFlASkvoAIqhQJsaWJhdXRoemNsaWVudC5zbwABvdeeAToJVAGKaFQBGcZSA5AFAmxpYmMuc28uNgABpb5S[/context]
2019-12-19T17:22:23.573Z warning vpxd[05113] [Originator@6876 sub=LSClient] Caught exception while retrieve endpoint. N7Vmacore9ExceptionE(Cannot initialize service registration stub)
--> [context]zKq7AVECAAAAAGC34QAPdnB4ZAAA4AArbGlidm1hY29yZS5zbwAAWCUbABWWGAH5kWV2cHhkAAE4l2UBKJllASuiZQEpL6ACKoUCbGliYXV0aHpjbGllbnQuc28AAb3XngE6CVQBimhUARnGUgOQBQJsaWJjLnNvLjYAAaW+Ug==[/context]
2019-12-19T17:22:23.574Z warning vpxd[05113] [Originator@6876 sub=LSClient] endpoint not found for Product: com.vmware.cis, Type: cs.inventory
2019-12-19T17:22:23.574Z warning vpxd[05113] [Originator@6876 sub=LSClient] Caught exception while getting service with Id :e2136204-f25b-4a2b-a5ac-67b473cfd253. N7Vmacore9ExceptionE(Cannot initialize service registration stub)
--> [context]zKq7AVECAAAAAGC34QAOdnB4ZAAA4AArbGlidm1hY29yZS5zbwAAWCUbABWWGAH5kWV2cHhkAAHOlWUB9qFlASkvoAI3hQJsaWJhdXRoemNsaWVudC5zbwABvdeeAToJVAGKaFQBGcZSA5AFAmxpYmMuc28uNgABpb5S[/context]
2019-12-19T17:22:23.575Z warning vpxd[05113] [Originator@6876 sub=LSClient] Caught exception while retrieve endpoint. N7Vmacore9ExceptionE(Cannot initialize service registration stub)
--> [context]zKq7AVECAAAAAGC34QAPdnB4ZAAA4AArbGlidm1hY29yZS5zbwAAWCUbABWWGAH5kWV2cHhkAAE4l2UBKJllASuiZQEpL6ACN4UCbGliYXV0aHpjbGllbnQuc28AAb3XngE6CVQBimhUARnGUgOQBQJsaWJjLnNvLjYAAaW+Ug==[/context]
2019-12-19T17:22:23.597Z warning vpxd[05113] [Originator@6876 sub=LSClient] endpoint not found for Product: com.vmware.cis, Type: cs.inventory
2019-12-19T17:22:23.718Z warning vpxd[05113] [Originator@6876 sub=VpxdAuthClient] [ConnectAndLogin] Failed to loginBySamlToken: N7Vmacore3Ssl18SSLVerifyExceptionE(SSL Exception: Verification parameters:
--> PeerThumbprint: 49:68:90:15:2C:75:C6:7C:C7:B4:55:EB:87:E2:E6:29:92:21:A8:72
--> ExpectedThumbprint:
--> ExpectedPeerName: localhost
--> The remote host certificate has these problems:
-->
--> * Host name does not match the subject name(s) in certificate.)
--> [context]zKq7AVECAAAAAGC34QANdnB4ZAAA4AArbGlidm1hY29yZS5zbwAAWCUbAP6dGACeQCIAaXEiABtFIgDTSSIAOaIjAHFvIwA6ciMAnVYrAdRzAGxpYnB0aHJlYWQuc28uMAAC3Y4ObGliYy5zby42AA==[/context]
2019-12-19T17:22:23.719Z info vpxd[05113] [Originator@6876 sub=VpxdAuthClient] fallback to loginByCertificate
2019-12-19T17:22:23.729Z error vpxd[05113] [Originator@6876 sub=ServerAccess] Remote login failed: N7Vmacore3Ssl18SSLVerifyExceptionE(SSL Exception: Verification parameters:
--> PeerThumbprint: 49:68:90:15:2C:75:C6:7C:C7:B4:55:EB:87:E2:E6:29:92:21:A8:72
--> ExpectedThumbprint:
--> ExpectedPeerName: localhost
--> The remote host certificate has these problems:
-->
--> * Host name does not match the subject name(s) in certificate.)

When resetting certificates using /usr/lib/vmware-vmca/bin/certificate-manager it works again


There is no ESXi host connected to vCenter just in case...

Hey all,

I just wanted to update a vCSA appliance. Unfortunately it hangs in the status "Checking for aivailable updates..." as has no internet access.

I changed the settings to CD-ROM  updates, mounted the update-repo iso and restarted the appliance, but no luck, it's still in the checking for updates mode.

Anyone has an idea how to stop this process? As the check and install update buttons are disabled during the update search.

Thanks

Tim

Hi

I have installed vCenter Server 6.0 for a customer today, which completed fine - however  I now have issues getting permissions i vCenter Web Client - even when using the SSO administrator login.

I can manage the environment from the legacy vSphere Client, however when logging into the Web Client i get the "You do not have permission to view this object or this object does not exist". and this even goes for the SSO administrator login. I cannot add global permissions or administer roles.

see screeenshots attached.

anyone had this issue before? and maybe a solution?

Hi!

I have a problem deleting some files of an already destroyed virtual machine. This is what I get when attempting to delete the folder:

########################

root@xxx yyy_zzz# rm -rf VM/

rm: cannot remove `VM//VM_2-flat.vmdk': Device or resource busy

rm: cannot remove `VM//VM-flat.vmdk': Device or resource busy

rm: cannot remove `VM//VM_1-flat.vmdk': Device or resource busy

rm: cannot remove `VM//VM-53afe79d.vswp': Device or resource busy

root@xxx yyy_zzz# cd VM/

root@xxx yyy_zzz# vmkfstools -U VM_1-flat.vmdk

Failed to delete virtual disk: Device or resource busy 1048585

#######################

The files are located on a LUN shared by seven ESX 3.02 Servers. What can I do to find out which process/system is locking those files? And how can I finally remove this folder?

Any help appreciated. Thanks!

Message was edited by: GreyhoundHH

Hello

Since we have updatet from ESXi 4.1 to Update 1 we have problems with taking quiesced snapshot. Before we have installed the update 1 quiesced snapshot worked witout problems.

When we take a quiesced snapshot, Windows 2008 R2 mount a new volumes and remove them after the snapshot is taken.

In the Eventlog i can see following errors and infos:

multiple entrys from this 2 event:

Log Name:      System
Source:        Virtual Disk Service
Date:          11.04.2011 22:40:26
Event ID:      3
Task Category: None
Level:         Information
Keywords:      Classic
User:          N/A

Description:
Service started.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="Virtual Disk Service" />

and

Log Name:      System
Source:        Service Control Manager
Date:          11.04.2011 22:40:26
Event ID:      7036
Task Category: None
Level:         Information
Keywords:      Classic
User:          N/A
Computer:      TESTTEMPLATE.gef.be.ch
Description:
The Virtual Disk service entered the running state.

and

Log Name:      System
Source:        Ntfs
Date:          11.04.2011 22:20:57
Event ID:      57
Task Category: (2)
Level:         Warning
Keywords:      Classic
User:          N/A
Description:
The system failed to flush data to the transaction log. Corruption may occur.

and

Log Name:      System
Source:        Ntfs
Date:          11.04.2011 22:20:57
Event ID:      137
Task Category: (2)
Level:         Error
Keywords:      Classic
User:          N/A
Description:
The default transaction resource manager on volume \\?\Volume{d533451f-6478-11e0-94e8-005056ae007a} encountered a non-retryable error and could not start.  The data contains the error code.

and

Log Name:      Application
Source:        VSS
Date:          11.04.2011 18:05:48
Event ID:      12289
Task Category: None
Level:         Error
Keywords:      Classic
User:          N/A
Computer:      G3110SRV014APL.gef.be.ch
Description:
Volume Shadow Copy Service error: Unexpected error DeviceIoControl(\\?\fdc#generic_floppy_drive#6&2bc13940&0&0#{53f5630d-b6bf-11d0-94f2-00a0c91efb8b} - 0000000000000418,0x00560000,0000000000000000,0,000000000027CDB0,4096,[0]).  hr = 0x80070001, Incorrect function.
.

Operation:
   Exposing Recovered Volumes
   Locating shadow-copy LUNs
   PostSnapshot Event
   Executing Asynchronous Operation

Context:
   Device: \\?\fdc#generic_floppy_drive#6&2bc13940&0&0#{53f5630d-b6bf-11d0-94f2-00a0c91efb8b}
   Examining Detected Volume: Existing - \\?\fdc#generic_floppy_drive#6&2bc13940&0&0#{53f5630d-b6bf-11d0-94f2-00a0c91efb8b}
   Execution Context: Provider
   Provider Name: VMware Snapshot Provider
   Provider Version: 1.0.0
   Provider ID: {564d7761-7265-2056-5353-2050726f7669}
   Current State: DoSnapshotSet
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
  <System>
    <Provider Name="VSS" />
    <EventID Qualifiers="0">12289</EventID>
    <Level>2</Level>
    <Task>0</Task>
    <Keywords>0x80000000000000</Keywords>
    <TimeCreated SystemTime="2011-04-11T16:05:48.000000000Z" />
    <EventRecordID>6430</EventRecordID>
    <Channel>Application</Channel>
    <Security />
  </System>
  <EventData>
    <Data>DeviceIoControl(\\?\fdc#generic_floppy_drive#6&amp;2bc13940&amp;0&amp;0#{53f5630d-b6bf-11d0-94f2-00a0c91efb8b} - 0000000000000418,0x00560000,0000000000000000,0,000000000027CDB0,4096,[0])</Data>

When we remove the snapshot the vm freeze for about 30second (no Ping no RDP)

Have anyone the same issue?

I have try to install a new clean server 2008 r2 but have the same problem.

Best Regards
Simon

I have an issue where I am getting constant notification of events as below:

Health of Memory changed from red to green.  Sensor name: Memory Device 1B 12: Uncorrectable ECC, Current state: Deassert (raw value).

I have switched memory, but socket number stayed the same, so have been in contact with server manufacturer, who have replaced the memory - same event, and replaced the motherboard with a faulty motherboard, so they put the original back in.

However looking at the IDRAC and logs etc, there are no errors showing on the hardware device.

I have tried to reset the sensor in the webclient, but this has not fixed the event.

Help please?

Thank you

hi

Can someone pls explain where can I download or post a link of “Cold Clone” bootable ISO converter?

I have a license to Virtual Center 5.1 and the other VI stuff.

I am trying to chage y identity source to ad over ldap using ldaps to my dc but I keep geting the error

Check the network settings and make sure you have netwok access to the idenity source

any idea?

Hi guy,

I have a system include vcsa 6.5u1 and Esxi 6.5

When i rescan storage esxi then is slow

i export log on esxi.

See log below

2017-08-28T22:29:02.661Z cpu17:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.00173800505230bc" occurred 2 times(of 2 commands)

2017-08-28T22:29:25.438Z cpu63:73520)ScsiDeviceIO: 2948: Cmd(0x43a141232980) 0x1a, CmdSN 0x908103 from world 0 to dev "naa.60030130f09000001a31cbf40d50bc3b" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2017-08-28T22:31:42.701Z cpu34:65651)ScsiDeviceIO: 2962: Cmd(0x439d4ad98880) 0x84, CmdSN 0x9081c5 from world 0 to dev "eui.0017380050521571" failed H:0x5 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.

2017-08-28T22:32:02.662Z cpu17:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:32:02.663Z cpu17:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.0017380050521571" occurred 1904 times(of 1904 commands)

2017-08-28T22:32:22.720Z cpu37:65654)ScsiDeviceIO: 2962: Cmd(0x439d4ad98880) 0x84, CmdSN 0x9081e8 from world 0 to dev "eui.00173800505230f9" failed H:0x5 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.

2017-08-28T22:32:32.663Z cpu17:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:32:32.663Z cpu17:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.00173800505230f9" occurred 1906 times(of 1906 commands)

2017-08-28T22:33:02.663Z cpu29:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:33:02.663Z cpu29:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.00173800505230bc" occurred 1894 times(of 1894 commands)

2017-08-28T22:33:02.723Z cpu45:65662)ScsiDeviceIO: 2962: Cmd(0x439d4ad98880) 0x84, CmdSN 0x9081f2 from world 0 to dev "eui.00173800505230bc" failed H:0x5 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.

2017-08-28T22:34:02.664Z cpu28:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:34:02.664Z cpu28:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.00173800505230bc" occurred 1 times(of 1 commands)

2017-08-28T22:35:09.536Z cpu31:775050)ScsiDeviceIO: 2948: Cmd(0x439949ea9680) 0x1a, CmdSN 0x908250 from world 0 to dev "naa.60030130f09000001a31cbf40d50bc3b" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.

2017-08-28T22:36:42.715Z cpu33:65650)ScsiDeviceIO: 2962: Cmd(0x439d47a3b500) 0x84, CmdSN 0x908308 from world 0 to dev "eui.0017380050521571" failed H:0x5 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.

2017-08-28T22:37:02.666Z cpu19:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:37:02.666Z cpu19:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.0017380050521571" occurred 1891 times(of 1891 commands)

2017-08-28T22:37:22.737Z cpu35:65652)ScsiDeviceIO: 2962: Cmd(0x439d47a3b500) 0x84, CmdSN 0x90832b from world 0 to dev "eui.00173800505230f9" failed H:0x5 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0.

2017-08-28T22:37:32.666Z cpu16:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

2017-08-28T22:37:32.666Z cpu16:66276)NMP: nmp_ResetDeviceLogThrottling:3342: Error status H:0x0 D:0x18 P:0x0 Sense Data: 0x0 0x0 0x0 from dev "eui.00173800505230f9" occurred 1899 times(of 1899 commands)

2017-08-28T22:38:02.666Z cpu17:66276)WARNING: ScsiCore: 1806: Invalid sense buffer: error=0x0, valid=0x0

pls help check log and support rescan normanly.

Thanks !

hi

when i try to login to vcenter from web client i received this error message :

Failed to connect to VMware Lookup Service - https://172.16.1.3.itp-moi.local:7444/lookupservice/sdk

how can i solve this problem ????

Hia

I'm trying to create a local account on the VCSA that is able to run 'service-control --status' in the bash shell. While trying to do this I've come accross a few things I cant really explain.

1. I can create users without any problem using "localaccounts.user.add --username x --role y -- password" but I cant edit or delete them without getting an error that the user is not recognized.

     - localaccounts.user.list only lists the root user. Didn't change after setting the bash shell as default for my custom user.

     - I can see all the users I created in my VCSA Web Interface, but I cant edit or delete useres here.

2. None of the given roles, even superAdmin, seems to have the permissions to run service-control. Do I need a root shell to run those commands?

I'm clearly missing something, overread something.. hoping you can point me in the right direction. I'm running a VCSA V6.7 U3 Build 14367737.

Regards

David

Hi,

I got problem that Web Client is not able to connect to vCenter. It is showing message:

HTTP Status 404 - /vsphere-client/

--------------------------------------------------------------------------------

type Status report

message /vsphere-client/

description The requested resource (/vsphere-client/) is not available.

--------------------------------------------------------------------------------

Apache Tomcat/7.0.26

I have tried to restart Web Clent Server but not helped.

Please help!

I have four hosts in my HA/DRS cluster. The cluster is showing a red exclamation but there are no errors in either of the hosts, VM's, datastores etc. THere is nothing to clear.

All hosts are vSphere 5 as is the vCenter Server.

Any ideas on this one guys?

I have a number of large files, e.g. C:\ProgramData\VMware\Infrastructure\Profile-Driven Storage\Logs\java_pid12345.hprof on my vCenter server.

Can they be safely be deleted?

I can only find the following article which doesn't relate to vCenter.

What is the pidXXXXXX.hprof file used for? (0000669) | VMware KB

I try to do the convergence from the web UI with 6.7.0.40000 Build 14367737

I have a couple of VCS/PSC on two sites and replication between each PSC

The process succed on first couple, the second failed on step below

        {

            "key": "firstbootpart1",

            "value": {

                "description": "Run vmafd firstboot",

                "status": "FAILED"

            }

        },

I think i'm exactly in that case : VMware Knowledge Base

so I disable TSO and GSO as explained on both PSC (source and replicat embedded previously converged)

But know, how can I restart the process ? should I restore backup ?

Another question, since the first converge succeed I haven't yet decommission it, I expect to do that after full convergence, but doesn't know the best practice.

converge.log

2019-10-10T12:28:28.18Z INFO converge Validating Provided Configuration ...

2019-10-10T12:28:28.23Z INFO converge Running the ldapsearch

2019-10-10T12:28:28.23Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=Sites,cn=Configuration,dc=vsphere,dc=local']

2019-10-10T12:28:28.238Z INFO converge Running command ldapsearch successful

2019-10-10T12:28:28.282Z INFO converge Following solutions have been found registered to the Platform Services Controller. You may have to re-register these after convergence. Please refer to the documentation for details.

2019-10-10T12:28:29.134Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/sts/STSService/ is up

2019-10-10T12:28:29.205Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/idm/ is up

2019-10-10T12:28:29.327Z INFO converge Verify AD domain input info.

2019-10-10T12:28:29.327Z INFO converge Skipping AD Domain related checks.

2019-10-10T12:28:29.331Z INFO converge Validation completed successfully.

2019-10-10T12:28:31.384Z INFO converge Validating Provided Configuration ...

2019-10-10T12:28:31.391Z INFO converge Running the ldapsearch

2019-10-10T12:28:31.392Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=Sites,cn=Configuration,dc=vsphere,dc=local']

2019-10-10T12:28:31.639Z INFO converge Running command ldapsearch successful

2019-10-10T12:28:31.684Z INFO converge Following solutions have been found registered to the Platform Services Controller. You may have to re-register these after convergence. Please refer to the documentation for details.

2019-10-10T12:28:32.364Z INFO converge Collected start_time:1570710512.3636036 as a part of Telemetry

2019-10-10T12:28:32.366Z INFO converge Collected build_no:14367737 as a part of Telemetry

2019-10-10T12:28:32.366Z INFO converge Collected version:6.7.0.40000 as a part of Telemetry

2019-10-10T12:28:32.367Z INFO converge Collected client:cli as a part of Telemetry

2019-10-10T12:28:32.367Z INFO converge Collected replication_flag:False as a part of Telemetry

2019-10-10T12:28:32.383Z DEBUG converge Starting new HTTPS connection (1): localhost

2019-10-10T12:28:33.75Z DEBUG converge https://localhost:443 "POST /rest/com/vmware/cis/session HTTP/1.1" 200 None

2019-10-10T12:28:33.88Z DEBUG converge Starting new HTTPS connection (1): localhost

2019-10-10T12:28:34.92Z DEBUG converge https://localhost:443 "GET /rest/vcenter/topology/nodes HTTP/1.1" 200 None

2019-10-10T12:28:34.95Z INFO converge Collected noOfVCs:2 as a part of Telemetry

2019-10-10T12:28:34.96Z INFO converge Collected noOfPSCs:2 as a part of Telemetry

2019-10-10T12:28:34.96Z INFO converge Collected topology info as a part of Telemetry

2019-10-10T12:28:34.185Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/sts/STSService/ is up

2019-10-10T12:28:34.224Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/idm/ is up

2019-10-10T12:28:34.326Z INFO converge Verify AD domain input info.

2019-10-10T12:28:34.326Z INFO converge Skipping AD Domain related checks.

2019-10-10T12:28:34.330Z INFO converge Validation completed successfully.

2019-10-10T12:28:34.330Z INFO converge Setting the converge running flag

2019-10-10T12:28:34.347Z INFO converge Running converge on Management node.

2019-10-10T12:28:34.348Z INFO converge Executing reconfiguring steps. This will take few minutes to complete.

Please wait ...

2019-10-10T12:28:34.348Z INFO converge Downloading RPMs

2019-10-10T12:28:34.349Z INFO converge Collected client:rest as a part of Telemetry

2019-10-10T12:28:34.418Z INFO converge Custom URL repositry not configured.Use default VMware repository URL.

2019-10-10T12:28:34.421Z INFO converge  currentURL = https://vapp-updates.vmware.com/vai-catalog/valm/vmw/8d167796-34d5-4899-be0a-6daade4005a3/6.5.0.14000.latest/

2019-10-10T12:28:34.421Z INFO converge Manifest file = https://vapp-updates.vmware.com/vai-catalog/valm/vmw/8d167796-34d5-4899-be0a-6daade4005a3/6.5.0.14000.latest/manifest/manifest-latest.xml

2019-10-10T12:28:34.422Z INFO converge Running command: ['/usr/bin/wget', '--no-check-certificate']

2019-10-10T12:28:34.545Z INFO converge Downloaded file manifest-latest.xml

2019-10-10T12:28:34.546Z INFO converge Running command: ['/usr/bin/wget', '--no-check-certificate']

2019-10-10T12:28:35.73Z INFO converge Exception in downloading file : manifest-latest.xml.sha256

2019-10-10T12:28:35.91Z INFO converge Unsetting the converge running flag

2019-10-10T12:28:38.199Z INFO converge Cleanup successful with partial flag = True.

2019-10-10T12:28:38.201Z INFO converge Collected end_time:1570710518.2011995 as a part of Telemetry

2019-10-10T12:28:38.201Z INFO converge Collected status:False as a part of Telemetry

2019-10-10T12:28:38.202Z INFO converge Collected @type:convergence_telemetry as a part of Telemetry

2019-10-10T12:28:38.213Z DEBUG converge Starting new HTTP connection (1): localhost

2019-10-10T12:28:38.227Z DEBUG converge http://localhost:15080 "POST /analytics/telemetry/ph/api/hyper/send?_c=vcebc.1_0 HTTP/1.1" 201 0

2019-10-10T12:28:38.232Z DEBUG converge Pushed the Collected Data to VMWare Analytics Service as a part of  Telemetry

2019-10-10T14:16:53.773Z INFO converge Validating Provided Configuration ...

2019-10-10T14:16:53.778Z INFO converge Running the ldapsearch

2019-10-10T14:16:53.778Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=Sites,cn=Configuration,dc=vsphere,dc=local']

2019-10-10T14:16:53.990Z INFO converge Running command ldapsearch successful

2019-10-10T14:16:54.37Z INFO converge Following solutions have been found registered to the Platform Services Controller. You may have to re-register these after convergence. Please refer to the documentation for details.

2019-10-10T14:16:58.512Z WARNING converge Unable to query solution regiestered

2019-10-10T14:16:58.638Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/sts/STSService/ is up

2019-10-10T14:16:58.675Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/idm/ is up

2019-10-10T14:16:58.767Z ERROR converge Failed to validate sso credential. Error SoapException:

faultcode: ns0:FailedAuthentication

faultstring: Invalid credentials

faultxml: <?xml version='1.0' encoding='UTF-8'?><S:Envelope xmlns:S="http://schemas.xmlsoap.org/soap/envelope/"><S:Body><S:Fault xmlns:ns4="http://www.w3.org/2003/05/soap-envelope"><faultcode xmlns:ns0="http://docs.oasis-open.org/ws-sx/ws-trust/200512">ns0:FailedAuthentication</faultcode><faultstring>Invalid credentials</faultstring></S:Fault></S:Body></S:Envelope>

2019-10-10T14:16:58.767Z ERROR converge SSO validation failed..

2019-10-10T14:16:58.773Z ERROR converge Pre-checks failed for converge.

2019-10-10T14:16:58.782Z INFO converge Unsetting the converge running flag

2019-10-10T14:17:02.816Z INFO converge Cleanup successful with partial flag = True.

2019-10-10T14:17:35.329Z INFO converge Validating Provided Configuration ...

2019-10-10T14:17:35.334Z INFO converge Running the ldapsearch

2019-10-10T14:17:35.334Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=Sites,cn=Configuration,dc=vsphere,dc=local']

2019-10-10T14:17:35.596Z INFO converge Running command ldapsearch successful

2019-10-10T14:17:35.689Z INFO converge Following solutions have been found registered to the Platform Services Controller. You may have to re-register these after convergence. Please refer to the documentation for details.

2019-10-10T14:17:36.639Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/sts/STSService/ is up

2019-10-10T14:17:36.675Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/idm/ is up

2019-10-10T14:17:36.763Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=LNIVMWVCT01.my.domain.lan,ou=Domain Controllers,dc=vsphere,dc=local']

2019-10-10T14:17:36.782Z INFO converge Replication partner provided is correct.

2019-10-10T14:17:36.783Z INFO converge Verify AD domain input info.

2019-10-10T14:17:36.784Z INFO converge Skipping AD Domain related checks.

2019-10-10T14:17:36.787Z INFO converge Validation completed successfully.

2019-10-10T14:17:38.940Z INFO converge Validating Provided Configuration ...

2019-10-10T14:17:38.949Z INFO converge Running the ldapsearch

2019-10-10T14:17:38.949Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=Sites,cn=Configuration,dc=vsphere,dc=local']

2019-10-10T14:17:39.195Z INFO converge Running command ldapsearch successful

2019-10-10T14:17:39.297Z INFO converge Following solutions have been found registered to the Platform Services Controller. You may have to re-register these after convergence. Please refer to the documentation for details.

2019-10-10T14:17:40.169Z INFO converge Collected start_time:1570717060.1686823 as a part of Telemetry

2019-10-10T14:17:40.171Z INFO converge Collected build_no:14367737 as a part of Telemetry

2019-10-10T14:17:40.172Z INFO converge Collected version:6.7.0.40000 as a part of Telemetry

2019-10-10T14:17:40.172Z INFO converge Collected client:cli as a part of Telemetry

2019-10-10T14:17:40.173Z INFO converge Collected replication_flag:False as a part of Telemetry

2019-10-10T14:17:40.188Z DEBUG converge Starting new HTTPS connection (1): localhost

2019-10-10T14:17:41.12Z DEBUG converge https://localhost:443 "POST /rest/com/vmware/cis/session HTTP/1.1" 200 None

2019-10-10T14:17:41.26Z DEBUG converge Starting new HTTPS connection (1): localhost

2019-10-10T14:17:42.864Z DEBUG converge https://localhost:443 "GET /rest/vcenter/topology/nodes HTTP/1.1" 200 None

2019-10-10T14:17:42.867Z INFO converge Collected noOfVCs:1 as a part of Telemetry

2019-10-10T14:17:42.868Z INFO converge Collected noOfPSCs:2 as a part of Telemetry

2019-10-10T14:17:42.868Z INFO converge Collected topology info as a part of Telemetry

2019-10-10T14:17:42.954Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/sts/STSService/ is up

2019-10-10T14:17:42.991Z INFO converge Infra node url https://llivmwpsc01.my.domain.lan:443/idm/ is up

2019-10-10T14:17:43.70Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=LNIVMWVCT01.my.domain.lan,ou=Domain Controllers,dc=vsphere,dc=local']

2019-10-10T14:17:43.92Z INFO converge Replication partner provided is correct.

2019-10-10T14:17:43.93Z INFO converge Verify AD domain input info.

2019-10-10T14:17:43.94Z INFO converge Skipping AD Domain related checks.

2019-10-10T14:17:43.99Z INFO converge Validation completed successfully.

2019-10-10T14:17:43.100Z INFO converge Setting the converge running flag

2019-10-10T14:17:43.119Z INFO converge Running converge on Management node.

2019-10-10T14:17:43.120Z INFO converge Executing reconfiguring steps. This will take few minutes to complete.

Please wait ...

2019-10-10T14:17:43.120Z INFO converge Downloading RPMs

2019-10-10T14:17:43.121Z INFO converge Collected client:rest as a part of Telemetry

2019-10-10T14:17:43.169Z INFO converge VCSA ISO is mounted. Copying RPMs from the ISO.

2019-10-10T14:17:43.180Z INFO converge ISO version : VMware-vCenter-Server-Appliance-6.7.0.40000-14367737

2019-10-10T14:17:43.180Z INFO converge VC version : VMware-vCenter-Server-Appliance-6.7.0.40000-14367737

2019-10-10T14:17:48.89Z INFO converge Collected site_guid:af685cec-89f9-4dca-872c-1b40c56be288 as a part of Telemetry

2019-10-10T14:17:48.90Z DEBUG converge e5dd6353-547d-4ecc-b908-1cc1a2156dab

2019-10-10T14:17:48.126Z DEBUG converge e4729eae-0fc8-451a-889f-20d1b60d49d7

2019-10-10T14:17:48.465Z INFO converge Store all vecs certificates.

2019-10-10T14:17:49.311Z INFO converge final json ---->

2019-10-10T14:17:49.312Z INFO converge [{'entries': [{'Entry type': 'Private Key', 'Alias': '__MACHINE_CERT', 'cert_path': '/root/velma/old_certs/__MACHINE_CERT-MACHINE_SSL_CERT.crt', 'key_path': '/root/velma/old_certs/__MACHINE_CERT-MACHINE_SSL_CERT.key'}], 'store_name': 'MACHINE_SSL_CERT', 'Number of entries in store': '1'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'machine', 'cert_path': '/root/velma/old_certs/machine-machine.crt', 'key_path': '/root/velma/old_certs/machine-machine.key'}], 'store_name': 'machine', 'Number of entries in store': '1'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'vsphere-webclient', 'cert_path': '/root/velma/old_certs/vsphere-webclient-vsphere-webclient.crt', 'key_path': '/root/velma/old_certs/vsphere-webclient-vsphere-webclient.key'}], 'store_name': 'vsphere-webclient', 'Number of entries in store': '1'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'vpxd', 'cert_path': '/root/velma/old_certs/vpxd-vpxd.crt', 'key_path': '/root/velma/old_certs/vpxd-vpxd.key'}], 'store_name': 'vpxd', 'Number of entries in store': '1'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'vpxd-extension', 'cert_path': '/root/velma/old_certs/vpxd-extension-vpxd-extension.crt', 'key_path': '/root/velma/old_certs/vpxd-extension-vpxd-extension.key'}], 'store_name': 'vpxd-extension', 'Number of entries in store': '1'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'sms_self_signed', 'cert_path': '/root/velma/old_certs/sms_self_signed-SMS.crt', 'key_path': '/root/velma/old_certs/sms_self_signed-SMS.key'}], 'store_name': 'SMS', 'Number of entries in store': '1'}, {'entries': [], 'store_name': 'APPLMGMT_PASSWORD', 'Number of entries in store': '0'}, {'entries': [{'Entry type': 'Private Key', 'Alias': 'data-encipherment', 'cert_path': '/root/velma/old_certs/data-encipherment-data-encipherment.crt', 'key_path': '/root/velma/old_certs/data-encipherment-data-encipherment.key'}], 'store_name': 'data-encipherment', 'Number of entries in store': '1'}]

2019-10-10T14:17:49.505Z INFO converge Removing computer account of vCenter on Management node.

2019-10-10T14:17:49.506Z INFO converge Running command: ['/usr/lib/vmware-vmafd/bin/domainjoin', 'leave', '--username', 'administrator', '--password', '******']

2019-10-10T14:17:49.745Z INFO converge Removed vCenter computer account from management node.

2019-10-10T14:17:49.757Z INFO converge Running Firstboots for : vmafd-firstboot

2019-10-10T14:17:59.437Z INFO converge Stopping the services ...

2019-10-10T14:17:59.445Z INFO converge <class 'list'>

2019-10-10T14:17:59.446Z INFO converge ['vmware-certificatemanagement', 'vmware-pod', 'vmware-topologysvc', 'vmware-updatemgr', 'vmware-vcha', 'vmcam', 'vmware-postgres-archiver', 'vsan-dps', 'vmware-perfcharts', 'vmware-vsan-health', 'vsphere-ui', 'vmware-eam', 'vmware-imagebuilder', 'vmware-mbcs', 'vmware-netdumper', 'vmware-rbd-watchdog', 'vmware-vsm', 'vsphere-client', 'vmware-content-library', 'vmware-sps', 'vmware-vpxd', 'vmware-vpxd-svcs', 'vmware-vpostgres']

2019-10-10T14:17:59.446Z INFO converge Stopping services

2019-10-10T14:20:25.24Z INFO converge Stopped all the services.

2019-10-10T14:20:25.54Z INFO converge Removed Old Afd db.

2019-10-10T14:20:25.68Z INFO converge Cleared old ssl certificates.

2019-10-10T14:20:25.252Z INFO converge

2019-10-10T14:20:25.253Z INFO converge Installing PSC Rpms.

2019-10-10T14:20:25.253Z INFO converge Installing rpm: /root/velma/rpm/vmware-directory-6.7.0.4837-14192624.x86_64.rpm

2019-10-10T14:20:26.240Z INFO converge Installing rpm: /root/velma/rpm/vmware-certificate-server-6.7.0.5602-14192633.x86_64.rpm

2019-10-10T14:20:27.128Z INFO converge Installing rpm: /root/velma/rpm/vmware-psc-health-6.7.0.1949-14192626.x86_64.rpm

2019-10-10T14:20:27.494Z INFO converge Installing rpm: /root/velma/rpm/VMware-cis-license-6.7.0-13714356.x86_64.rpm

2019-10-10T14:20:28.220Z INFO converge Installing rpm: /root/velma/rpm/vmware-identity-sts-6.7.0.6011-14192627.noarch.rpm

2019-10-10T14:20:35.690Z INFO converge Installing rpm: /root/velma/rpm/vmware-dns-server-1.0.0-14192631.x86_64.rpm

2019-10-10T14:20:36.509Z INFO converge PSC Rpms Installed Success.

2019-10-10T14:20:36.510Z INFO converge Running the ldapsearch

2019-10-10T14:20:36.511Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'llivmwpsc01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=ConsentConfigContainer,cn=PhoneHome,cn=Services,dc=vsphere,dc=local']

2019-10-10T14:20:36.532Z INFO converge Running command successful

2019-10-10T14:20:36.533Z INFO converge CEIP is disabled.

2019-10-10T14:20:36.533Z INFO converge Setting Install Parameters

2019-10-10T14:20:36.543Z INFO converge Install Parameters Set.

2019-10-10T14:20:37.664Z INFO converge Perform update startuptype operation in start order. startup_type=Automatic, svc_names=['vmdird', 'vmcad', 'vmdnsd', 'vmware-sts-idmd', 'vmware-certificatemanagement'], include_vmonsvcs=False include_coreossvcs=False, include_leafossvcs=False

2019-10-10T14:20:37.979Z INFO converge Successfully changed startuptype for service vmdird

2019-10-10T14:20:38.441Z INFO converge Successfully changed startuptype for service vmcad

2019-10-10T14:20:39.9Z INFO converge Successfully changed startuptype for service vmware-sts-idmd

2019-10-10T14:20:39.582Z INFO converge Successfully changed startuptype for service vmdnsd

2019-10-10T14:20:39.601Z INFO converge Successfully changed startuptype for service certificatemanagement

2019-10-10T14:20:39.605Z INFO converge Collected replication_flag:True as a part of Telemetry

2019-10-10T14:20:39.606Z INFO converge Running command: ['/opt/likewise/bin/ldapsearch', '-h', 'LNIVMWVCT01.my.domain.lan', '-w', '******', '-x', '-D', 'cn=administrator,cn=users,dc=vsphere,dc=local', '-b', 'cn=slivctapp.my.domain.lan,ou=Computers,dc=vsphere,dc=local']

2019-10-10T14:20:39.677Z WARNING converge Unable to run ldapsearch

2019-10-10T14:20:39.678Z INFO converge Collected replication_latency:0.0727686882019043 as a part of Telemetry

2019-10-10T14:20:39.678Z INFO converge Leave fed is complete

2019-10-10T14:20:39.679Z INFO converge Leave fed complete status: True

2019-10-10T14:20:39.679Z INFO converge Running Firstboots for : visl-support-firstboot,vmafd-firstboot

2019-10-10T14:26:37.832Z ERROR converge Failed to run white listed firstboot scripts. Error: {

    "problemId": null,

    "detail": [

        {

            "id": "install.ciscommon.command.errinvoke",

            "args": [

                "Command: ['run-firstboot-scripts', '--action', 'firstboot', '--subaction', 'firstboot', '--fbWhiteList', 'visl-support-firstboot,vmafd-firstboot']\nStderr: "

            ],

            "translatable": "An error occurred while invoking external command : '%(0)s'",

            "localized": "An error occurred while invoking external command : 'Command: ['run-firstboot-scripts', '--action', 'firstboot', '--subaction', 'firstboot', '--fbWhiteList', 'visl-support-firstboot,vmafd-firstboot']\nStderr: '"

        }

    ],

    "componentKey": null,

    "resolution": null

}

2019-10-10T14:26:37.849Z INFO converge Unsetting the converge running flag

2019-10-10T14:26:42.103Z INFO converge Cleanup successful with partial flag = True.

2019-10-10T14:26:42.104Z INFO converge Collected end_time:1570717602.1046734 as a part of Telemetry

2019-10-10T14:26:42.105Z INFO converge Collected status:False as a part of Telemetry

2019-10-10T14:26:42.105Z INFO converge Collected @type:convergence_telemetry as a part of Telemetry

2019-10-10T14:26:42.118Z DEBUG converge Starting new HTTP connection (1): localhost

2019-10-10T14:26:42.130Z DEBUG converge http://localhost:15080 "POST /analytics/telemetry/ph/api/hyper/send?_c=vcebc.1_0 HTTP/1.1" 201 0

2019-10-10T14:26:42.133Z DEBUG converge Pushed the Collected Data to VMWare Analytics Service as a part of  Telemetry

Thanks for your help