====== PowerVC troubleshoot (Virtual Center for Power Servers) ======

==== PowerVC version 2 ====

=== Unable to deploy LPARs ===

Thank you for your time today, it was very useful session.

After some troubleshooting, we noticed that the **pvc socket** files under **/etc/systemd/system** did not have node IP in the [Socket] section:
  ListenStream=9200


Once we added the node IP for all pvc sockets, reloaded the deamon and restarted all sockets manually, the services stabilized and were no longer restarting by themselves:
  ListenStream=10.10.10.20:9200


We were then able to deploy a test VM.


Please monitor the environment and let us know if you observe an unusual behavior or restart of a service. You can check by running

<cli prompt='#'>
# for i in `cibadmin --query |   xmllint --xpath '/cib/configuration/resources/*/@id' - |   tr ' ' '\n' |   cut -f2 -d'"' |   grep -v '^$' |   sed -e 's/-clone$//' |   grep -v -E "virtualip|galera"`
do 
echo "$i `systemctl status $i | grep Active`"
done | column -t
</cli>

You can also monitor output of:
<cli prompt='#'>
# powervc-services status
</cli>

Check for any NoHeartbeat status






===== Prerequisites for 1.4.3.0 =====

<cli>
rpm -Uhv python-fpconst-0.7.3-12.el7.noarch.rpm
rpm -Uhv SOAPpy-0.11.6-17.el7.noarch.rpm
rpm -Uhv python-zope-interface-4.0.5-4.el7.x86_64.rpm
rpm -Uhv pyserial-2.6-6.el7.noarch.rpm
rpm -Uhv python-twisted-core-12.2.0-4.el7.x86_64.rpm
rpm -Uhv python-webob-1.2.3-7.el7.noarch.rpm
rpm -Uhv python-twisted-web-12.1.0-5.el7_2.x86_64.rpm
rpm -Uhv python-webtest-1.3.4-6.el7.noarch.rpm
</cli>

===== Install pb with version 1.4.3.0 =====

https://www.ibm.com/support/pages/powervc-14x-143-install-fails-steps-5-7-mariadb-error

PowerVC 1.4.x to 1.4.3 install fails on steps 5-7 with MariaDB error
Troubleshooting

Problem
PowerVC upgrade fails with below error :
<code>
Traceback (most recent call last):
  File "/mnt/PowerVC/1.4.3/powervc-1.4.3.0/lib/config.sh", line 73, in main
    mgr.configure_data()
  File "/usr/lib/python2.7/site-packages/powervc_oslo/config/data_mgr.py", line 848, in configure_data
    _multi_manager_execute(mgrs, 'create_database')
  File "/usr/lib/python2.7/site-packages/powervc_oslo/config/data_mgr.py", line 1244, in _multi_manager_execute
    rc = getattr(mgr, method)(*parms)
  File "/usr/lib/python2.7/site-packages/powervc_oslo/config/db_data_mgr.py", line 53, in create_database
    self.__initialize_mariadb()
  File "/usr/lib/python2.7/site-packages/powervc_oslo/config/db_data_mgr.py", line 154, in __initialize_mariadb
    self.__change_mariadb_password(config['db_password'])
  File "/usr/lib/python2.7/site-packages/powervc_oslo/config/db_data_mgr.py", line 188, in __change_mariadb_password
    p.expect(['New password:'], timeout=10)
  File "/usr/lib/python2.7/site-packages/pexpect.py", line 1311, in expect
    return self.expect_list(compiled_pattern_list, timeout, searchwindowsize)
  File "/usr/lib/python2.7/site-packages/pexpect.py", line 1325, in expect_list
    return self.expect_loop(searcher_re(pattern_list), timeout, searchwindowsize)
  File "/usr/lib/python2.7/site-packages/pexpect.py", line 1396, in expect_loop
    raise EOF (str(e) + '\n' + str(self))
EOF: End Of File (EOF) in read_nonblocking(). Exception style platform.
<pexpect.spawn object at 0x7f339ec07d10>
version: 2.3 ($Revision: 399 $)
command: /usr/bin/mysqladmin
args: ['/usr/bin/mysqladmin', 'password']
searcher: searcher_re:
    0: re.compile("New password:")
buffer (last 100 chars):
before (last 100 chars): .sock' (2)'
Check that mysqld is running and that the socket: '/var/lib/mysql/mysql.sock' exists!
</code>

Resolving The Problem

Please proceed with the steps below:

Please run

ln -s /usr/bin/resolveip /usr/libexec/resolveip

 Then attempt this command

 /root/powervc-1.4.3.0/lib/config.sh --interface yourinterface --ipversion 4 --ipoption default --firewall yes --silent 0 --hostaddress yourfqdn  --operation configure --logfile /opt/ibm/powervc/log/yourlastinstalllogfilename

 

where yourinterface is the name of the Network adapter used to configure your PowerVC server.

where yourlastinstalllogfilename is the name of the powervc install log from the current failed install

where yourfqdn is the fully qualified domain name of your PowerVC server

Once it completes with successful then run the below command.

powervc-restore