{"id":665,"date":"2021-04-06T13:32:52","date_gmt":"2021-04-06T12:32:52","guid":{"rendered":"https:\/\/www.simweb.ch\/blog\/?p=665"},"modified":"2021-04-06T13:34:04","modified_gmt":"2021-04-06T12:34:04","slug":"ovirt-rhv-cluster-upgrade-fails-with-unclear-reasons","status":"publish","type":"post","link":"https:\/\/www.simweb.ch\/blog\/2021\/04\/ovirt-rhv-cluster-upgrade-fails-with-unclear-reasons\/","title":{"rendered":"oVirt \/ RHV: Cluster Upgrade fails with unclear reasons"},"content":{"rendered":"

Symptoms<\/h2>\n

I've encountered this error after upgrading a RHV 4.3 environment to 4.4 and since this release already permits updating both the cluster and the data center to 4.5 (I'd have expected 4.4) I tried and failed a couple of times because upgrading the cluster level to 4.4 always failed because of a couple of VMs.<\/p>\n

Looking at the messages about each VM in the UI didn't really help much either:<\/p>\n

Cannot update compatibility version of Vm\/Template: [<name-of-the-vm], Message: [No Message]<\/code><\/pre>\n
Identifying the reason<\/h2>\n
Search for this error message didn't reveal much useful at all. So i turned to engine.log<\/code> on the RHV manager which has a tendency of being very verbose, thus not really helpful.<\/p>\n
So I let run tail -f \/var\/log\/ovirt-engine\/engine.log | tee \/tmp\/engine-extract.log<\/code> and attempted another upgrade.<\/p>\n
Searching for the name of the listed VMs.only gave me:<\/p>\n
2021-04-xx xx:xx:xx,xxxZ ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-2) [3e664583] EVENT_ID: CLUSTER_CANNOT_UPDATE_VM_COMPATIBILITY_VERSION(12,005), Cannot update compatibility version of Vm\/Template: [beaufix], Message: [No Message]<\/code><\/pre>\n
Allas No Message<\/code> isn't really that much more helpful either.<\/p>\n
However bat at least limiting the amount of logs to dig through I finally stumbled upon the following kind of messages:<\/p>\n
2021-04-xx xx:xx:xx,xxxZ WARN  [org.ovirt.engine.core.bll.UpdateVmCommand] (default task-2) [60ce7f39] Validation of action 'UpdateVm' failed for user <user>@<realm>-authz. Reasons: VAR__ACTION__UPDATE,VAR__TYPE__VM,ERROR_CANNOT_FIND_ISO_IMAGE_PATH<\/code><\/pre>\n
The amount of occurences of these messages matched with the number of VMs that were listed in the initial error message.<\/p>\n
At that point it was clear that the affected VMs had some lingering ISO mounts configuredfor ISO images not present anymore on the ISO storage domain.<\/p>\n
Checking if a ISO was still mounted revealed nothing though.<\/p>\n
Fixing<\/h2>\n
In the end I had to edit each VM settings and detach the virtual CD\/DVD drive (which is possible while the VM is online), simply ejecting wasn't enough.<\/p>\n
Afterwards bumping the cluster, then the datacenter level to 4.5  worked fine.<\/p>\n
However I whished the log messages had been "a tad" more helpful in the first place.<\/p>\n
TL;DR:<\/strong> If you get a not very helpful message in the oVirt or RHV UI, don't hesitate to dig through the engine Logs of the manager.<\/p>\n
Unfortunately they are both rather verbose and not that easy to dig through.at the same time.<\/p>\n","protected":false},"excerpt":{"rendered":"
Symptoms I’ve encountered this error after upgrading a RHV 4.3 environment to 4.4 and since this release already permits updating both the cluster and the data center to 4.5 (I’d have expected 4.4) I tried and failed a couple of times because upgrading the cluster level to 4.4 always failed because of a couple of … more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_crdt_document":"","footnotes":""},"categories":[1],"tags":[73,71,72],"class_list":["post-665","post","type-post","status-publish","format-standard","hentry","category-uncategorized","tag-kvm","tag-ovirt","tag-rhv"],"_links":{"self":[{"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/posts\/665","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/comments?post=665"}],"version-history":[{"count":0,"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/posts\/665\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/media?parent=665"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/categories?post=665"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.simweb.ch\/blog\/wp-json\/wp\/v2\/tags?post=665"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}