You have set Only registered users can checkout in VirtueMart Configuration therefore Hide Registration and Login Area can not be enabled. You need to allow guest checkout in VirtueMart Configuration.