manageiq-providers-scvmm still supported ?

[szajac01]

Hi community,
i'm searching for provider Microsoft SCVMM in my ManageIQ UI (Petrosian appliance version), and it's not available on the appliance.
Does the provider still supported and if yes, how to install the plugin ?
https://www.manageiq.org/docs/reference/petrosian/capabilities_matrix/index.html#infrastructure-providers url would say yes, but latest page seems to have removed it...
Can you give information on the subject please ?

[Fryguy]

Does the provider still supported

hi @szajac01 - unfortunately, no, we had to drop support for the scvmm provider, because some of the dependencies prevented us from getting to CentOS 9 as they wouldn't compile anymore. At the time, SCVMM support from Microsoft was questionable anyway, and we had little indication that anyone was using it. However, more recently it seems SCVMM is back on Microsoft's radar, so we've been considering resurrecting it without the features that were preventing the upgrade.

cc @agrare

[szajac01]

Hi @agrare , i've seen Spassky have been released yesterday, i imagine we would use this version to setup MIQ dev setup ? What is your advice ? we will start setup and first add the provider in order to troubleshoot if there is an issue related to the OS during the setup, and then integrate an Hyper-V.

[agrare]

Hey @szajac01 honestly it would be easier to just use "master" for your development setup since any PRs that get created are going to be against master anyway.

[szajac01]

Hey @szajac01 the best thing to do when you have an SCVMM system is to set up a MIQ development system where we can add the manageiq-providers-scvmm provider plugin back to the Gemfile and then we can test from there.

Hi @agrare, we have setup a dev environment, can you help us going ahead ?

[agrare]

@szajac01 awesome, so what I would do is:

1. Clone the manageiq-providers-scvmm plugin locally: git clone https://github.com/ManageIQ/manageiq-providers-scvmm
2. Add ensure_gem "manageiq-providers-scvmm", :path => "/path/to/your/manageiq-providers-scvmm" to the bundler.d/overrides.rb file in your core repo and run bundle update
3. Restart evmserverd or rails s/rake evm:ssimulte_queue_worker` so the rails env picks up the new plugin
4. Add your SCVMM provider in the Infrastructure providers section
5. See if the credential verification succeeds, if it does see if the Refresh succeeds.

If everything still works, great. If some things aren't working lets take them one at a time. Eventually we'll re-record the VCRs for specs to capture the current API responses.

[szajac01]

Hi @agrare , we are setting up a scvmm right now, i will let you know when we're able to integrate with our dev ManageIQ env.

[ebilbil]

Hi @agrare,
I'm szajac's colleague, I setup a ManageIQ dev environment and added the SCVMM provider as requested.
Authentication and discovery seem to be OK.
Now I'm trying to create a catalog item for the SCVMM provider.

I added the miq_provision_microsoft_dialogs_template for the VM provision dialog, but it seems that something is still missing.

Any idea?

[agrare]

Hey @ebilbil adding the provider, credential verification, and Inventory refresh was all I was expecting to test in this first round so if that all worked then that is really encouraging news. It means their PS API didn't change dramatically in the newer versions since we last tested this.

The catalog item failing is likely due to missing provisioning dialogs, and automate classes. This has the full list of changes that were done to drop scvmm #22279

[ebilbil]

thank you for your answer @agrare. I will take a look next week.

[schrammdocarmo]

Hello!

I've tried to re-implement the dropped support for SCVMM into the current master branch.
I've followed the History of merged pull requests, added overrides for the following repositories:

• manageiq
• manageiq-providers-scvmm
• manageiq-automation_engine
• manageiq-content
• manageiq-gems-pending
• manageiq-schema
• manageiq-ui-classic

I was not 100% sure about manageiq-smartstate.

However, I can install and start the server, yet I have the same issue with some of the forms, exactly as described by @ebilbil , it happens e.g. when creating a new service catalog item.

I could trace the error back to the function workflow_instance_from_vars in manageiq-ui-classic/app/controllers/application_controller/miq_request_methids,rb.
wf_type does correctly contain "ManageIQ::Providers::Microsoft::InfraManager::ProvisionWorkflow", however the request info cannot be created and the template not rendered.

I was able to have a stack trace (I noticed the "method missing" towards the end if it):
Cannot create Request Info, error: /workspace/manageiq-ui-classic/app/controllers/application_controller/miq_request_methods.rb:1076:in backtrace' /workspace/manageiq-ui-classic/app/controllers/application_controller/miq_request_methods.rb:1076:in rescue in workflow_instance_from_vars' /workspace/manageiq-ui-classic/app/controllers/application_controller/miq_request_methods.rb:1012:in workflow_instance_from_vars' /workspace/manageiq-ui-classic/app/controllers/application_controller/miq_request_methods.rb:929:in prov_set_form_vars' /workspace/manageiq-ui-classic/app/controllers/catalog_controller.rb:250:in atomic_form_field_changed' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/basic_implicit_render.rb:8:in send_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/rendering.rb:193:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in block in process_action' /usr/local/share/gems/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:110:in run_callbacks' /usr/local/share/gems/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/rescue.rb:27:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/instrumentation.rb:77:in block in process_action' /usr/local/share/gems/gems/activesupport-7.2.3/lib/active_support/notifications.rb:210:in block in instrument' /usr/local/share/gems/gems/activesupport-7.2.3/lib/active_support/notifications/instrumenter.rb:58:in instrument' /usr/local/share/gems/gems/activesupport-7.2.3/lib/active_support/notifications.rb:210:in instrument' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/instrumentation.rb:76:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal/params_wrapper.rb:259:in process_action' /usr/local/share/gems/gems/activerecord-7.2.3/lib/active_record/railties/controller_runtime.rb:39:in process_action' /usr/local/share/gems/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in process' /usr/local/share/gems/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in process' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal.rb:252:in dispatch' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_controller/metal.rb:335:in dispatch' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/routing/route_set.rb:67:in dispatch' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/routing/route_set.rb:50:in serve' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/journey/router.rb:53:in block in serve' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/journey/router.rb:133:in block in find_routes' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/journey/router.rb:126:in each' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/journey/router.rb:126:in find_routes' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/journey/router.rb:34:in serve' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/routing/route_set.rb:896:in call' /usr/local/share/gems/gems/rack-attack-6.8.0/lib/rack/attack.rb:129:in call' /usr/local/share/gems/gems/routes_lazy_routes-0.4.3/lib/routes_lazy_routes/lazy_routes_middleware.rb:16:in call' /workspace/manageiq/lib/request_started_on_middleware.rb:12:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/tempfile_reaper.rb:15:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/etag.rb:27:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/conditional_get.rb:40:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/head.rb:12:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/http/permissions_policy.rb:38:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/http/content_security_policy.rb:38:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/session/abstract/id.rb:266:in context' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/session/abstract/id.rb:260:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/cookies.rb:704:in call' /usr/local/share/gems/gems/activerecord-7.2.3/lib/active_record/migration.rb:674:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/callbacks.rb:31:in block in call' /usr/local/share/gems/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:101:in run_callbacks' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/callbacks.rb:30:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/executor.rb:16:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/debug_exceptions.rb:31:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/show_exceptions.rb:32:in call' /usr/local/share/gems/gems/railties-7.2.3/lib/rails/rack/logger.rb:41:in call_app' /usr/local/share/gems/gems/railties-7.2.3/lib/rails/rack/logger.rb:29:in call' /usr/local/share/gems/gems/sprockets-rails-3.5.2/lib/sprockets/rails/quiet_assets.rb:17:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/remote_ip.rb:96:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/request_id.rb:33:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/method_override.rb:24:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/runtime.rb:22:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/executor.rb:16:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/static.rb:27:in call' /usr/local/share/gems/gems/rack-2.2.21/lib/rack/sendfile.rb:127:in call' /usr/local/share/gems/gems/actionpack-7.2.3/lib/action_dispatch/middleware/host_authorization.rb:143:in call' /usr/local/share/gems/gems/secure_headers-3.9.0/lib/secure_headers/middleware.rb:12:in call' /usr/local/share/gems/gems/railties-7.2.3/lib/rails/engine.rb:535:in call' /usr/local/share/gems/gems/railties-7.2.3/lib/rails/railtie.rb:226:in public_send' /usr/local/share/gems/gems/railties-7.2.3/lib/rails/railtie.rb:226:in method_missing' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/configuration.rb:279:in call' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/request.rb:99:in block in handle_request' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/thread_pool.rb:390:in with_force_shutdown' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/request.rb:98:in handle_request' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/server.rb:472:in process_client' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/server.rb:254:in block in run' /usr/local/share/gems/gems/puma-6.6.1/lib/puma/thread_pool.rb:167:in block in spawn_thread'

If I follow what the application does, I end up in a function atomic_form_field_changed, the error occuring wjem rendering a partial "st_form", which renders "_form.html.haml", which then loads "_form_request_info.html" and finally "_prov_wf.html.haml".
The condition "if !@edit[:wf]" in _form_request_info.html.haml is not met, and when trying to go any further, the _prov_wf.html.haml is missing a method `provisioning_tab_list' for nil [catalog/atomic_form_field_changed].
Function provisioning_tab_list is defined in manageiq/app/models/miq_request_workflow.rb

There seems to be something missing. Can you help?

[schrammdocarmo]

Hi! I'm working with @szajac01 and @ebilbil to re-integrate the support. Anyone being able to help with the above issue or give some useful tips?

[agrare]

Hey @schrammdocarmo, the test that I asked @szajac01 to run was just to confirm that our current EmsRefresh code still worked with the current SCVMM API and it appears that it does.

That makes this significantly easier.

Now, we need to start adding back the things which were cleaned up by the PRs listed in github.com//pull/22279.

This is a little trickier than a simple revert because some of these changes we don't want to put back in the same place.
Tor example the product/dialogs in #22279 we would want to move to manageiq-providers-scvmm in content/dialogs.

If you're interested in putting some PRs in then I think adding back the changes in manageiq-content: content/automate/, https://github.com/ManageIQ/manageiq-ui-classic/pull/8588/changes#diff-374bbbb7646dd6f8c1cc7ecb45e63c8f1a2890943627bdd87c9a1535cc810d76, and moving the product/dialogs and spec/factories in #22279 to the manageiq-providers-scvmm plugin.

[ebilbil]

Hello @agrare ,
I put 4 PRs regarding the SCVMM re-integration

• add provision dialog in content/miq_dialogs folder manageiq-providers-scvmm#227
• manage scvmm in Provisioning and retirement manageiq-content#784
• Reintegrate scvmm provider manageiq-ui-classic#9926
• re-integrate scvmm manageiq-automation_engine#585

The provider seems to work correctly on my dev platform.
I hope it can be integrated on the next release.

[szajac01]

Hello @agrare @Fryguy , i see that there's still PRs not merged... can you give us a status ?
What's next step if merged, when will it be available on a official release?

[agrare]

Hey @szajac01 some of these can't be merged without also a core pr which adds the plugin back to the gemfile (the classes won't exist).
I also want to run some tests to ensure thing work as expected but haven't had time yet.

[agrare]

We've added the SCVMM provider back to the Gemfile, for any future issues please open an issue in https://github.com/ManageIQ/manageiq-providers-scvmm/issues/new