text:
Trillian testrun on PR-1692 fwd-merged on 4.9 branch

@blueorangutan package
The aim of the PR is to see how marvin tests perform on 4.9 branch with recent list of fixes from PR #1692
/cc @jburwell

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-59

Trillian test result (tid-127)
Environment: kvm-centos7 (x2), Advanced Networking
Total time taken: 22766 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t127-kvm-centos7.zip
Test completed. 48 look ok, 0 have error(s)

Test
Result
Time (s)

test_router_dns_guestipquery
Success
74.685

test_router_dns_externalipquery
Success
0.059

test_router_dhcphosts
Success
241.441

test_rolepermission_lifecycle_update
Success
7.077

test_rolepermission_lifecycle_list
Success
6.938

test_rolepermission_lifecycle_delete
Success
6.876

test_rolepermission_lifecycle_create
Success
6.767

test_rolepermission_lifecycle_concurrent_updates
Success
6.900

test_role_lifecycle_update_role_inuse
Success
6.923

test_role_lifecycle_update
Success
11.879

test_role_lifecycle_list
Success
6.787

test_role_lifecycle_delete
Success
11.817

test_role_lifecycle_create
Success
6.798

test_role_inuse_deletion
Success
6.794

test_role_account_acls_multiple_mgmt_servers
Success
9.063

test_role_account_acls
Success
9.294

test_releaseIP
Success
153.417

test_reboot_router
Success
389.419

test_public_ip_user_account
Success
10.309

test_public_ip_admin_account
Success
40.283

test_oobm_zchange_password
Success
20.611

test_oobm_multiple_mgmt_server_ownership
Success
16.582

test_oobm_issue_power_status
Success
10.564

test_oobm_issue_power_soft
Success
15.585

test_oobm_issue_power_reset
Success
15.608

test_oobm_issue_power_on
Success
15.589

test_oobm_issue_power_off
Success
10.584

test_oobm_issue_power_cycle
Success
10.564

test_oobm_enabledisable_across_clusterzones
Success
58.790

test_oobm_enable_feature_valid
Success
5.214

test_oobm_enable_feature_invalid
Success
0.142

test_oobm_disable_feature_valid
Success
5.226

test_oobm_disable_feature_invalid
Success
0.154

test_oobm_configure_invalid_driver
Success
0.115

test_oobm_configure_default_driver
Success
0.142

test_oobm_background_powerstate_sync
Success
20.117

test_nic_secondaryip_add_remove
Success
188.350

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
66.717

test_network_rules_acquired_public_ip_2_nat_rule
Success
61.650

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
121.732

test_isolate_network_password_server
Success
56.264

test_extendPhysicalNetworkVlan
Success
15.336

test_deployvm_userdispersing
Success
20.586

test_deployvm_userdata_post
Success
25.480

test_deployvm_userdata
Success
40.780

test_deployvm_userconcentrated
Success
35.707

test_deployvm_firstfit
Success
45.598

test_deploy_vm_multiple
Success
223.415

test_deploy_vm_from_iso
Success
193.537

test_deploy_vm
Success
0.036

test_delete_account
Success
278.648

test_default_role_deletion
Success
6.866

test_dedicatePublicIpRange
Success
0.450

test_dedicateGuestVlanRange
Success
10.276

test_create_pvlan_network
Success
5.213

test_createRegion
Success
0.042

test_createPortablePublicIPRange
Success
15.214

test_createPortablePublicIPAcquire
Success
15.523

test_assign_and_removal_lb
Success
133.398

test_advZoneVirtualRouter
Success
0.024

test_UpdateStorageOverProvisioningFactor
Success
0.158

test_UpdateConfigParamWithScope
Success
0.143

test_DeployVmAntiAffinityGroup
Success
56.066

test_CreateTemplateWithDuplicateName
Success
60.613

test_10_destroy_cpvm
Success
131.491

test_10_attachAndDetach_iso
Success
26.562

test_09_reboot_router
Success
35.310

test_09_expunge_vm
Success
185.220

test_09_destroy_ssvm
Success
133.136

test_09_delete_detached_volume
Success
15.540

test_08_start_router
Success
25.274

test_08_resize_volume
Success
15.423

test_08_reboot_cpvm
Success
101.390

test_08_migrate_vm
Success
36.051

test_08_list_system_templates
Success
0.031

test_07_stop_router
Success
10.160

test_07_restore_vm
Success
0.147

test_07_resize_fail
Success
20.467

test_07_reboot_ssvm
Success
133.855

test_07_list_public_templates
Success
0.039

test_07_list_default_iso
Success
0.062

test_06_stop_cpvm
Success
131.600

test_06_router_advanced
Success
0.060

test_06_download_detached_volume
Success
15.317

test_06_destroy_vm
Success
125.831

test_05_template_permissions
Success
0.064

test_05_stop_ssvm
Success
103.267

test_05_rvpc_multi_tiers
Success
486.296

test_05_router_basic
Success
0.041

test_05_iso_permissions
Success
0.062

test_05_detach_volume
Success
100.253

test_04_rvpc_privategw_static_routes
Success
426.308

test_04_rvpc_network_garbage_collector_nics
Success
1394.037

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
207.883

test_04_restart_network_wo_cleanup
Success
5.629

test_04_extract_template
Success
5.223

test_04_extract_Iso
Success
5.127

test_04_delete_attached_volume
Success
10.220

test_04_create_fat_type_disk_offering
Success
0.070

test_04_cpvm_internals
Success
1.034

test_04_change_offering_small
Success
204.533

test_03_vpc_privategw_restart_vpc_cleanup
Success
430.488

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
162.782

test_03_ssvm_internals
Success
2.914

test_03_restart_network_cleanup
Success
50.487

test_03_reboot_vm
Success
125.834

test_03_list_snapshots
Success
0.055

test_03_download_attached_volume
Success
15.296

test_03_delete_template
Success
5.134

test_03_delete_service_offering
Success
0.040

test_03_delete_iso
Success
95.203

test_03_delete_disk_offering
Success
0.040

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
528.881

test_02_vpc_privategw_static_routes
Success
351.671

test_02_sys_template_ready
Success
0.149

test_02_start_vm
Success
10.171

test_02_router_internal_adv
Success
0.914

test_02_redundant_VPC_default_routes
Success
735.033

test_02_port_fwd_on_non_src_nat
Success
55.627

test_02_list_templates
Success
0.039

test_02_list_cpvm_vm
Success
0.145

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
473.791

test_02_edit_template
Success
90.182

test_02_edit_service_offering
Success
0.056

test_02_edit_iso
Success
0.066

test_02_edit_disk_offering
Success
0.051

test_02_deploy_vm_root_resize
Success
6.946

test_02_create_sparse_type_disk_offering
Success
0.074

test_02_create_lb_rule_non_nat
Success
187.385

test_02_attach_volume
Success
43.647

test_02_VPC_default_routes
Success
253.590

test_01_vpc_site2site_vpn
Success
139.714

test_01_vpc_remote_access_vpn
Success
61.070

test_01_vpc_privategw_acl
Success
83.357

test_01_updatevolumedetail
Success
5.146

test_01_sys_vm_start
Success
0.184

test_01_stop_vm
Success
35.301

test_01_snapshot_root_disk
Success
11.275

test_01_router_internal_basic
Success
0.515

test_01_reset_vm_on_reboot
Success
130.937

test_01_redundant_vpc_site2site_vpn
Success
215.812

test_01_primary_storage_nfs
Success
35.770

test_01_port_fwd_on_src_nat
Success
109.733

test_01_nic
Success
591.429

test_01_list_volumes
Success
0.031

test_01_list_sec_storage_vm
Success
0.133

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Success
399.023

test_01_deploy_vm_root_resize
Success
6.907

test_01_create_volume
Success
621.039

test_01_create_template
Success
25.407

test_01_create_service_offering
Success
0.107

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Success
1250.140

test_01_create_lb_rule_src_nat
Success
207.833

test_01_create_iso
Success
22.432

test_01_create_disk_offering
Success
0.105

test_01_VPC_nics_after_destroy
Success
508.901

test_00_deploy_vm_root_resize
Success
198.339

login_test_saml_user
Success
24.590

test_static_role_account_acls
Skipped
0.051

test_deploy_vgpu_enabled_vm
Skipped
0.005

test_06_copy_template
Skipped
0.000

test_06_copy_iso
Skipped
0.000

test_03_delete_vm_snapshots
Skipped
0.000

test_02_revert_vm_snapshots
Skipped
0.000

test_01_test_vm_volume_snapshot
Skipped
0.001

test_01_scale_vm
Skipped
0.001

test_01_primary_storage_iscsi
Skipped
0.039

test_01_create_vm_snapshots
Skipped
0.000

Trillian test result (tid-128)
Environment: xenserver-65sp1 (x2), Advanced Networking
Total time taken: 39080 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t128-xenserver-65sp1.zip
Tested twice for intermitten failure: /marvin/tests/smoke/test_outofbandmanagement.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_privategw_acl.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_volumes.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_redundant.py
Test completed. 45 look ok, 3 have error(s)

Test
Result
Time (s)

test_05_rvpc_multi_tiers
Failure
520.529

test_04_rvpc_privategw_static_routes
Failure
678.396

test_04_rvpc_network_garbage_collector_nics
Failure
1341.466

test_03_vpc_privategw_restart_vpc_cleanup
Failure
452.452

test_02_vpc_privategw_static_routes
Failure
401.903

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Failure
545.832

test_06_download_detached_volume
Error
25.322

test_router_dns_guestipquery
Success
48.727

test_router_dns_externalipquery
Success
0.083

test_router_dhcphosts
Success
142.506

test_rolepermission_lifecycle_update
Success
7.111

test_rolepermission_lifecycle_list
Success
7.023

test_rolepermission_lifecycle_delete
Success
6.778

test_rolepermission_lifecycle_create
Success
6.818

test_rolepermission_lifecycle_concurrent_updates
Success
6.981

test_role_lifecycle_update_role_inuse
Success
6.787

test_role_lifecycle_update
Success
6.873

test_role_lifecycle_list
Success
6.817

test_role_lifecycle_delete
Success
11.896

test_role_lifecycle_create
Success
6.856

test_role_inuse_deletion
Success
6.755

test_role_account_acls_multiple_mgmt_servers
Success
9.035

test_role_account_acls
Success
9.187

test_releaseIP
Success
279.118

test_reboot_router
Success
560.925

test_public_ip_user_account
Success
10.257

test_public_ip_admin_account
Success
40.285

test_oobm_zchange_password
Success
20.617

test_oobm_multiple_mgmt_server_ownership
Success
12.564

test_oobm_issue_power_status
Success
10.558

test_oobm_issue_power_soft
Success
15.629

test_oobm_issue_power_reset
Success
15.589

test_oobm_issue_power_on
Success
15.588

test_oobm_issue_power_off
Success
15.588

test_oobm_issue_power_cycle
Success
15.588

test_oobm_enabledisable_across_clusterzones
Success
53.446

test_oobm_enable_feature_valid
Success
5.181

test_oobm_enable_feature_invalid
Success
0.126

test_oobm_disable_feature_valid
Success
5.197

test_oobm_disable_feature_invalid
Success
0.108

test_oobm_configure_invalid_driver
Success
0.102

test_oobm_configure_default_driver
Success
0.099

test_oobm_background_powerstate_sync
Success
11.824

test_nic_secondaryip_add_remove
Success
133.024

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
86.867

test_network_rules_acquired_public_ip_2_nat_rule
Success
76.583

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
102.952

test_isolate_network_password_server
Success
66.066

test_extendPhysicalNetworkVlan
Success
15.313

test_deployvm_userdispersing
Success
106.166

test_deployvm_userdata_post
Success
20.434

test_deployvm_userdata
Success
116.217

test_deployvm_userconcentrated
Success
45.741

test_deployvm_firstfit
Success
156.531

test_deploy_vm_multiple
Success
228.485

test_deploy_vm_from_iso
Success
148.154

test_deploy_vm
Success
0.032

test_delete_account
Success
248.451

test_default_role_deletion
Success
6.866

test_dedicatePublicIpRange
Success
0.401

test_dedicateGuestVlanRange
Success
10.306

test_create_pvlan_network
Success
5.201

test_createRegion
Success
0.041

test_createPortablePublicIPRange
Success
15.200

test_createPortablePublicIPAcquire
Success
15.450

test_assign_and_removal_lb
Success
148.924

test_advZoneVirtualRouter
Success
0.024

test_UpdateStorageOverProvisioningFactor
Success
0.133

test_UpdateConfigParamWithScope
Success
0.136

test_DeployVmAntiAffinityGroup
Success
201.910

test_CreateTemplateWithDuplicateName
Success
85.700

test_10_destroy_cpvm
Success
196.703

test_10_attachAndDetach_iso
Success
26.867

test_09_reboot_router
Success
50.385

test_09_expunge_vm
Success
125.230

test_09_destroy_ssvm
Success
228.956

test_09_delete_detached_volume
Success
20.674

test_08_start_router
Success
40.353

test_08_resize_volume
Success
105.972

test_08_reboot_cpvm
Success
141.569

test_08_migrate_vm
Success
66.065

test_08_list_system_templates
Success
0.034

test_07_stop_router
Success
15.187

test_07_restore_vm
Success
0.103

test_07_resize_fail
Success
111.210

test_07_reboot_ssvm
Success
153.772

test_07_list_public_templates
Success
0.042

test_07_list_default_iso
Success
0.066

test_06_stop_cpvm
Success
136.666

test_06_router_advanced
Success
0.059

test_06_destroy_vm
Success
10.144

test_05_template_permissions
Success
0.063

test_05_stop_ssvm
Success
168.896

test_05_router_basic
Success
0.042

test_05_iso_permissions
Success
0.062

test_05_detach_volume
Success
100.208

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
501.226

test_04_restart_network_wo_cleanup
Success
5.546

test_04_extract_template
Success
5.129

test_04_extract_Iso
Success
5.214

test_04_delete_attached_volume
Success
10.196

test_04_create_fat_type_disk_offering
Success
0.068

test_04_cpvm_internals
Success
1.152

test_04_change_offering_small
Success
124.052

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
314.317

test_03_ssvm_internals
Success
3.367

test_03_restart_network_cleanup
Success
100.789

test_03_reboot_vm
Success
10.163

test_03_list_snapshots
Success
0.054

test_03_download_attached_volume
Success
20.277

test_03_delete_vm_snapshots
Success
280.253

test_03_delete_template
Success
5.104

test_03_delete_service_offering
Success
0.043

test_03_delete_iso
Success
95.203

test_03_delete_disk_offering
Success
0.057

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
870.055

test_02_sys_template_ready
Success
0.127

test_02_start_vm
Success
20.223

test_02_router_internal_adv
Success
0.794

test_02_revert_vm_snapshots
Success
191.259

test_02_redundant_VPC_default_routes
Success
1058.772

test_02_port_fwd_on_non_src_nat
Success
70.773

test_02_list_templates
Success
0.041

test_02_list_cpvm_vm
Success
0.143

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
974.998

test_02_edit_template
Success
90.085

test_02_edit_service_offering
Success
0.056

test_02_edit_iso
Success
0.054

test_02_edit_disk_offering
Success
0.050

test_02_deploy_vm_root_resize
Success
6.929

test_02_create_sparse_type_disk_offering
Success
0.076

test_02_create_lb_rule_non_nat
Success
207.727

test_02_attach_volume
Success
10.660

test_02_VPC_default_routes
Success
365.576

test_01_vpc_site2site_vpn
Success
286.199

test_01_vpc_remote_access_vpn
Success
151.542

test_01_vpc_privategw_acl
Success
143.405

test_01_updatevolumedetail
Success
0.077

test_01_sys_vm_start
Success
0.182

test_01_stop_vm
Success
30.319

test_01_snapshot_root_disk
Success
16.288

test_01_scale_vm
Success
5.247

test_01_router_internal_basic
Success
0.425

test_01_reset_vm_on_reboot
Success
90.799

test_01_redundant_vpc_site2site_vpn
Success
547.639

test_01_primary_storage_nfs
Success
38.589

test_01_port_fwd_on_src_nat
Success
83.772

test_01_nic
Success
686.840

test_01_list_volumes
Success
0.032

test_01_list_sec_storage_vm
Success
0.131

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Success
686.397

test_01_deploy_vm_root_resize
Success
6.965

test_01_create_volume
Success
397.252

test_01_create_vm_snapshots
Success
130.754

test_01_create_template
Success
40.415

test_01_create_service_offering
Success
0.083

test_01_create_lb_rule_src_nat
Success
208.089

test_01_create_iso
Success
21.912

test_01_create_disk_offering
Success
0.077

test_01_VPC_nics_after_destroy
Success
603.484

test_00_deploy_vm_root_resize
Success
6.942

login_test_saml_user
Success
24.566

test_static_role_account_acls
Skipped
0.020

test_deploy_vgpu_enabled_vm
Skipped
0.005

test_06_copy_template
Skipped
0.000

test_06_copy_iso
Skipped
0.000

test_01_test_vm_volume_snapshot
Skipped
0.001

test_01_primary_storage_iscsi
Skipped
0.040

Trillian test result (tid-129)
Environment: vmware-55u3 (x2), Advanced Networking
Total time taken: 41336 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t129-vmware-55u3.zip
Tested twice for intermitten failure: /marvin/tests/smoke/test_internal_lb.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_outofbandmanagement.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_routers_network_ops.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_snapshots.py
Tested twice for intermitten failure: /marvin/tests/smoke/test_vpc_vpn.py
Test completed. 47 look ok, 1 have error(s)

Test
Result
Time (s)

test_01_vpc_site2site_vpn
Error
501.997

test_01_redundant_vpc_site2site_vpn
Error
729.340

test_router_dns_guestipquery
Success
76.742

test_router_dns_externalipquery
Success
0.075

test_router_dhcphosts
Success
143.973

test_rolepermission_lifecycle_update
Success
7.089

test_rolepermission_lifecycle_list
Success
6.880

test_rolepermission_lifecycle_delete
Success
6.725

test_rolepermission_lifecycle_create
Success
6.762

test_rolepermission_lifecycle_concurrent_updates
Success
6.887

test_role_lifecycle_update_role_inuse
Success
6.923

test_role_lifecycle_update
Success
11.889

test_role_lifecycle_list
Success
6.778

test_role_lifecycle_delete
Success
11.828

test_role_lifecycle_create
Success
6.778

test_role_inuse_deletion
Success
6.750

test_role_account_acls_multiple_mgmt_servers
Success
9.096

test_role_account_acls
Success
9.226

test_releaseIP
Success
288.976

test_reboot_router
Success
620.832

test_public_ip_user_account
Success
10.298

test_public_ip_admin_account
Success
40.290

test_oobm_zchange_password
Success
20.609

test_oobm_multiple_mgmt_server_ownership
Success
14.573

test_oobm_issue_power_status
Success
10.558

test_oobm_issue_power_soft
Success
15.586

test_oobm_issue_power_reset
Success
15.583

test_oobm_issue_power_on
Success
15.588

test_oobm_issue_power_off
Success
15.631

test_oobm_issue_power_cycle
Success
15.585

test_oobm_enabledisable_across_clusterzones
Success
58.519

test_oobm_enable_feature_valid
Success
5.171

test_oobm_enable_feature_invalid
Success
0.112

test_oobm_disable_feature_valid
Success
5.195

test_oobm_disable_feature_invalid
Success
0.110

test_oobm_configure_invalid_driver
Success
0.099

test_oobm_configure_default_driver
Success
0.096

test_oobm_background_powerstate_sync
Success
11.504

test_nic_secondaryip_add_remove
Success
248.859

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
76.932

test_network_rules_acquired_public_ip_2_nat_rule
Success
61.652

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
125.277

test_isolate_network_password_server
Success
95.472

test_extendPhysicalNetworkVlan
Success
15.354

test_deployvm_userdispersing
Success
55.825

test_deployvm_userdata_post
Success
30.501

test_deployvm_userdata
Success
146.377

test_deployvm_userconcentrated
Success
101.090

test_deployvm_firstfit
Success
171.433

test_deploy_vm_multiple
Success
248.391

test_deploy_vm_from_iso
Success
198.296

test_deploy_vm
Success
0.031

test_delete_account
Success
303.900

test_default_role_deletion
Success
6.854

test_dedicatePublicIpRange
Success
0.574

test_dedicateGuestVlanRange
Success
10.270

test_create_pvlan_network
Success
5.271

test_createRegion
Success
0.039

test_createPortablePublicIPRange
Success
15.191

test_createPortablePublicIPAcquire
Success
15.572

test_assign_and_removal_lb
Success
148.787

test_advZoneVirtualRouter
Success
0.023

test_UpdateStorageOverProvisioningFactor
Success
0.161

test_UpdateConfigParamWithScope
Success
0.141

test_DeployVmAntiAffinityGroup
Success
201.892

test_CreateTemplateWithDuplicateName
Success
221.672

test_10_destroy_cpvm
Success
231.839

test_10_attachAndDetach_iso
Success
26.881

test_09_reboot_router
Success
176.199

test_09_expunge_vm
Success
125.190

test_09_destroy_ssvm
Success
233.777

test_09_delete_detached_volume
Success
30.862

test_08_start_router
Success
115.836

test_08_reboot_cpvm
Success
156.598

test_08_migrate_vm
Success
76.161

test_08_list_system_templates
Success
0.031

test_07_stop_router
Success
25.247

test_07_restore_vm
Success
0.101

test_07_reboot_ssvm
Success
158.547

test_07_list_public_templates
Success
0.058

test_07_list_default_iso
Success
0.060

test_06_stop_cpvm
Success
171.905

test_06_router_advanced
Success
0.055

test_06_download_detached_volume
Success
55.647

test_06_destroy_vm
Success
10.150

test_05_template_permissions
Success
0.111

test_05_stop_ssvm
Success
209.099

test_05_rvpc_multi_tiers
Success
696.011

test_05_router_basic
Success
0.043

test_05_iso_permissions
Success
0.077

test_05_detach_volume
Success
105.259

test_04_rvpc_privategw_static_routes
Success
1120.751

test_04_rvpc_network_garbage_collector_nics
Success
1555.468

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
590.645

test_04_restart_network_wo_cleanup
Success
5.668

test_04_extract_template
Success
10.225

test_04_extract_Iso
Success
5.181

test_04_delete_attached_volume
Success
20.250

test_04_create_fat_type_disk_offering
Success
0.071

test_04_cpvm_internals
Success
1.233

test_04_change_offering_small
Success
92.363

test_03_vpc_privategw_restart_vpc_cleanup
Success
1029.796

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
399.667

test_03_ssvm_internals
Success
3.444

test_03_restart_network_cleanup
Success
140.971

test_03_reboot_vm
Success
5.137

test_03_list_snapshots
Success
0.085

test_03_download_attached_volume
Success
20.379

test_03_delete_vm_snapshots
Success
275.193

test_03_delete_template
Success
5.108

test_03_delete_service_offering
Success
0.037

test_03_delete_iso
Success
95.144

test_03_delete_disk_offering
Success
0.046

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
685.095

test_02_vpc_privategw_static_routes
Success
713.498

test_02_sys_template_ready
Success
0.130

test_02_start_vm
Success
20.313

test_02_router_internal_adv
Success
1.073

test_02_revert_vm_snapshots
Success
224.163

test_02_redundant_VPC_default_routes
Success
730.920

test_02_port_fwd_on_non_src_nat
Success
55.641

test_02_list_templates
Success
0.043

test_02_list_cpvm_vm
Success
0.210

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
1103.686

test_02_edit_template
Success
90.182

test_02_edit_service_offering
Success
0.057

test_02_edit_iso
Success
0.078

test_02_edit_disk_offering
Success
0.053

test_02_deploy_vm_root_resize
Success
6.869

test_02_create_sparse_type_disk_offering
Success
0.070

test_02_create_lb_rule_non_nat
Success
207.494

test_02_attach_volume
Success
58.785

test_02_VPC_default_routes
Success
405.897

test_01_vpc_remote_access_vpn
Success
171.672

test_01_vpc_privategw_acl
Success
198.971

test_01_updatevolumedetail
Success
0.086

test_01_test_vm_volume_snapshot
Success
146.237

test_01_sys_vm_start
Success
0.184

test_01_stop_vm
Success
5.117

test_01_snapshot_root_disk
Success
66.501

test_01_router_internal_basic
Success
0.587

test_01_reset_vm_on_reboot
Success
35.375

test_01_primary_storage_nfs
Success
36.730

test_01_port_fwd_on_src_nat
Success
112.015

test_01_nic
Success
657.401

test_01_list_volumes
Success
0.032

test_01_list_sec_storage_vm
Success
0.132

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Success
761.524

test_01_deploy_vm_root_resize
Success
6.744

test_01_create_volume
Success
523.620

test_01_create_vm_snapshots
Success
161.715

test_01_create_template
Success
115.861

test_01_create_service_offering
Success
0.107

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Success
1388.108

test_01_create_lb_rule_src_nat
Success
208.076

test_01_create_iso
Success
21.985

test_01_create_disk_offering
Success
0.108

test_01_VPC_nics_after_destroy
Success
720.418

test_00_deploy_vm_root_resize
Success
6.872

login_test_saml_user
Success
24.722

test_static_role_account_acls
Skipped
0.022

test_deploy_vgpu_enabled_vm
Skipped
0.004

test_08_resize_volume
Skipped
5.108

test_07_resize_fail
Skipped
10.287

test_06_copy_template
Skipped
0.001

test_06_copy_iso
Skipped
0.000

test_01_scale_vm
Skipped
66.313

test_01_primary_storage_iscsi
Skipped
0.036

Rebased against 4.9 branch, re-kicking packaging and tests.
@blueorangutan package

@rhtyd a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: ✔centos6 ✔centos7 ✔debian. JID-60

Kicked 4 trillian test envs with xenserver65, kvm centos7, vmware 5.5 and 6.0. We'll see some results in next 6-8 hours.

Trillian test result (tid-142)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 24455 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t142-kvm-centos7.zip
Test completed. 47 look ok, 1 have error(s)

Test
Result
Time (s)
Test File

test_02_redundant_VPC_default_routes
Failure
848.26
test_vpc_redundant.py

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Failure
358.82
test_vpc_redundant.py

test_01_vpc_site2site_vpn
Success
134.44
test_vpc_vpn.py

test_01_vpc_remote_access_vpn
Success
60.84
test_vpc_vpn.py

test_01_redundant_vpc_site2site_vpn
Success
255.14
test_vpc_vpn.py

test_02_VPC_default_routes
Success
258.67
test_vpc_router_nics.py

test_01_VPC_nics_after_destroy
Success
533.11
test_vpc_router_nics.py

test_05_rvpc_multi_tiers
Success
500.02
test_vpc_redundant.py

test_04_rvpc_network_garbage_collector_nics
Success
1409.26
test_vpc_redundant.py

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
547.07
test_vpc_redundant.py

test_09_delete_detached_volume
Success
15.42
test_volumes.py

test_08_resize_volume
Success
15.30
test_volumes.py

test_07_resize_fail
Success
20.36
test_volumes.py

test_06_download_detached_volume
Success
15.27
test_volumes.py

test_05_detach_volume
Success
100.19
test_volumes.py

test_04_delete_attached_volume
Success
10.15
test_volumes.py

test_03_download_attached_volume
Success
10.19
test_volumes.py

test_02_attach_volume
Success
43.61
test_volumes.py

test_01_create_volume
Success
711.32
test_volumes.py

test_deploy_vm_multiple
Success
272.77
test_vm_life_cycle.py

test_deploy_vm
Success
0.02
test_vm_life_cycle.py

test_advZoneVirtualRouter
Success
0.02
test_vm_life_cycle.py

test_10_attachAndDetach_iso
Success
26.47
test_vm_life_cycle.py

test_09_expunge_vm
Success
125.19
test_vm_life_cycle.py

test_08_migrate_vm
Success
40.78
test_vm_life_cycle.py

test_07_restore_vm
Success
0.10
test_vm_life_cycle.py

test_06_destroy_vm
Success
125.65
test_vm_life_cycle.py

test_03_reboot_vm
Success
125.68
test_vm_life_cycle.py

test_02_start_vm
Success
10.13
test_vm_life_cycle.py

test_01_stop_vm
Success
35.23
test_vm_life_cycle.py

test_CreateTemplateWithDuplicateName
Success
70.59
test_templates.py

test_08_list_system_templates
Success
0.02
test_templates.py

test_07_list_public_templates
Success
0.02
test_templates.py

test_05_template_permissions
Success
0.04
test_templates.py

test_04_extract_template
Success
5.11
test_templates.py

test_03_delete_template
Success
5.10
test_templates.py

test_02_edit_template
Success
90.14
test_templates.py

test_01_create_template
Success
40.32
test_templates.py

test_10_destroy_cpvm
Success
166.57
test_ssvm.py

test_09_destroy_ssvm
Success
163.49
test_ssvm.py

test_08_reboot_cpvm
Success
101.45
test_ssvm.py

test_07_reboot_ssvm
Success
133.47
test_ssvm.py

test_06_stop_cpvm
Success
131.60
test_ssvm.py

test_05_stop_ssvm
Success
133.73
test_ssvm.py

test_04_cpvm_internals
Success
1.34
test_ssvm.py

test_03_ssvm_internals
Success
3.96
test_ssvm.py

test_02_list_cpvm_vm
Success
0.11
test_ssvm.py

test_01_list_sec_storage_vm
Success
0.10
test_ssvm.py

test_01_snapshot_root_disk
Success
11.04
test_snapshots.py

test_04_change_offering_small
Success
239.41
test_service_offerings.py

test_03_delete_service_offering
Success
0.03
test_service_offerings.py

test_02_edit_service_offering
Success
0.07
test_service_offerings.py

test_01_create_service_offering
Success
0.08
test_service_offerings.py

test_02_sys_template_ready
Success
0.09
test_secondary_storage.py

test_01_sys_vm_start
Success
0.12
test_secondary_storage.py

test_09_reboot_router
Success
35.23
test_routers.py

test_08_start_router
Success
30.21
test_routers.py

test_07_stop_router
Success
10.12
test_routers.py

test_06_router_advanced
Success
0.04
test_routers.py

test_05_router_basic
Success
0.03
test_routers.py

test_04_restart_network_wo_cleanup
Success
5.65
test_routers.py

test_03_restart_network_cleanup
Success
55.37
test_routers.py

test_02_router_internal_adv
Success
0.92
test_routers.py

test_01_router_internal_basic
Success
0.48
test_routers.py

test_router_dns_guestipquery
Success
76.69
test_router_dns.py

test_router_dns_externalipquery
Success
0.04
test_router_dns.py

test_router_dhcphosts
Success
241.29
test_router_dhcphosts.py

test_01_updatevolumedetail
Success
0.06
test_resource_detail.py

test_01_reset_vm_on_reboot
Success
145.82
test_reset_vm_on_reboot.py

test_createRegion
Success
0.04
test_regions.py

test_create_pvlan_network
Success
5.16
test_pvlan.py

test_dedicatePublicIpRange
Success
0.29
test_public_ip_range.py

test_04_rvpc_privategw_static_routes
Success
444.58
test_privategw_acl.py

test_03_vpc_privategw_restart_vpc_cleanup
Success
464.05
test_privategw_acl.py

test_02_vpc_privategw_static_routes
Success
374.28
test_privategw_acl.py

test_01_vpc_privategw_acl
Success
77.13
test_privategw_acl.py

test_01_primary_storage_nfs
Success
35.64
test_primary_storage.py

test_createPortablePublicIPRange
Success
15.13
test_portable_publicip.py

test_createPortablePublicIPAcquire
Success
15.30
test_portable_publicip.py

test_isolate_network_password_server
Success
89.61
test_password_server.py

test_UpdateStorageOverProvisioningFactor
Success
0.10
test_over_provisioning.py

test_oobm_zchange_password
Success
15.54
test_outofbandmanagement.py

test_oobm_multiple_mgmt_server_ownership
Success
12.55
test_outofbandmanagement.py

test_oobm_issue_power_status
Success
10.54
test_outofbandmanagement.py

test_oobm_issue_power_soft
Success
15.56
test_outofbandmanagement.py

test_oobm_issue_power_reset
Success
10.54
test_outofbandmanagement.py

test_oobm_issue_power_on
Success
15.56
test_outofbandmanagement.py

test_oobm_issue_power_off
Success
10.58
test_outofbandmanagement.py

test_oobm_issue_power_cycle
Success
15.57
test_outofbandmanagement.py

test_oobm_enabledisable_across_clusterzones
Success
52.96
test_outofbandmanagement.py

test_oobm_enable_feature_valid
Success
5.14
test_outofbandmanagement.py

test_oobm_enable_feature_invalid
Success
0.10
test_outofbandmanagement.py

test_oobm_disable_feature_valid
Success
5.15
test_outofbandmanagement.py

test_oobm_disable_feature_invalid
Success
0.09
test_outofbandmanagement.py

test_oobm_configure_invalid_driver
Success
0.08
test_outofbandmanagement.py

test_oobm_configure_default_driver
Success
0.08
test_outofbandmanagement.py

test_oobm_background_powerstate_sync
Success
19.70
test_outofbandmanagement.py

test_extendPhysicalNetworkVlan
Success
15.25
test_non_contigiousvlan.py

test_01_nic
Success
614.65
test_nic.py

test_releaseIP
Success
257.95
test_network.py

test_reboot_router
Success
398.29
test_network.py

test_public_ip_user_account
Success
10.20
test_network.py

test_public_ip_admin_account
Success
40.22
test_network.py

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
66.59
test_network.py

test_network_rules_acquired_public_ip_2_nat_rule
Success
61.52
test_network.py

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
120.99
test_network.py

test_delete_account
Success
262.55
test_network.py

test_02_port_fwd_on_non_src_nat
Success
55.53
test_network.py

test_01_port_fwd_on_src_nat
Success
111.72
test_network.py

test_nic_secondaryip_add_remove
Success
197.46
test_multipleips_per_nic.py

login_test_saml_user
Success
21.28
test_login.py

test_assign_and_removal_lb
Success
133.54
test_loadbalance.py

test_02_create_lb_rule_non_nat
Success
187.29
test_loadbalance.py

test_01_create_lb_rule_src_nat
Success
207.73
test_loadbalance.py

test_03_list_snapshots
Success
0.04
test_list_ids_parameter.py

test_02_list_templates
Success
0.03
test_list_ids_parameter.py

test_01_list_volumes
Success
0.02
test_list_ids_parameter.py

test_07_list_default_iso
Success
0.04
test_iso.py

test_05_iso_permissions
Success
0.04
test_iso.py

test_04_extract_Iso
Success
5.13
test_iso.py

test_03_delete_iso
Success
95.17
test_iso.py

test_02_edit_iso
Success
0.05
test_iso.py

test_01_create_iso
Success
21.28
test_iso.py

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
222.81
test_internal_lb.py

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
167.48
test_internal_lb.py

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
494.44
test_internal_lb.py

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Success
399.08
test_internal_lb.py

test_dedicateGuestVlanRange
Success
10.20
test_guest_vlan_range.py

test_UpdateConfigParamWithScope
Success
0.10
test_global_settings.py

test_rolepermission_lifecycle_update
Success
6.35
test_dynamicroles.py

test_rolepermission_lifecycle_list
Success
6.25
test_dynamicroles.py

test_rolepermission_lifecycle_delete
Success
6.14
test_dynamicroles.py

test_rolepermission_lifecycle_create
Success
6.23
test_dynamicroles.py

test_rolepermission_lifecycle_concurrent_updates
Success
6.29
test_dynamicroles.py

test_role_lifecycle_update_role_inuse
Success
6.26
test_dynamicroles.py

test_role_lifecycle_update
Success
6.22
test_dynamicroles.py

test_role_lifecycle_list
Success
6.19
test_dynamicroles.py

test_role_lifecycle_delete
Success
6.19
test_dynamicroles.py

test_role_lifecycle_create
Success
6.19
test_dynamicroles.py

test_role_inuse_deletion
Success
6.18
test_dynamicroles.py

test_role_account_acls_multiple_mgmt_servers
Success
7.60
test_dynamicroles.py

test_role_account_acls
Success
7.66
test_dynamicroles.py

test_default_role_deletion
Success
6.32
test_dynamicroles.py

test_04_create_fat_type_disk_offering
Success
0.05
test_disk_offerings.py

test_03_delete_disk_offering
Success
0.03
test_disk_offerings.py

test_02_edit_disk_offering
Success
0.04
test_disk_offerings.py

test_02_create_sparse_type_disk_offering
Success
0.05
test_disk_offerings.py

test_01_create_disk_offering
Success
0.08
test_disk_offerings.py

test_deployvm_userdispersing
Success
20.40
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userconcentrated
Success
20.40
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_firstfit
Success
60.69
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userdata_post
Success
10.29
test_deploy_vm_with_userdata.py

test_deployvm_userdata
Success
40.46
test_deploy_vm_with_userdata.py

test_02_deploy_vm_root_resize
Success
6.23
test_deploy_vm_root_resize.py

test_01_deploy_vm_root_resize
Success
6.24
test_deploy_vm_root_resize.py

test_00_deploy_vm_root_resize
Success
202.48
test_deploy_vm_root_resize.py

test_deploy_vm_from_iso
Success
202.62
test_deploy_vm_iso.py

test_DeployVmAntiAffinityGroup
Success
95.83
test_affinity_groups.py

test_03_delete_vm_snapshots
Skipped
0.00
test_vm_snapshots.py

test_02_revert_vm_snapshots
Skipped
0.00
test_vm_snapshots.py

test_01_test_vm_volume_snapshot
Skipped
0.00
test_vm_snapshots.py

test_01_create_vm_snapshots
Skipped
0.00
test_vm_snapshots.py

test_06_copy_template
Skipped
0.00
test_templates.py

test_static_role_account_acls
Skipped
0.02
test_staticroles.py

test_01_scale_vm
Skipped
0.00
test_scale_vm.py

test_01_primary_storage_iscsi
Skipped
0.03
test_primary_storage.py

test_06_copy_iso
Skipped
0.00
test_iso.py

test_deploy_vgpu_enabled_vm
Skipped
0.01
test_deploy_vgpu_enabled_vm.py

Trillian test result (tid-143)
Environment: xenserver-65sp1 (x2), Advanced Networking with Mgmt server 7
Total time taken: 32707 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t143-xenserver-65sp1.zip
Test completed. 46 look ok, 2 have error(s)

Test
Result
Time (s)
Test File

test_05_rvpc_multi_tiers
Failure
527.95
test_vpc_redundant.py

test_04_rvpc_network_garbage_collector_nics
Failure
1380.08
test_vpc_redundant.py

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Failure
585.90
test_vpc_redundant.py

test_04_rvpc_privategw_static_routes
Failure
716.36
test_privategw_acl.py

test_03_vpc_privategw_restart_vpc_cleanup
Failure
439.80
test_privategw_acl.py

test_02_vpc_privategw_static_routes
Failure
495.36
test_privategw_acl.py

test_oobm_zchange_password
Failure
20.33
test_outofbandmanagement.py

test_01_vpc_site2site_vpn
Success
331.36
test_vpc_vpn.py

test_01_vpc_remote_access_vpn
Success
156.14
test_vpc_vpn.py

test_01_redundant_vpc_site2site_vpn
Success
601.44
test_vpc_vpn.py

test_02_VPC_default_routes
Success
398.86
test_vpc_router_nics.py

test_01_VPC_nics_after_destroy
Success
631.49
test_vpc_router_nics.py

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
856.75
test_vpc_redundant.py

test_02_redundant_VPC_default_routes
Success
1096.44
test_vpc_redundant.py

test_09_delete_detached_volume
Success
21.08
test_volumes.py

test_08_resize_volume
Success
110.79
test_volumes.py

test_07_resize_fail
Success
120.72
test_volumes.py

test_06_download_detached_volume
Success
20.22
test_volumes.py

test_05_detach_volume
Success
105.17
test_volumes.py

test_04_delete_attached_volume
Success
20.18
test_volumes.py

test_03_download_attached_volume
Success
15.17
test_volumes.py

test_02_attach_volume
Success
15.70
test_volumes.py

test_01_create_volume
Success
427.94
test_volumes.py

test_03_delete_vm_snapshots
Success
280.18
test_vm_snapshots.py

test_02_revert_vm_snapshots
Success
224.30
test_vm_snapshots.py

test_01_create_vm_snapshots
Success
100.85
test_vm_snapshots.py

test_deploy_vm_multiple
Success
187.07
test_vm_life_cycle.py

test_deploy_vm
Success
0.02
test_vm_life_cycle.py

test_advZoneVirtualRouter
Success
0.01
test_vm_life_cycle.py

test_10_attachAndDetach_iso
Success
36.71
test_vm_life_cycle.py

test_09_expunge_vm
Success
125.18
test_vm_life_cycle.py

test_08_migrate_vm
Success
65.70
test_vm_life_cycle.py

test_07_restore_vm
Success
0.07
test_vm_life_cycle.py

test_06_destroy_vm
Success
5.08
test_vm_life_cycle.py

test_03_reboot_vm
Success
10.11
test_vm_life_cycle.py

test_02_start_vm
Success
20.17
test_vm_life_cycle.py

test_01_stop_vm
Success
30.19
test_vm_life_cycle.py

test_CreateTemplateWithDuplicateName
Success
100.61
test_templates.py

test_08_list_system_templates
Success
0.02
test_templates.py

test_07_list_public_templates
Success
0.02
test_templates.py

test_05_template_permissions
Success
0.04
test_templates.py

test_04_extract_template
Success
5.11
test_templates.py

test_03_delete_template
Success
5.07
test_templates.py

test_02_edit_template
Success
90.08
test_templates.py

test_01_create_template
Success
65.41
test_templates.py

test_10_destroy_cpvm
Success
231.65
test_ssvm.py

test_09_destroy_ssvm
Success
228.63
test_ssvm.py

test_08_reboot_cpvm
Success
181.61
test_ssvm.py

test_07_reboot_ssvm
Success
143.58
test_ssvm.py

test_06_stop_cpvm
Success
166.96
test_ssvm.py

test_05_stop_ssvm
Success
163.81
test_ssvm.py

test_04_cpvm_internals
Success
1.13
test_ssvm.py

test_03_ssvm_internals
Success
3.63
test_ssvm.py

test_02_list_cpvm_vm
Success
0.07
test_ssvm.py

test_01_list_sec_storage_vm
Success
0.08
test_ssvm.py

test_01_snapshot_root_disk
Success
26.06
test_snapshots.py

test_04_change_offering_small
Success
118.91
test_service_offerings.py

test_03_delete_service_offering
Success
0.03
test_service_offerings.py

test_02_edit_service_offering
Success
0.04
test_service_offerings.py

test_01_create_service_offering
Success
0.06
test_service_offerings.py

test_02_sys_template_ready
Success
0.09
test_secondary_storage.py

test_01_sys_vm_start
Success
0.12
test_secondary_storage.py

test_01_scale_vm
Success
5.13
test_scale_vm.py

test_09_reboot_router
Success
65.34
test_routers.py

test_08_start_router
Success
55.60
test_routers.py

test_07_stop_router
Success
15.13
test_routers.py

test_06_router_advanced
Success
0.05
test_routers.py

test_05_router_basic
Success
0.03
test_routers.py

test_04_restart_network_wo_cleanup
Success
5.54
test_routers.py

test_03_restart_network_cleanup
Success
115.59
test_routers.py

test_02_router_internal_adv
Success
0.79
test_routers.py

test_01_router_internal_basic
Success
0.45
test_routers.py

test_router_dns_guestipquery
Success
48.84
test_router_dns.py

test_router_dns_externalipquery
Success
0.04
test_router_dns.py

test_router_dhcphosts
Success
137.97
test_router_dhcphosts.py

test_01_updatevolumedetail
Success
0.05
test_resource_detail.py

test_01_reset_vm_on_reboot
Success
40.26
test_reset_vm_on_reboot.py

test_createRegion
Success
0.03
test_regions.py

test_create_pvlan_network
Success
5.14
test_pvlan.py

test_dedicatePublicIpRange
Success
0.27
test_public_ip_range.py

test_01_vpc_privategw_acl
Success
162.43
test_privategw_acl.py

test_01_primary_storage_nfs
Success
38.84
test_primary_storage.py

test_01_primary_storage_iscsi
Success
79.83
test_primary_storage.py

test_createPortablePublicIPRange
Success
15.15
test_portable_publicip.py

test_createPortablePublicIPAcquire
Success
20.31
test_portable_publicip.py

test_isolate_network_password_server
Success
35.71
test_password_server.py

test_UpdateStorageOverProvisioningFactor
Success
0.09
test_over_provisioning.py

test_oobm_multiple_mgmt_server_ownership
Success
12.55
test_outofbandmanagement.py

test_oobm_issue_power_status
Success
10.54
test_outofbandmanagement.py

test_oobm_issue_power_soft
Success
15.55
test_outofbandmanagement.py

test_oobm_issue_power_reset
Success
15.55
test_outofbandmanagement.py

test_oobm_issue_power_on
Success
15.59
test_outofbandmanagement.py

test_oobm_issue_power_off
Success
15.58
test_outofbandmanagement.py

test_oobm_issue_power_cycle
Success
15.61
test_outofbandmanagement.py

test_oobm_enabledisable_across_clusterzones
Success
58.16
test_outofbandmanagement.py

test_oobm_enable_feature_valid
Success
5.12
test_outofbandmanagement.py

test_oobm_enable_feature_invalid
Success
0.08
test_outofbandmanagement.py

test_oobm_disable_feature_valid
Success
0.12
test_outofbandmanagement.py

test_oobm_disable_feature_invalid
Success
0.08
test_outofbandmanagement.py

test_oobm_configure_invalid_driver
Success
0.07
test_outofbandmanagement.py

test_oobm_configure_default_driver
Success
0.07
test_outofbandmanagement.py

test_oobm_background_powerstate_sync
Success
11.27
test_outofbandmanagement.py

test_extendPhysicalNetworkVlan
Success
15.21
test_non_contigiousvlan.py

test_01_nic
Success
709.82
test_nic.py

test_releaseIP
Success
263.00
test_network.py

test_reboot_router
Success
593.90
test_network.py

test_public_ip_user_account
Success
10.17
test_network.py

test_public_ip_admin_account
Success
40.20
test_network.py

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
86.24
test_network.py

test_network_rules_acquired_public_ip_2_nat_rule
Success
76.28
test_network.py

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
99.86
test_network.py

test_delete_account
Success
292.85
test_network.py

test_02_port_fwd_on_non_src_nat
Success
70.55
test_network.py

test_01_port_fwd_on_src_nat
Success
83.81
test_network.py

test_nic_secondaryip_add_remove
Success
202.30
test_multipleips_per_nic.py

login_test_saml_user
Success
21.33
test_login.py

test_assign_and_removal_lb
Success
148.79
test_loadbalance.py

test_02_create_lb_rule_non_nat
Success
207.31
test_loadbalance.py

test_01_create_lb_rule_src_nat
Success
208.09
test_loadbalance.py

test_03_list_snapshots
Success
0.03
test_list_ids_parameter.py

test_02_list_templates
Success
0.03
test_list_ids_parameter.py

test_01_list_volumes
Success
0.02
test_list_ids_parameter.py

test_07_list_default_iso
Success
0.04
test_iso.py

test_05_iso_permissions
Success
0.04
test_iso.py

test_04_extract_Iso
Success
5.09
test_iso.py

test_03_delete_iso
Success
95.18
test_iso.py

test_02_edit_iso
Success
0.04
test_iso.py

test_01_create_iso
Success
21.26
test_iso.py

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
549.25
test_internal_lb.py

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
353.07
test_internal_lb.py

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
1063.99
test_internal_lb.py

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Success
695.76
test_internal_lb.py

test_dedicateGuestVlanRange
Success
10.18
test_guest_vlan_range.py

test_UpdateConfigParamWithScope
Success
0.09
test_global_settings.py

test_rolepermission_lifecycle_update
Success
6.33
test_dynamicroles.py

test_rolepermission_lifecycle_list
Success
6.25
test_dynamicroles.py

test_rolepermission_lifecycle_delete
Success
6.13
test_dynamicroles.py

test_rolepermission_lifecycle_create
Success
6.19
test_dynamicroles.py

test_rolepermission_lifecycle_concurrent_updates
Success
6.26
test_dynamicroles.py

test_role_lifecycle_update_role_inuse
Success
6.18
test_dynamicroles.py

test_role_lifecycle_update
Success
11.24
test_dynamicroles.py

test_role_lifecycle_list
Success
6.17
test_dynamicroles.py

test_role_lifecycle_delete
Success
11.18
test_dynamicroles.py

test_role_lifecycle_create
Success
6.17
test_dynamicroles.py

test_role_inuse_deletion
Success
6.14
test_dynamicroles.py

test_role_account_acls_multiple_mgmt_servers
Success
7.52
test_dynamicroles.py

test_role_account_acls
Success
7.71
test_dynamicroles.py

test_default_role_deletion
Success
6.21
test_dynamicroles.py

test_04_create_fat_type_disk_offering
Success
0.04
test_disk_offerings.py

test_03_delete_disk_offering
Success
0.02
test_disk_offerings.py

test_02_edit_disk_offering
Success
0.03
test_disk_offerings.py

test_02_create_sparse_type_disk_offering
Success
0.04
test_disk_offerings.py

test_01_create_disk_offering
Success
0.05
test_disk_offerings.py

test_deployvm_userdispersing
Success
50.51
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userconcentrated
Success
131.11
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_firstfit
Success
191.15
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userdata_post
Success
30.36
test_deploy_vm_with_userdata.py

test_deployvm_userdata
Success
125.81
test_deploy_vm_with_userdata.py

test_02_deploy_vm_root_resize
Success
6.12
test_deploy_vm_root_resize.py

test_01_deploy_vm_root_resize
Success
6.12
test_deploy_vm_root_resize.py

test_00_deploy_vm_root_resize
Success
6.22
test_deploy_vm_root_resize.py

test_deploy_vm_from_iso
Success
182.16
test_deploy_vm_iso.py

test_DeployVmAntiAffinityGroup
Success
241.35
test_affinity_groups.py

test_01_test_vm_volume_snapshot
Skipped
0.00
test_vm_snapshots.py

test_06_copy_template
Skipped
0.00
test_templates.py

test_static_role_account_acls
Skipped
0.01
test_staticroles.py

test_06_copy_iso
Skipped
0.00
test_iso.py

test_deploy_vgpu_enabled_vm
Skipped
0.00
test_deploy_vgpu_enabled_vm.py

Trillian test result (tid-144)
Environment: vmware-55u3 (x2), Advanced Networking with Mgmt server 7
Total time taken: 36776 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t144-vmware-55u3.zip
Test completed. 41 look ok, 7 have error(s)

Test
Result
Time (s)
Test File

test_02_VPC_default_routes
Failure
920.61
test_vpc_router_nics.py

test_01_VPC_nics_after_destroy
Failure
1256.29
test_vpc_router_nics.py

test_05_rvpc_multi_tiers
Failure
718.08
test_vpc_redundant.py

test_03_vpc_privategw_restart_vpc_cleanup
Failure
233.53
test_privategw_acl.py

test_oobm_zchange_password
Failure
20.53
test_outofbandmanagement.py

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Failure
525.25
test_internal_lb.py

test_01_vpc_site2site_vpn
Error
501.87
test_vpc_vpn.py

test_01_redundant_vpc_site2site_vpn
Error
768.66
test_vpc_vpn.py

test_05_rvpc_multi_tiers
Error
809.23
test_vpc_redundant.py

test_01_snapshot_root_disk
Error
5.18
test_snapshots.py

test_09_reboot_router
Error
196.26
test_routers.py

test_01_vpc_remote_access_vpn
Success
161.69
test_vpc_vpn.py

test_04_rvpc_network_garbage_collector_nics
Success
1590.79
test_vpc_redundant.py

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Success
725.97
test_vpc_redundant.py

test_02_redundant_VPC_default_routes
Success
722.04
test_vpc_redundant.py

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Success
1408.66
test_vpc_redundant.py

test_09_delete_detached_volume
Success
31.02
test_volumes.py

test_06_download_detached_volume
Success
55.60
test_volumes.py

test_05_detach_volume
Success
105.32
test_volumes.py

test_04_delete_attached_volume
Success
20.46
test_volumes.py

test_03_download_attached_volume
Success
20.33
test_volumes.py

test_02_attach_volume
Success
53.77
test_volumes.py

test_01_create_volume
Success
519.90
test_volumes.py

test_03_delete_vm_snapshots
Success
275.24
test_vm_snapshots.py

test_02_revert_vm_snapshots
Success
229.40
test_vm_snapshots.py

test_01_test_vm_volume_snapshot
Success
146.36
test_vm_snapshots.py

test_01_create_vm_snapshots
Success
161.70
test_vm_snapshots.py

test_deploy_vm_multiple
Success
218.42
test_vm_life_cycle.py

test_deploy_vm
Success
0.03
test_vm_life_cycle.py

test_advZoneVirtualRouter
Success
0.03
test_vm_life_cycle.py

test_10_attachAndDetach_iso
Success
26.89
test_vm_life_cycle.py

test_09_expunge_vm
Success
125.25
test_vm_life_cycle.py

test_08_migrate_vm
Success
81.28
test_vm_life_cycle.py

test_07_restore_vm
Success
0.10
test_vm_life_cycle.py

test_06_destroy_vm
Success
10.20
test_vm_life_cycle.py

test_03_reboot_vm
Success
5.15
test_vm_life_cycle.py

test_02_start_vm
Success
20.24
test_vm_life_cycle.py

test_01_stop_vm
Success
10.16
test_vm_life_cycle.py

test_CreateTemplateWithDuplicateName
Success
246.88
test_templates.py

test_08_list_system_templates
Success
0.03
test_templates.py

test_07_list_public_templates
Success
0.04
test_templates.py

test_05_template_permissions
Success
0.06
test_templates.py

test_04_extract_template
Success
10.28
test_templates.py

test_03_delete_template
Success
5.12
test_templates.py

test_02_edit_template
Success
90.16
test_templates.py

test_01_create_template
Success
115.96
test_templates.py

test_10_destroy_cpvm
Success
267.14
test_ssvm.py

test_09_destroy_ssvm
Success
269.17
test_ssvm.py

test_08_reboot_cpvm
Success
186.77
test_ssvm.py

test_07_reboot_ssvm
Success
158.63
test_ssvm.py

test_06_stop_cpvm
Success
177.01
test_ssvm.py

test_05_stop_ssvm
Success
294.52
test_ssvm.py

test_04_cpvm_internals
Success
1.28
test_ssvm.py

test_03_ssvm_internals
Success
3.56
test_ssvm.py

test_02_list_cpvm_vm
Success
0.15
test_ssvm.py

test_01_list_sec_storage_vm
Success
0.16
test_ssvm.py

test_04_change_offering_small
Success
92.95
test_service_offerings.py

test_03_delete_service_offering
Success
0.04
test_service_offerings.py

test_02_edit_service_offering
Success
0.08
test_service_offerings.py

test_01_create_service_offering
Success
0.12
test_service_offerings.py

test_02_sys_template_ready
Success
0.15
test_secondary_storage.py

test_01_sys_vm_start
Success
0.21
test_secondary_storage.py

test_08_start_router
Success
141.18
test_routers.py

test_07_stop_router
Success
30.29
test_routers.py

test_06_router_advanced
Success
0.06
test_routers.py

test_05_router_basic
Success
0.04
test_routers.py

test_04_restart_network_wo_cleanup
Success
5.68
test_routers.py

test_03_restart_network_cleanup
Success
191.40
test_routers.py

test_02_router_internal_adv
Success
1.13
test_routers.py

test_01_router_internal_basic
Success
0.68
test_routers.py

test_router_dns_guestipquery
Success
76.90
test_router_dns.py

test_router_dns_externalipquery
Success
0.12
test_router_dns.py

test_router_dhcphosts
Success
151.24
test_router_dhcphosts.py

test_01_updatevolumedetail
Success
0.11
test_resource_detail.py

test_01_reset_vm_on_reboot
Success
60.56
test_reset_vm_on_reboot.py

test_createRegion
Success
0.08
test_regions.py

test_create_pvlan_network
Success
5.25
test_pvlan.py

test_dedicatePublicIpRange
Success
0.54
test_public_ip_range.py

test_04_rvpc_privategw_static_routes
Success
1077.16
test_privategw_acl.py

test_02_vpc_privategw_static_routes
Success
698.97
test_privategw_acl.py

test_01_vpc_privategw_acl
Success
204.18
test_privategw_acl.py

test_01_primary_storage_nfs
Success
37.70
test_primary_storage.py

test_createPortablePublicIPRange
Success
15.24
test_portable_publicip.py

test_createPortablePublicIPAcquire
Success
15.47
test_portable_publicip.py

test_isolate_network_password_server
Success
97.60
test_password_server.py

test_UpdateStorageOverProvisioningFactor
Success
0.15
test_over_provisioning.py

test_oobm_multiple_mgmt_server_ownership
Success
12.57
test_outofbandmanagement.py

test_oobm_issue_power_status
Success
10.56
test_outofbandmanagement.py

test_oobm_issue_power_soft
Success
15.59
test_outofbandmanagement.py

test_oobm_issue_power_reset
Success
15.60
test_outofbandmanagement.py

test_oobm_issue_power_on
Success
15.58
test_outofbandmanagement.py

test_oobm_issue_power_off
Success
15.67
test_outofbandmanagement.py

test_oobm_issue_power_cycle
Success
15.71
test_outofbandmanagement.py

test_oobm_enabledisable_across_clusterzones
Success
54.00
test_outofbandmanagement.py

test_oobm_enable_feature_valid
Success
5.27
test_outofbandmanagement.py

test_oobm_enable_feature_invalid
Success
0.18
test_outofbandmanagement.py

test_oobm_disable_feature_valid
Success
5.40
test_outofbandmanagement.py

test_oobm_disable_feature_invalid
Success
0.21
test_outofbandmanagement.py

test_oobm_configure_invalid_driver
Success
0.20
test_outofbandmanagement.py

test_oobm_configure_default_driver
Success
0.17
test_outofbandmanagement.py

test_oobm_background_powerstate_sync
Success
17.77
test_outofbandmanagement.py

test_extendPhysicalNetworkVlan
Success
15.38
test_non_contigiousvlan.py

test_01_nic
Success
687.82
test_nic.py

test_releaseIP
Success
430.74
test_network.py

test_reboot_router
Success
661.37
test_network.py

test_public_ip_user_account
Success
10.40
test_network.py

test_public_ip_admin_account
Success
40.30
test_network.py

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Success
76.94
test_network.py

test_network_rules_acquired_public_ip_2_nat_rule
Success
61.77
test_network.py

test_network_rules_acquired_public_ip_1_static_nat_rule
Success
125.34
test_network.py

test_delete_account
Success
334.35
test_network.py

test_02_port_fwd_on_non_src_nat
Success
55.78
test_network.py

test_01_port_fwd_on_src_nat
Success
111.91
test_network.py

test_nic_secondaryip_add_remove
Success
218.73
test_multipleips_per_nic.py

login_test_saml_user
Success
24.75
test_login.py

test_assign_and_removal_lb
Success
149.31
test_loadbalance.py

test_02_create_lb_rule_non_nat
Success
207.94
test_loadbalance.py

test_01_create_lb_rule_src_nat
Success
208.32
test_loadbalance.py

test_03_list_snapshots
Success
0.09
test_list_ids_parameter.py

test_02_list_templates
Success
0.04
test_list_ids_parameter.py

test_01_list_volumes
Success
0.03
test_list_ids_parameter.py

test_07_list_default_iso
Success
0.06
test_iso.py

test_05_iso_permissions
Success
0.07
test_iso.py

test_04_extract_Iso
Success
5.16
test_iso.py

test_03_delete_iso
Success
95.23
test_iso.py

test_02_edit_iso
Success
0.06
test_iso.py

test_01_create_iso
Success
21.89
test_iso.py

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Success
570.74
test_internal_lb.py

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Success
435.05
test_internal_lb.py

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Success
1047.74
test_internal_lb.py

test_dedicateGuestVlanRange
Success
10.28
test_guest_vlan_range.py

test_UpdateConfigParamWithScope
Success
0.15
test_global_settings.py

test_rolepermission_lifecycle_update
Success
7.28
test_dynamicroles.py

test_rolepermission_lifecycle_list
Success
6.90
test_dynamicroles.py

test_rolepermission_lifecycle_delete
Success
6.95
test_dynamicroles.py

test_rolepermission_lifecycle_create
Success
6.94
test_dynamicroles.py

test_rolepermission_lifecycle_concurrent_updates
Success
7.15
test_dynamicroles.py

test_role_lifecycle_update_role_inuse
Success
6.87
test_dynamicroles.py

test_role_lifecycle_update
Success
11.92
test_dynamicroles.py

test_role_lifecycle_list
Success
6.82
test_dynamicroles.py

test_role_lifecycle_delete
Success
11.91
test_dynamicroles.py

test_role_lifecycle_create
Success
7.11
test_dynamicroles.py

test_role_inuse_deletion
Success
6.89
test_dynamicroles.py

test_role_account_acls_multiple_mgmt_servers
Success
9.18
test_dynamicroles.py

test_role_account_acls
Success
9.41
test_dynamicroles.py

test_default_role_deletion
Success
6.91
test_dynamicroles.py

test_04_create_fat_type_disk_offering
Success
0.08
test_disk_offerings.py

test_03_delete_disk_offering
Success
0.05
test_disk_offerings.py

test_02_edit_disk_offering
Success
0.07
test_disk_offerings.py

test_02_create_sparse_type_disk_offering
Success
0.09
test_disk_offerings.py

test_01_create_disk_offering
Success
0.13
test_disk_offerings.py

test_deployvm_userdispersing
Success
55.84
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userconcentrated
Success
96.18
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_firstfit
Success
383.13
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userdata_post
Success
60.83
test_deploy_vm_with_userdata.py

test_deployvm_userdata
Success
166.77
test_deploy_vm_with_userdata.py

test_02_deploy_vm_root_resize
Success
6.84
test_deploy_vm_root_resize.py

test_01_deploy_vm_root_resize
Success
7.30
test_deploy_vm_root_resize.py

test_00_deploy_vm_root_resize
Success
7.05
test_deploy_vm_root_resize.py

test_deploy_vm_from_iso
Success
214.15
test_deploy_vm_iso.py

test_DeployVmAntiAffinityGroup
Success
273.06
test_affinity_groups.py

test_08_resize_volume
Skipped
5.12
test_volumes.py

test_07_resize_fail
Skipped
10.29
test_volumes.py

test_06_copy_template
Skipped
0.00
test_templates.py

test_static_role_account_acls
Skipped
0.03
test_staticroles.py

test_01_scale_vm
Skipped
66.46
test_scale_vm.py

test_01_primary_storage_iscsi
Skipped
0.04
test_primary_storage.py

test_06_copy_iso
Skipped
0.00
test_iso.py

test_deploy_vgpu_enabled_vm
Skipped
0.01
test_deploy_vgpu_enabled_vm.py

Similar to #1703 the test test_oobm_zchange_password failed due to env related config where oobm sync interval was set to 1 second. I've increased the timeout to 5s, and added some code to cleanup old alerts (the failure was around alert count, while the core test itself passed). The failure as seen above can be ignored, as manually ran test succeeded along with the test that ran in the Travis job.
Tests out-of-band management ownership expiry across multi-mgmt server ... === TestName: test_oobm_multiple_mgmt_server_ownership | Status : SUCCESS ===
ok
Tests out-of-band management change password feature ... === TestName: test_oobm_zchange_password | Status : SUCCESS ===
ok
Ran 16 tests in 206.122s
OK

Trillian test result (tid-145)
Environment: vmware-60u2 (x2), Advanced Networking with Mgmt server 7
Total time taken: 43150 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr1703-t145-vmware-60u2.zip
Test completed. 36 look ok, 12 have error(s)

Test
Result
Time (s)
Test File

test_02_VPC_default_routes
Failure
896.45
test_vpc_router_nics.py

test_01_VPC_nics_after_destroy
Failure
906.62
test_vpc_router_nics.py

test_05_rvpc_multi_tiers
Failure
389.53
test_vpc_redundant.py

test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers
Failure
308.78
test_vpc_redundant.py

test_02_redundant_VPC_default_routes
Failure
1169.48
test_vpc_redundant.py

test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL
Failure
384.52
test_vpc_redundant.py

test_01_create_volume
Failure
683.72
test_volumes.py

test_02_revert_vm_snapshots
Failure
90.31
test_vm_snapshots.py

test_04_change_offering_small
Failure
693.80
test_service_offerings.py

test_04_rvpc_privategw_static_routes
Failure
1484.88
test_privategw_acl.py

test_03_vpc_privategw_restart_vpc_cleanup
Failure
1173.41
test_privategw_acl.py

test_01_vpc_privategw_acl
Failure
116.70
test_privategw_acl.py

test_isolate_network_password_server
Failure
195.92
test_password_server.py

test_oobm_zchange_password
Failure
20.32
test_outofbandmanagement.py

test_reboot_router
Failure
600.76
test_network.py

test_network_rules_acquired_public_ip_3_Load_Balancer_Rule
Failure
841.59
test_network.py

test_network_rules_acquired_public_ip_2_nat_rule
Failure
684.24
test_network.py

test_network_rules_acquired_public_ip_1_static_nat_rule
Failure
676.43
test_network.py

test_02_port_fwd_on_non_src_nat
Failure
683.88
test_network.py

test_01_port_fwd_on_src_nat
Failure
678.77
test_network.py

test_assign_and_removal_lb
Failure
176.71
test_loadbalance.py

test_02_create_lb_rule_non_nat
Failure
176.75
test_loadbalance.py

test_01_create_lb_rule_src_nat
Failure
207.20
test_loadbalance.py

test_04_rvpc_internallb_haproxy_stats_on_all_interfaces
Failure
437.11
test_internal_lb.py

test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80
Failure
1024.34
test_internal_lb.py

test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80
Failure
400.39
test_internal_lb.py

ContextSuite context=TestVpcSite2SiteVpn>:setup
Error
0.00
test_vpc_vpn.py

ContextSuite context=TestVpcRemoteAccessVpn>:setup
Error
0.00
test_vpc_vpn.py

ContextSuite context=TestRVPCSite2SiteVpn>:setup
Error
0.00
test_vpc_vpn.py

test_05_rvpc_multi_tiers
Error
475.33
test_vpc_redundant.py

ContextSuite context=TestVPCRedundancy>:teardown
Error
480.42
test_vpc_redundant.py

test_01_test_vm_volume_snapshot
Error
176.00
test_vm_snapshots.py

test_01_create_vm_snapshots
Error
161.65
test_vm_snapshots.py

test_01_scale_vm
Error
663.54
test_scale_vm.py

test_03_vpc_internallb_haproxy_stats_on_all_interfaces
Error
340.56
test_internal_lb.py

test_04_rvpc_network_garbage_collector_nics
Success
1502.74
test_vpc_redundant.py

test_09_delete_detached_volume
Success
20.81
test_volumes.py

test_06_download_detached_volume
Success
45.32
test_volumes.py

test_05_detach_volume
Success
100.17
test_volumes.py

test_04_delete_attached_volume
Success
10.15
test_volumes.py

test_03_download_attached_volume
Success
15.18
test_volumes.py

test_02_attach_volume
Success
48.70
test_volumes.py

test_03_delete_vm_snapshots
Success
275.18
test_vm_snapshots.py

test_deploy_vm_multiple
Success
247.42
test_vm_life_cycle.py

test_deploy_vm
Success
0.02
test_vm_life_cycle.py

test_advZoneVirtualRouter
Success
0.02
test_vm_life_cycle.py

test_10_attachAndDetach_iso
Success
26.72
test_vm_life_cycle.py

test_09_expunge_vm
Success
125.18
test_vm_life_cycle.py

test_08_migrate_vm
Success
60.69
test_vm_life_cycle.py

test_07_restore_vm
Success
0.09
test_vm_life_cycle.py

test_06_destroy_vm
Success
5.08
test_vm_life_cycle.py

test_03_reboot_vm
Success
5.10
test_vm_life_cycle.py

test_02_start_vm
Success
20.16
test_vm_life_cycle.py

test_01_stop_vm
Success
10.10
test_vm_life_cycle.py

test_CreateTemplateWithDuplicateName
Success
231.12
test_templates.py

test_08_list_system_templates
Success
0.02
test_templates.py

test_07_list_public_templates
Success
0.02
test_templates.py

test_05_template_permissions
Success
0.04
test_templates.py

test_04_extract_template
Success
10.23
test_templates.py

test_03_delete_template
Success
5.07
test_templates.py

test_02_edit_template
Success
90.10
test_templates.py

test_01_create_template
Success
130.83
test_templates.py

test_10_destroy_cpvm
Success
261.59
test_ssvm.py

test_09_destroy_ssvm
Success
263.44
test_ssvm.py

test_08_reboot_cpvm
Success
186.36
test_ssvm.py

test_07_reboot_ssvm
Success
158.38
test_ssvm.py

test_06_stop_cpvm
Success
201.61
test_ssvm.py

test_05_stop_ssvm
Success
203.39
test_ssvm.py

test_04_cpvm_internals
Success
1.06
test_ssvm.py

test_03_ssvm_internals
Success
3.35
test_ssvm.py

test_02_list_cpvm_vm
Success
0.07
test_ssvm.py

test_01_list_sec_storage_vm
Success
0.08
test_ssvm.py

test_01_snapshot_root_disk
Success
61.13
test_snapshots.py

test_03_delete_service_offering
Success
0.03
test_service_offerings.py

test_02_edit_service_offering
Success
0.05
test_service_offerings.py

test_01_create_service_offering
Success
0.07
test_service_offerings.py

test_02_sys_template_ready
Success
0.08
test_secondary_storage.py

test_01_sys_vm_start
Success
0.12
test_secondary_storage.py

test_09_reboot_router
Success
170.77
test_routers.py

test_08_start_router
Success
130.81
test_routers.py

test_07_stop_router
Success
25.17
test_routers.py

test_06_router_advanced
Success
0.03
test_routers.py

test_05_router_basic
Success
0.03
test_routers.py

test_04_restart_network_wo_cleanup
Success
5.56
test_routers.py

test_03_restart_network_cleanup
Success
145.76
test_routers.py

test_02_router_internal_adv
Success
0.95
test_routers.py

test_01_router_internal_basic
Success
0.51
test_routers.py

test_router_dns_guestipquery
Success
77.41
test_router_dns.py

test_router_dns_externalipquery
Success
0.06
test_router_dns.py

test_router_dhcphosts
Success
143.95
test_router_dhcphosts.py

test_01_updatevolumedetail
Success
0.05
test_resource_detail.py

test_01_reset_vm_on_reboot
Success
55.36
test_reset_vm_on_reboot.py

test_createRegion
Success
0.03
test_regions.py

test_create_pvlan_network
Success
5.14
test_pvlan.py

test_dedicatePublicIpRange
Success
0.28
test_public_ip_range.py

test_02_vpc_privategw_static_routes
Success
650.70
test_privategw_acl.py

test_01_primary_storage_nfs
Success
36.03
test_primary_storage.py

test_createPortablePublicIPRange
Success
15.15
test_portable_publicip.py

test_createPortablePublicIPAcquire
Success
20.36
test_portable_publicip.py

test_UpdateStorageOverProvisioningFactor
Success
0.10
test_over_provisioning.py

test_oobm_multiple_mgmt_server_ownership
Success
12.54
test_outofbandmanagement.py

test_oobm_issue_power_status
Success
10.54
test_outofbandmanagement.py

test_oobm_issue_power_soft
Success
15.55
test_outofbandmanagement.py

test_oobm_issue_power_reset
Success
15.55
test_outofbandmanagement.py

test_oobm_issue_power_on
Success
15.56
test_outofbandmanagement.py

test_oobm_issue_power_off
Success
15.61
test_outofbandmanagement.py

test_oobm_issue_power_cycle
Success
15.58
test_outofbandmanagement.py

test_oobm_enabledisable_across_clusterzones
Success
53.15
test_outofbandmanagement.py

test_oobm_enable_feature_valid
Success
5.12
test_outofbandmanagement.py

test_oobm_enable_feature_invalid
Success
0.08
test_outofbandmanagement.py

test_oobm_disable_feature_valid
Success
0.14
test_outofbandmanagement.py

test_oobm_disable_feature_invalid
Success
0.08
test_outofbandmanagement.py

test_oobm_configure_invalid_driver
Success
0.07
test_outofbandmanagement.py

test_oobm_configure_default_driver
Success
0.07
test_outofbandmanagement.py

test_oobm_background_powerstate_sync
Success
13.53
test_outofbandmanagement.py

test_extendPhysicalNetworkVlan
Success
15.21
test_non_contigiousvlan.py

test_01_nic
Success
645.14
test_nic.py

test_releaseIP
Success
307.90
test_network.py

test_public_ip_user_account
Success
10.20
test_network.py

test_public_ip_admin_account
Success
40.18
test_network.py

test_delete_account
Success
247.37
test_network.py

test_nic_secondaryip_add_remove
Success
242.69
test_multipleips_per_nic.py

login_test_saml_user
Success
21.53
test_login.py

test_03_list_snapshots
Success
0.06
test_list_ids_parameter.py

test_02_list_templates
Success
0.03
test_list_ids_parameter.py

test_01_list_volumes
Success
0.02
test_list_ids_parameter.py

test_07_list_default_iso
Success
0.04
test_iso.py

test_05_iso_permissions
Success
0.09
test_iso.py

test_04_extract_Iso
Success
5.28
test_iso.py

test_03_delete_iso
Success
95.18
test_iso.py

test_02_edit_iso
Success
0.04
test_iso.py

test_01_create_iso
Success
21.24
test_iso.py

test_dedicateGuestVlanRange
Success
10.18
test_guest_vlan_range.py

test_UpdateConfigParamWithScope
Success
0.09
test_global_settings.py

test_rolepermission_lifecycle_update
Success
6.36
test_dynamicroles.py

test_rolepermission_lifecycle_list
Success
6.21
test_dynamicroles.py

test_rolepermission_lifecycle_delete
Success
6.21
test_dynamicroles.py

test_rolepermission_lifecycle_create
Success
6.17
test_dynamicroles.py

test_rolepermission_lifecycle_concurrent_updates
Success
6.23
test_dynamicroles.py

test_role_lifecycle_update_role_inuse
Success
6.17
test_dynamicroles.py

test_role_lifecycle_update
Success
11.23
test_dynamicroles.py

test_role_lifecycle_list
Success
6.16
test_dynamicroles.py

test_role_lifecycle_delete
Success
11.20
test_dynamicroles.py

test_role_lifecycle_create
Success
6.17
test_dynamicroles.py

test_role_inuse_deletion
Success
6.22
test_dynamicroles.py

test_role_account_acls_multiple_mgmt_servers
Success
7.51
test_dynamicroles.py

test_role_account_acls
Success
7.63
test_dynamicroles.py

test_default_role_deletion
Success
6.32
test_dynamicroles.py

test_04_create_fat_type_disk_offering
Success
0.04
test_disk_offerings.py

test_03_delete_disk_offering
Success
0.02
test_disk_offerings.py

test_02_edit_disk_offering
Success
0.03
test_disk_offerings.py

test_02_create_sparse_type_disk_offering
Success
0.04
test_disk_offerings.py

test_01_create_disk_offering
Success
0.07
test_disk_offerings.py

test_deployvm_userdispersing
Success
50.51
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userconcentrated
Success
105.75
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_firstfit
Success
196.06
test_deploy_vms_with_varied_deploymentplanners.py

test_deployvm_userdata_post
Success
25.33
test_deploy_vm_with_userdata.py

test_deployvm_userdata
Success
206.21
test_deploy_vm_with_userdata.py

test_02_deploy_vm_root_resize
Success
6.14
test_deploy_vm_root_resize.py

test_01_deploy_vm_root_resize
Success
6.15
test_deploy_vm_root_resize.py

test_00_deploy_vm_root_resize
Success
6.22
test_deploy_vm_root_resize.py

test_deploy_vm_from_iso
Success
187.23
test_deploy_vm_iso.py

test_DeployVmAntiAffinityGroup
Success
186.15
test_affinity_groups.py

test_08_resize_volume
Skipped
5.07
test_volumes.py

test_07_resize_fail
Skipped
10.18
test_volumes.py

test_06_copy_template
Skipped
0.00
test_templates.py

test_static_role_account_acls
Skipped
0.01
test_staticroles.py

test_01_primary_storage_iscsi
Skipped
0.02
test_primary_storage.py

test_06_copy_iso
Skipped
0.00
test_iso.py

test_deploy_vgpu_enabled_vm
Skipped
0.00
test_deploy_vgpu_enabled_vm.py

@karuturi @swill @wido @NuxRo @nvazquez we believe this PR is ready to merge.  However, we need to cross check the test results.  Would one (or more of you) be able to test this PR in order to move it forward?

@karuturi can you help run BVT tests on this PR?

@jburwell @rhtyd we're running tests with @serg38 and we got some errors, but we notice that failed_plus_exceptions and runinfo files are empty after tests finish. When we run individual tests this doesn't happen. It would be helpful for us to have those files so we can fix some things in our config and re-run tests. Did you have the same issue before?
We are running tests using this command:
nosetests --with-marvin --marvin-config=setup/dev/advanced.cfg -vv -s -a tags=advanced,required_hardware=true --hypervisor=vmware test/integration/smoke/*.py

@nvazquez thanks for the update, yes it's known issue that when running tests all at once it might cause issues. If you have a look at our Travis runner, we're running each test one at a time:
https://github.com/apache/cloudstack/blob/master/tools/travis/script.sh#L43
Trillian runs them one at a time as well, you may take some hints from Trillian's smoketest runner:
https://github.com/shapeblue/Trillian/blob/master/Ansible/roles/marvin/templates/smoketests.sh.j2#L70

Thanks! I'll post results when we can fix issues

@nvazquez @serg38 thank you for your help verifying the is PR.

The same results as 1692.  Overall much better state. We have still failure in execution of the following tests:
test_privategw_acl
test_routers_network_ops
test_vpc_redundant
test_vpc_router_nics
All of the failure seem to be either environmental or due to incorrect ACL order .
Also out-of-band management test give a lot of exceptions but this is as expected.
We had to make one change that I propose to include. In test_service_offereing.py line 389 switch from
range=20 to range=40 . In our tests variation in available RAM in CentOs was larger than 20 Mb so test_service_offereing fails.
Let's merge this !!!
Successful tests. RHEL 6 management server, advanced networking, Vmware 5.5/6 hypervisors
test DeployVM in anti-affinity groups for project ... === TestName: test_DeployVmAntiAffinityGroup_in_project | Status : SUCCESS ===
test DeployVM in anti-affinity groups ... === TestName: test_DeployVmAntiAffinityGroup | Status : SUCCESS ===
Test Deploy Virtual Machine from ISO ... === TestName: test_deploy_vm_from_iso | Status : SUCCESS ===
Test deploy virtual machine with root resize ... === TestName: test_00_deploy_vm_root_resize | Status : SUCCESS ===
Test proper failure to deploy virtual machine with rootdisksize of 0 ... === TestName: test_01_deploy_vm_root_resize | Status : SUCCESS ===
Test proper failure to deploy virtual machine with rootdisksize less than template size ... === TestName: test_02_deploy_vm_root_resize | Status : SUCCESS ===
Test to deploy vm with a first fit offering ... === TestName: test_deployvm_firstfit | Status : SUCCESS ===
Test deploy VMs using user concentrated planner ... === TestName: test_deployvm_userconcentrated | Status : SUCCESS ===
Test deploy VMs using user dispersion planner ... === TestName: test_deployvm_userdispersing | Status : SUCCESS ===
Test userdata as GET, size > 2k ... === TestName: test_deployvm_userdata | Status : SUCCESS ===
Test userdata as POST, size > 2k ... === TestName: test_deployvm_userdata_post | Status : SUCCESS ===
Test to create disk offering ... === TestName: test_01_create_disk_offering | Status : SUCCESS ===
Test to create  a sparse type disk offering ... === TestName: test_02_create_sparse_type_disk_offering | Status : SUCCESS ===
Test to create  a sparse type disk offering ... === TestName: test_04_create_fat_type_disk_offering | Status : SUCCESS ===
Test to update existing disk offering ... === TestName: test_02_edit_disk_offering | Status : SUCCESS ===
Test to delete disk offering ... === TestName: test_03_delete_disk_offering | Status : SUCCESS ===
test update configuration setting at zone level scope ... === TestName: test_UpdateConfigParamWithScope | Status : SUCCESS ===
Test guest vlan range dedication ... === TestName: test_dedicateGuestVlanRange | Status : SUCCESS ===
Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Single VPC ... === TestName: test_01_internallb_roundrobin_1VPC_3VM_HTTP_port80 | Status : SUCCESS ===
Test create, assign, remove of an Internal LB with roundrobin http traffic to 3 vm's in a Redundant VPC ... === TestName: test_02_internallb_roundrobin_1RVPC_3VM_HTTP_port80 | Status : SUCCESS ===
Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_03_vpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS ===
Test to verify access to loadbalancer haproxy admin stats page ... === TestName: test_04_rvpc_internallb_haproxy_stats_on_all_interfaces | Status : SUCCESS ===
Test create public & private ISO ... === TestName: test_01_create_iso | Status : SUCCESS ===
Test Edit ISO ... === TestName: test_02_edit_iso | Status : SUCCESS ===
Test delete ISO ... === TestName: test_03_delete_iso | Status : SUCCESS ===
Test for extract ISO ... === TestName: test_04_extract_Iso | Status : SUCCESS ===
Update & Test for ISO permissions ... === TestName: test_05_iso_permissions | Status : SUCCESS ===
Test delete ISO ... === TestName: test_07_list_default_iso | Status : SUCCESS ===
Test listing Volumes using 'ids' parameter ... === TestName: test_01_list_volumes | Status : SUCCESS ===
Test listing Templates using 'ids' parameter ... === TestName: test_02_list_templates | Status : SUCCESS ===
Test listing Snapshots using 'ids' parameter ... === TestName: test_03_list_snapshots | Status : SUCCESS ===
Test to create Load balancing rule with source NAT ... === TestName: test_01_create_lb_rule_src_nat | Status : SUCCESS ===
Test to create Load balancing rule with non source NAT ... === TestName: test_02_create_lb_rule_non_nat | Status : SUCCESS ===
Test for assign & removing load balancing rule ... === TestName: test_assign_and_removal_lb | Status : SUCCESS ===
Tests that SAML users are not allowed CloudStack local log in ... === TestName: login_test_saml_user | Status : SUCCESS ===
test_nic_secondaryip_add_remove (integration.smoke.test_multipleips_per_nic.TestDeployVM) ... === TestName: test_nic_secondaryip_add_remove | Status : SUCCESS ===
Test network ACL lists and items in VPC ... === TestName: test_network_acl | Status : SUCCESS ===
Test for delete account ... === TestName: test_delete_account | Status : SUCCESS ===
Test for port forwarding on source NAT ... === TestName: test_01_port_fwd_on_src_nat | Status : SUCCESS ===
Test for port forwarding on non source NAT ... === TestName: test_02_port_fwd_on_non_src_nat | Status : SUCCESS ===
Test for Associate/Disassociate public IP address for admin account ... === TestName: test_public_ip_admin_account | Status : SUCCESS ===
Test for Associate/Disassociate public IP address for user account ... === TestName: test_public_ip_user_account | Status : SUCCESS ===
Test for reboot router ... === TestName: test_reboot_router | Status : SUCCESS ===
Test for release public IP address ... === TestName: test_releaseIP | Status : SUCCESS ===
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_1_static_nat_rule | Status : SUCCESS ===
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_2_nat_rule | Status : SUCCESS ===
Test for Router rules for network rules on acquired public IP ... === TestName: test_network_rules_acquired_public_ip_3_Load_Balancer_Rule | Status : SUCCESS ===
Test to change service offering for instances with vm snapshots ... === TestName: test_04_change_service_offering_for_vm_with_snapshots | Status : SUCCESS ===
Test to add and update added nic to a virtual machine ... === TestName: test_01_nic | Status : SUCCESS ===
Test to update a physical network and extend its vlan ... === TestName: test_extendPhysicalNetworkVlan | Status : SUCCESS ===
test update configuration setting at storage scope ... === TestName: test_UpdateStorageOverProvisioningFactor | Status : SUCCESS ===
Check the password file in the Router VM ... === TestName: test_isolate_network_password_server | Status : SUCCESS ===
Test to acquire a provisioned public ip range ... === TestName: test_createPortablePublicIPAcquire | Status : SUCCESS ===
Test to create a portable public ip range ... === TestName: test_createPortablePublicIPRange | Status : SUCCESS ===
Test primary storage pools - XEN, KVM, VMWare. Not Supported for hyperv ... === TestName: test_01_primary_storage_nfs | Status : SUCCESS ===
test_01_vpc_privategw_acl (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_01_vpc_privategw_acl | Status : SUCCESS ===
Test public IP range dedication ... === TestName: test_dedicatePublicIpRange | Status : SUCCESS ===
test_create_pvlan_network (integration.smoke.test_pvlan.TestPVLAN) ... === TestName: test_create_pvlan_network | Status : SUCCESS ===
Test for create region ... === TestName: test_createRegion | Status : SUCCESS ===
Test reset virtual machine on reboot ... === TestName: test_01_reset_vm_on_reboot | Status : SUCCESS ===
Test volume detail ... === TestName: test_01_updatevolumedetail | Status : SUCCESS ===
Check that the /etc/dhcphosts.txt doesn't contain duplicate IPs ... === TestName: test_router_dhcphosts | Status : SUCCESS ===
Checks that non-guest network IPs cannot access VR DNS ... === TestName: test_router_dns_externalipquery | Status : SUCCESS ===
Checks that guest VM can query VR DNS ... === TestName: test_router_dns_guestipquery | Status : SUCCESS ===
Test iptables default INPUT/FORWARD policy on RouterVM ... === TestName: test_02_routervm_iptables_policies | Status : SUCCESS ===
Test iptables default INPUT/FORWARD policies on VPC router ... === TestName: test_01_single_VPC_iptables_policies | Status : SUCCESS ===
Test redundant router internals ... === TestName: test_01_isolate_network_FW_PF_default_routes_egress_true | Status : SUCCESS ===
Test redundant router internals ... === TestName: test_01_RVR_Network_FW_PF_SSH_default_routes_egress_true | Status : SUCCESS ===
Test router internal basic zone ... === TestName: test_01_router_internal_basic | Status : SUCCESS ===
Test router internal advanced zone ... === TestName: test_02_router_internal_adv | Status : SUCCESS ===
Test restart network ... === TestName: test_03_restart_network_cleanup | Status : SUCCESS ===
Test restart network without cleanup ... === TestName: test_04_restart_network_wo_cleanup | Status : SUCCESS ===
Test router basic setup ... === TestName: test_05_router_basic | Status : SUCCESS ===
Test router advanced setup ... === TestName: test_06_router_advanced | Status : SUCCESS ===
Test stop router ... === TestName: test_07_stop_router | Status : SUCCESS ===
Test start router ... === TestName: test_08_start_router | Status : SUCCESS ===
Test reboot router ... === TestName: test_09_reboot_router | Status : SUCCESS ===
Test system VM start ... === TestName: test_01_sys_vm_start | Status : SUCCESS ===
Test system templates are ready ... === TestName: test_02_sys_template_ready | Status : SUCCESS ===
Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS ===
Test to update existing service offering ... === TestName: test_02_edit_service_offering | Status : SUCCESS ===
Test to delete service offering ... === TestName: test_03_delete_service_offering | Status : SUCCESS ===
Test to change service to a small capacity ... === TestName: test_04_change_offering_small | Status : SUCCESS ===
Test to create service offering ... === TestName: test_01_create_service_offering | Status : SUCCESS ===
Test to update existing service offering ... === TestName: test_02_edit_service_offering | Status : SUCCESS ===
Test to delete service offering ... === TestName: test_03_delete_service_offering | Status : SUCCESS ===
Test to change service to a small capacity ... === TestName: test_04_change_offering_small | Status : SUCCESS ===
Test Snapshot Root Disk ... === TestName: test_01_snapshot_root_disk | Status : SUCCESS ===
Test List secondary storage VMs ... === TestName: test_01_list_sec_storage_vm | Status : SUCCESS ===
Test List console proxy VMs ... === TestName: test_02_list_cpvm_vm | Status : SUCCESS ===
Test SSVM Internals ... === TestName: test_03_ssvm_internals | Status : SUCCESS ===
Test CPVM Internals ... === TestName: test_04_cpvm_internals | Status : SUCCESS ===
Test stop SSVM ... === TestName: test_05_stop_ssvm | Status : SUCCESS ===
Test stop CPVM ... === TestName: test_06_stop_cpvm | Status : SUCCESS ===
Test reboot SSVM ... === TestName: test_07_reboot_ssvm | Status : SUCCESS ===
Test reboot CPVM ... === TestName: test_08_reboot_cpvm | Status : SUCCESS ===
Test destroy SSVM ... === TestName: test_09_destroy_ssvm | Status : SUCCESS ===
Test destroy CPVM ... === TestName: test_10_destroy_cpvm | Status : SUCCESS ===
Tests allowed APIs for common account types ... === TestName: test_static_role_account_acls | Status : SUCCESS ===
Test create public & private template ... === TestName: test_01_create_template | Status : SUCCESS ===
Test when createTemplate is used to create templates having the same name all of them get ... === TestName: test_CreateTemplateWithDuplicateName | Status : SUCCESS ===
Test Edit template ... === TestName: test_02_edit_template | Status : SUCCESS ===
Test delete template ... === TestName: test_03_delete_template | Status : SUCCESS ===
Test for extract template ... === TestName: test_04_extract_template | Status : SUCCESS ===
Update & Test for template permissions ... === TestName: test_05_template_permissions | Status : SUCCESS ===
Test only public templates are visible to normal user ... === TestName: test_07_list_public_templates | Status : SUCCESS ===
Test System templates are not visible to normal user ... === TestName: test_08_list_system_templates | Status : SUCCESS ===
Test advanced zone virtual router ... === TestName: test_advZoneVirtualRouter | Status : SUCCESS ===
Test Deploy Virtual Machine ... === TestName: test_deploy_vm | Status : SUCCESS ===
Test Multiple Deploy Virtual Machine ... === TestName: test_deploy_vm_multiple | Status : SUCCESS ===
Test Stop Virtual Machine ... === TestName: test_01_stop_vm | Status : SUCCESS ===
Test Start Virtual Machine ... === TestName: test_02_start_vm | Status : SUCCESS ===
Test Reboot Virtual Machine ... === TestName: test_03_reboot_vm | Status : SUCCESS ===
Test destroy Virtual Machine ... === TestName: test_06_destroy_vm | Status : SUCCESS ===
Test recover Virtual Machine ... === TestName: test_07_restore_vm | Status : SUCCESS ===
Test migrate VM ... === TestName: test_08_migrate_vm | Status : SUCCESS ===
Test destroy(expunge) Virtual Machine ... === TestName: test_09_expunge_vm | Status : SUCCESS ===
Test for attach and detach ISO to virtual machine ... === TestName: test_10_attachAndDetach_iso | Status : SUCCESS ===
@Desc: Test that Volume snapshot for root volume is not allowed ... === TestName: test_01_test_vm_volume_snapshot | Status : SUCCESS ===
Test to create VM snapshots ... === TestName: test_01_create_vm_snapshots | Status : SUCCESS ===
Test to revert VM snapshots ... === TestName: test_02_revert_vm_snapshots | Status : SUCCESS ===
Test to delete vm snapshots ... === TestName: test_03_delete_vm_snapshots | Status : SUCCESS ===
Test Volume creation for all Disk Offerings (incl. custom) ... === TestName: test_01_create_volume | Status : SUCCESS ===
Attach a created Volume to a Running VM ... === TestName: test_02_attach_volume | Status : SUCCESS ===
Download a Volume attached to a VM ... === TestName: test_03_download_attached_volume | Status : SUCCESS ===
Delete a Volume attached to a VM ... === TestName: test_04_delete_attached_volume | Status : SUCCESS ===
Detach a Volume attached to a VM ... === TestName: test_05_detach_volume | Status : SUCCESS ===
Download a Volume unattached to an VM ... === TestName: test_06_download_detached_volume | Status : SUCCESS ===
Delete a Volume unattached to an VM ... === TestName: test_09_delete_detached_volume | Status : SUCCESS ===
Create a redundant VPC with two networks with two VMs in each network and check default routes ... === TestName: test_02_redundant_VPC_default_routes | Status : SUCCESS ===
Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_03_create_redundant_VPC_1tier_2VMs_2IPs_2PF_ACL_reboot_routers | Status : SUCCESS ===
Create a VPC with two networks with one VM in each network and test default routes ... === TestName: test_02_VPC_default_routes | Status : SUCCESS ===
Test Site 2 Site VPN Across redundant VPCs ... === TestName: test_01_redundant_vpc_site2site_vpn | Status : SUCCESS ===
Test Remote Access VPN in VPC ... === TestName: test_01_vpc_remote_access_vpn | Status : SUCCESS ===
Test Site 2 Site VPN Across VPCs ... === TestName: test_01_vpc_site2site_vpn | Status : SUCCESS ===

Failed tests
test_02_vpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_02_vpc_privategw_static_routes | Status : FAILED ===
test_03_vpc_privategw_restart_vpc_cleanup (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_03_vpc_privategw_restart_vpc_cleanup | Status : FAILED ===
test_04_rvpc_privategw_static_routes (integration.smoke.test_privategw_acl.TestPrivateGwACL) ... === TestName: test_04_rvpc_privategw_static_routes | Status : FAILED ===
Test redundant router internals ... === TestName: test_02_isolate_network_FW_PF_default_routes_egress_false | Status : FAILED ===
Create a redundant VPC with two networks with two VMs in each network ... === TestName: test_01_create_redundant_VPC_2tiers_4VMs_4IPs_4PF_ACL | Status : FAILED ===
Create a VPC with two networks with one VM in each network and test nics after destroy ... === TestName: test_01_VPC_nics_after_destroy | Status : FAILED ===

Exceptions:
Tests out-of-band management background powerstate sync ... === TestName: test_oobm_background_powerstate_sync | Status : EXCEPTION ===
Tests out-of-band management configuration with valid data ... === TestName: test_oobm_configure_default_driver | Status : EXCEPTION ===
Tests out-of-band management configuration with invalid driver ... === TestName: test_oobm_configure_invalid_driver | Status : EXCEPTION ===
Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_invalid | Status : EXCEPTION ===
Tests out-of-band management host disable feature with ... === TestName: test_oobm_disable_feature_valid | Status : EXCEPTION ===
Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_invalid | Status : EXCEPTION ===
Tests out-of-band management host enable feature with ... === TestName: test_oobm_enable_feature_valid | Status : EXCEPTION ===
Tests out-of-band management enable/disable feature at cluster ... === TestName: test_oobm_enabledisable_across_clusterzones | Status : EXCEPTION ===
Tests out-of-band management issue power cycle action ... === TestName: test_oobm_issue_power_cycle | Status : EXCEPTION ===
Tests out-of-band management issue power off action ... === TestName: test_oobm_issue_power_off | Status : EXCEPTION ===
Tests out-of-band management issue power on action ... === TestName: test_oobm_issue_power_on | Status : EXCEPTION ===
Tests out-of-band management issue power reset action ... === TestName: test_oobm_issue_power_reset | Status : EXCEPTION ===
Tests out-of-band management issue power soft action ... === TestName: test_oobm_issue_power_soft | Status : EXCEPTION ===
Tests out-of-band management issue power action ... === TestName: test_oobm_issue_power_status | Status : EXCEPTION ===
Tests out-of-band management ownership expiry across multi-mgmt server ... === TestName: test_oobm_multiple_mgmt_server_ownership | Status : EXCEPTION ===
Tests out-of-band management change password feature ... === TestName: test_oobm_zchange_password

Thanks all for your review, tests. Fwd merge did not automatically close this PR, so closing this manually.

authors: blueorangutan jburwell nvazquez rhtyd serg38


text:
CLOUDSTACK-9716: Change of network to rvr for baremetal caused vm deployment to get stuck

Refer to CLOUDSTACK-9716 for more details

@harikrishna-patnala, @sadhugit Can you please review?

@rashmidixit Could you add a marvin test case? It looks with your changes, master VR Redundant state will be stuck in unknown state.

PR #1990 already covers this change. @SudharmaJain @priyankparihar Can you please review #1990.
Thanks @harikrishna-patnala for the review.
Closing this PR since its already covered.

source: gharchive/pull-request

authors: SudharmaJain rashmidixit

repo: apache/cloudstack

license_type: permissive

license_source: github-api