This is an exercise to extract unsupported tests  on simulator from the existing smoke and regression integration test suites.

Here is the list of automated smoke/BVT/sanity tests which needs to be reviewed. There is a column 'type' added with the following values

  1. self service
  2. provisioning
  3. unsupported
  4. test issue
  5. Not Run -skipped test
  • skipped tests need to be run manually.
  • test issues need to be fixed an re run.

BVT Report - advanced zone:

 

Sl. No.test casestatusError DescriptionTypeComment
1test_DeployVmAntiAffinityGroupPASSEDNoneself service

                                                                                                                                                                                                                                                             

2test_deploy_vmPASSEDNoneself service 
3test_deployvm_userdataPASSEDNoneprovisioning

[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning.

Talluri/Koushik Fix the test to verify userdata

4test_deployvm_userdata_postPASSEDNoneprovisioning

[ Koushik ] This looks same as #2 unless user data is verified. For verification you need actual setup. So this should belong to provisioning.

Talluri/Koushik Fix the test to verify userdata

5test_deployvm_firstfitPASSEDNoneself service 
6test_deployvm_userconcentratedPASSEDNoneself service 
7test_deployvm_userdispersingPASSEDNoneself service 
8test_01_create_disk_offeringPASSEDNoneself service 
9test_02_edit_disk_offeringPASSEDNoneself service 
10test_03_delete_disk_offeringPASSEDNoneself service 
11test_UpdateConfigParamWithScopePASSEDNoneself service 
12test_dedicateGuestVlanRangePASSEDNoneself service 
13test_internallbPASSEDNoneprovisioningEnhancement: modify this test to verify lb rules by sending request from another tier
14test_01_create_isoPASSEDNoneself serviceEnhancement: check the existence of registered of ISO in secondary deploy a VM with registered ISO. can be added as another test (provisioning)
15test_02_edit_isoPASSEDNoneself service 
16test_03_delete_isoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}self serviceRajani: this can be fixed by implementing deleteAsync in SimulatorImageStoreDriverImpl.java (Fixed this locally. will push after more testing)
17test_04_extract_IsoFAILEDExtract ISO Failed with invalid URL http://192.168.2.3/userdata/9a95de36-9645-40c1-b473-f6665bb9a4f0.iso (ISO id: 297135cd-020a-47cb-ae0d-efb970876eee)provisioningThis test can be modified for simulator not to download using URL
18test_05_iso_permissionsPASSEDNoneself service 
19test_06_copy_isoSKIPPEDNoneprovisioningdestination zone needs to extract the template URL
20test_01_create_lb_rule_src_natFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8provisioning

 avoid ssh connection

21test_02_create_lb_rule_non_natFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8: SSH failed for VM with IP Address: 192.168.2.8provisioning avoid ssh connection
22test_assign_and_removal_lbFAILEDConnection Failed: SSH failed for VM with IP Address: 192.168.2.8provisioning avoid ssh connection
23test_nic_secondaryip_add_removePASSEDNoneprovisioningEnhancement: add verification
24test_delete_accountPASSEDNoneself service 
25test_01_port_fwd_on_src_natFAILEDSSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
26test_02_port_fwd_on_non_src_natFAILEDSSH Access failed for 10.1.1.56: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
27test_public_ip_admin_accountPASSEDNoneself service 
28test_public_ip_user_accountPASSEDNoneself service 
29test_reboot_routerFAILEDSSH Access failed for 192.168.2.5: Connection Failedprovisioning avoid ssh connection
30test_releaseIPPASSEDNoneself service 
31test_network_aclPASSEDNoneprovisioning

[ Koushik ] Is it just testing creation of acl on the db? For verifying if the acl is working you need actual setup. In that case this will be provisioning.

Enhancement: add actual verification Logic for rules.

32test_01_nicPASSEDNoneprovisioningEnhancement: add validation
33test_extendPhysicalNetworkVlanPASSEDNoneself service 
34test_createPortablePublicIPAcquirePASSEDNoneself service 
35test_createPortablePublicIPRangePASSEDNoneself service 
36test_01_primary_storage_iscsiPASSED

None

self servicein actual VM deployment scenarios storage will be tested.
37test_01_primary_storage_nfsPASSEDNoneself servicein actual VM deployment scenarios storage will be tested.
38test_privategw_aclPASSEDNoneself serviceEnhancement: add a new test to verification of ACL rules
39test_dedicatePublicIpRangePASSEDNoneself service 
40test_create_pvlan_networkPASSEDNoneself service 
41test_createRegionPASSEDNoneself service 
42test_01_reset_vm_on_rebootPASSEDNoneself serviceEnhancement: add new test to check volume contents
43test_01_updatevolumedetailPASSEDNoneself service 
44test_01_router_internal_basicSKIPPEDNoneprovisioning[ Koushik ] This test ssh to the router
45test_02_router_internal_advSKIPPEDNoneprovisioning[ Koushik ] This test ssh to the router
46test_03_restart_network_cleanupPASSEDNoneself service 
47test_04_restart_network_wo_cleanupSKIPPEDNoneprovisioningneed access to host
48test_05_router_basicPASSEDNoneself service 
49test_06_router_advancedPASSEDNoneself service 
50test_07_stop_routerPASSEDNoneself service 
51test_08_start_routerPASSEDNoneself service 
52test_09_reboot_routerPASSEDNoneself service 
53test_01_scale_vmFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}provisioning[ Koushik ] There is HV specific check in CS code and so fails for HV type 'Simulator'. For now run as provisioning test.
54test_01_sys_vm_startPASSEDNoneself service 
55test_02_sys_template_readyPASSEDNoneself service 
56test_01_create_service_offeringPASSEDNoneself service 
57test_02_edit_service_offeringPASSEDNoneself service 
58test_03_delete_service_offeringPASSEDNoneself service 
59test_04_change_offering_smallFAILEDSSH Access failed for 10.1.1.130: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning avoid ssh connection
60test_01_snapshot_root_diskFAILED'simulator'provisioningTest script needs to be changed for simulator to avoid checking the existence of snapshot on secondary
61test_01_list_sec_storage_vmPASSEDNoneself service 
62test_02_list_cpvm_vmPASSEDNoneself service 
63test_03_ssvm_internalsSKIPPEDNoneprovisioning[ Koushik ] Based on similar test cases for router
64test_04_cpvm_internalsSKIPPEDNoneprovisioning[ Koushik ] Based on similar test cases for router
65test_05_stop_ssvmSKIPPEDNoneprovisioningactually doing a stop and then a start. then calls test_ssvm_internals()
66test_06_stop_cpvmSKIPPEDNoneprovisioningdo
67test_07_reboot_ssvmSKIPPEDNoneprovisioningdo
68test_08_reboot_cpvmSKIPPEDNoneprovisioningdo
69test_09_destroy_ssvmSKIPPEDNoneprovisioningdo
70test_10_destroy_cpvmSKIPPEDNoneprovisioningdo
71test_01_create_templateFAILEDWarning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}self service

Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.

[ Koushik ] Rajani fixed the simulator for this

72test_02_edit_templatePASSEDNoneself service 
73test_03_delete_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}self service

Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.

[ Koushik ] Rajani fixed the simulator for this

74test_04_extract_templateFAILEDExtract Template Failed with invalid URL http://192.168.2.3/userdata/d408cfd8-bf7f-47ef-9aa0-84c353d24221.raw (template id: 31ea9fe5-3a0b-4425-b4ca-7aa9e0695605)

provisioning

 

This test can be modified for simulator not to download using URL
75test_05_template_permissionsPASSEDNoneself service 
76test_06_copy_templateSKIPPEDNoneprovisioningdestination zone needs to extract the template URL
77test_07_list_public_templatesPASSEDNoneself service 
78test_08_list_system_templatesPASSEDNoneself service 
79test_advZoneVirtualRouterPASSEDNoneNAduplicate test, remove it
80test_deploy_vmPASSEDNoneself service

{Koushik}Is this a duplicate of #2

Can be removed since it is covered in test_vm_life_cycle.py

81test_01_stop_vmPASSEDNoneself service 
82test_02_start_vmPASSEDNoneself service 
83test_03_reboot_vmPASSEDNoneself service 
84test_06_destroy_vmPASSEDNoneself service 
85test_07_restore_vmPASSEDNoneself serviceEnhancement: add another test the data on the restored VM.
86test_08_migrate_vmPASSEDNoneself service 
87test_09_expunge_vmPASSEDNoneself service 
88test_10_attachAndDetach_isoFAILEDSSH failed for virtual machine: 10.1.1.62 - SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 avoid ssh connection
89test_01_create_vm_snapshotsFAILEDSSH failed for Virtual machine: 10.1.1.44

provisioning

 avoid ssh connection
90test_02_revert_vm_snapshotsFAILEDSSH failed for Virtual machine: 10.1.1.44

provisioning

 avoid ssh connection
91test_03_delete_vm_snapshotsFAILEDCheck list response returns a valid list

provisioning

 
92test_01_create_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

{Koushik} Rajani fixed simulator for this

test does SSH connection, Hence, marking it as provisioning

93test_02_attach_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

test does SSH connection, Hence, marking it as provisioning

94test_03_download_attached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing

test is checking that downloading an attached volume fails

95test_04_delete_attached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
96test_05_detach_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
97test_06_download_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing
98test_07_resize_failFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
99test_08_resize_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

attach volume is failing

Enhancement: check the resized volume on the backend if it has actually been resized.

100test_09_delete_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attach volume is failing
101test_vpc_remote_access_vpnFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 31 on domR: r-9-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

vpn user creation is failing

{Koushik} Rajani fixed simulator for this

102test_vpc_site2site_vpnPASSEDNoneself service 

Self Service tests: 63

Provisioning tests: 38

Total no. of existing automated tests for advanced zone: 118

Test Report Analysis:

29 out of 102 smoke tests failed.

Unsupported commands:

  1. create vpn users. [ com.cloud.agent.api.routing.VpnUsersCfgCommand ]
  2. delete ISO- Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
  3. delete Template -Delete template/ISO is eventually removing the entry from DB but errors out while trying to delete it from backend.
  4. AttachVolumeCmd

    java.lang.NullPointerException

        at com.cloud.hypervisor.dao.HypervisorCapabilitiesDaoImpl.getMaxDataVolumesLimit(HypervisorCapabilitiesDaoImpl.java:90)

  5. extract template.
  6. scale VM

 

Regression test report -Advanced Zone:

Here is the list of automated regression tests which needs to be reviewed. There is a column 'type' added with the following values

  1. self service
  2. provisioning
  3. unsupported
  4. test issue
  5. Not Run -skipped test
  • skipped tests need to be run manually.
  • test issues need to be fixed an re run.

Sl. No.

test case

status

Error Description

Type

Comment

1

test_01_create_account

PASSED

None

self service

 

2

test_01_add_vm_to_subdomain

PASSED

None

self service

 

3

test_DeleteDomain

PASSED

None

self service

 

4

test_forceDeleteDomain

PASSED

None

self service

 

5

test_01_non_root_admin_Privileges

PASSED

None

self service

 

6

test_01_user_remove_VM_running

PASSED

None

self service

 

7

test_01_service_offering_hierarchy

PASSED

None

self service

 

8

test_01_service_offering_siblings

PASSED

None

self service

 

9

ContextSuite context=TestTemplateHierarchy>:setup

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

expand this test to all dependent tests

10

test_updateAdminDetails

PASSED

None

self service

 

11

test_updateDomainAdminDetails

PASSED

None

self service

 

12

test_updateUserDetails

PASSED

None

self service

 

13

test_LoginApiDomain

PASSED

None

self service

 

14

test_LoginApiUuidResponse

PASSED

None

self service

 

15

ContextSuite context=TestAddNetworkToVirtualMachine>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

16

ContextSuite context=TestFailureScenariosAddNetworkToVM>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

17

ContextSuite context=TestFailureScenariosRemoveNicFromVM>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

18

ContextSuite context=TestFailureScenariosUpdateVirtualMachineNIC>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

19

ContextSuite context=TestRemoveNetworkFromVirtualMachine>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

20

ContextSuite context=TestUpdateVirtualMachineNIC>:setup

SKIPPED

None

Not Run

add remove network to VM is supported on all hypervisor. Modify this test not to skip based on hypervisor

21

test_01_deploy_vm_another_user

PASSED

None

self service

 

22

test_02_create_aff_grp_user

PASSED

None

self service

 

23

test_03_list_aff_grp_all_users

PASSED

None

self service

 

24

test_04_list_all_admin_aff_grp

PASSED

None

self service

 

25

test_05_list_all_users_aff_grp

PASSED

None

self service

 

26

test_06_list_all_users_aff_grp_by_id

PASSED

None

self service

 

27

test_07_delete_aff_grp_of_other_user

PASSED

None

self service

 

28

test_01_admin_create_aff_grp

PASSED

None

self service

 

29

test_02_doadmin_create_aff_grp

PASSED

None

self service

 

30

test_03_user_create_aff_grp

PASSED

None

self service

 

31

test_04_user_create_aff_grp_existing_name

PASSED

None

self service

 

32

test_05_create_aff_grp_same_name_diff_acc

PASSED

None

self service

 

33

test_06_create_aff_grp_nonexisting_type

PASSED

None

self service

 

34

test_01_delete_aff_grp_by_name

PASSED

None

self service

 

35

test_02_delete_aff_grp_for_acc

PASSED

None

self service

 

36

test_03_delete_aff_grp_with_vms

PASSED

None

self service

 

37

test_05_delete_aff_grp_id

PASSED

None

self service

 

38

test_06_delete_aff_grp_name

PASSED

None

self service

 

39

test_08_delete_aff_grp_by_id

PASSED

None

self service

 

40

test_09_delete_aff_grp_root_admin

PASSED

None

self service

 

41

test_01_deploy_vm_without_aff_grp

PASSED

None

self service

 

42

test_02_deploy_vm_by_aff_grp_name

PASSED

None

self service

 

43

test_03_deploy_vm_by_aff_grp_id

PASSED

None

self service

 

44

test_04_deploy_vm_anti_affinity_group

PASSED

None

self service

 

45

test_05_deploy_vm_by_id

PASSED

None

self service

 

46

test_06_deploy_vm_aff_grp_of_other_user_by_name

PASSED

None

self service

 

47

test_07_deploy_vm_aff_grp_of_other_user_by_id

PASSED

None

self service

 

48

test_08_deploy_vm_multiple_aff_grps

PASSED

None

self service

 

49

test_09_deploy_vm_multiple_aff_grps

PASSED

None

self service

 

50

test_10_deploy_vm_by_aff_grp_name_and_id

PASSED

None

self service

 

51

test_01_list_aff_grps_for_vm

PASSED

None

self service

 

52

test_02_list_multiple_aff_grps_for_vm

PASSED

None

self service

 

53

test_03_list_aff_grps_by_id

PASSED

None

self service

 

54

test_04_list_aff_grps_by_name

PASSED

None

self service

 

55

test_05_list_aff_grps_by_non_existing_id

PASSED

None

self service

 

56

test_06_list_aff_grps_by_non_existing_name

PASSED

None

self service

 

57

test_07_list_all_vms_in_aff_grp

PASSED

None

self service

 

58

test_01_update_aff_grp_by_ids

PASSED

None

self service

 

59

test_02_update_aff_grp_by_names

PASSED

None

self service

 

60

test_03_update_aff_grp_for_vm_with_no_aff_grp

PASSED

None

self service

 

61

test_04_update_aff_grp_remove_all

SKIPPED

None

Not Run

 

62

test_05_update_aff_grp_on_running_vm

PASSED

None

self service

 

63

test_01_zones

PASSED

None

self service

 

64

test_02_pods

PASSED

None

self service

 

65

test_03_clusters

PASSED

None

self service

 

66

test_04_hosts

PASSED

None

self service

 

67

test_05_storage_pools

PASSED

None

self service

 

68

test_06_secondary_storage

FAILED

Secondary storage should be in Up state

self service

We might need to fix simulator

69

test_01_move_across_different_domains

PASSED

None

self service

 

70

test_02_move_across_subdomains

PASSED

None

self service

 

71

test_03_move_from_domain_to_subdomain

PASSED

None

self service

 

72

test_04_move_from_domain_to_sub_of_subdomain

PASSED

None

self service

 

73

test_05_move_to_domain_from_sub_of_subdomain

PASSED

None

self service

 

74

test_06_move_to_domain_from_subdomain

PASSED

None

self service

 

75

test_07_move_across_subdomain

PASSED

None

self service

 

76

test_08_move_across_subdomain_network_create

PASSED

None

self service

 

77

test_09_move_across_subdomain

PASSED

None

self service

 

78

test_10_move_across_subdomain_vm_running

PASSED

None

self service

 

79

test_11_move_across_subdomain_vm_pfrule

PASSED

None

self service

 

80

test_12_move_across_subdomain_vm_volumes

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

attachVolume

{Koushik}Fixed by Rajani

81

test_13_move_across_subdomain_vm_snapshot

PASSED

None

self service

 

82

test_14_move_across_subdomain_vm_project

PASSED

None

self service

 

83

test_15_move_across_subdomain_account_limit

PASSED

None

self service

 

84

test_16_move_across_subdomain_volume_and_account_limit

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

{Koushik}Fixed by Rajani

85

test_01_deploy_instance_with_is_volatile_offering

PASSED

None

self service

 

86

test_02_reboot_instance_with_is_volatile_offering

PASSED

None

self service

 

87

test_03_restore_vm_with_new_template

PASSED

None

self service

 

88

test_04_reoccuring_snapshot_rules

FAILED

Exception not raised

self service

Possible bug in CS.ReRun and validate

89

test_01_firewall_rules_port_fw

PASSED

None

self service

Add more tests to actually verify the rules on the router

90

test_01_restart_network_cleanup

PASSED

None

self service

 

91

test_01_list_routers_admin

PASSED

None

self service

 

92

test_01_create_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

 

93

test_01_check_template_size

FAILED

Template instance has no attribute 'size'

provisioning

 

94

test_02_check_size_snapshotTemplate

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

Rerun

95

test_03_reuse_template_name

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

Rerun

96

test_01_multiple_core_vm_start_stop_instance

PASSED

None

self service

 

97

test_02_multiple_core_vm_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

98

test_03_multiple_core_vm_delete_instance

PASSED

None

self service

 

99

test_04_deploy_multiple_vm_with_multiple_core

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

self service

{Koushik}There looks some typo here. The test name and reason failure doesn't match.

Modify the test not to unnecessary migration

100

test_01_multiple_child_domains

PASSED

None

self service

 

101

test_01_multiplecore_start_stop_instance

PASSED

None

self service

 

102

test_02_multiplecore_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

103

test_03_multiplecore_delete_instance

PASSED

None

self service

 

104

test_04_deploy_multiple_vm_with_multiple_cpus

PASSED

None

self service

lets rename this test which is same as #108

105

test_01_stop_start_instance

PASSED

None

self service

 

106

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

{Koushik}This is again HV specific check in code and so fails for 'Simulator' HV type

107

test_03_delete_instance

PASSED

None

self service

 

108

test_04_deploy_multiple_vm_with_multiple_cpus

SKIPPED

None

provisioning

{Koushik}Atleast the test name suggest that this should be self service.

marking it as provisioning test as it needs vm migration

109

test_01_deploy_vm_domain_limit_reached

PASSED

None

self service

 

110

test_02_deploy_vm_account_limit_reached

PASSED

None

self service

 

111

test_03_deploy_vm_project_limit_reached

PASSED

None

self service

 

112

test_04_deployVm__account_limit_reached

PASSED

None

self service

 

113

test_01_project_counts_start_stop_instance

PASSED

None

self service

 

114

test_02_project_counts_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

115

test_03_project_counts_delete_instance

PASSED

None

self service

 

116

test_01_custom_hostname_instancename_false

PASSED

None

self service

 

117

test_01_user_provided_hostname

SKIPPED

None

self service

depends on vm.instancename.flag

118

test_02_instancename_from_default_configuration

SKIPPED

None

self service

{Koushik}Atleast the test name suggest that this should be self service.

119

test_03_duplicate_name

SKIPPED

None

self service

{Koushik}Atleast the test name suggest that this should be self service.

120

test_04_edit_display_name

PASSED

None

self service

 

121

test_05_unsupported_chars_in_display_name

PASSED

None

self service

 

122

test_deployvm_userdata_post

FAILED

No JSON object could be decoded

provisioning

we need to add some validation on router

123

test_01_1_egress_fr1

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

124

test_01_egress_fr1

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

125

test_02_1_egress_fr2

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

126

test_02_egress_fr2

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

127

test_03_1_egress_fr3

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

128

test_03_egress_fr3

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

129

test_04_1_egress_fr4

PASSED

None

self service

 

130

test_04_egress_fr4

PASSED

None

self service

 

131

test_05_1_egress_fr5

SKIPPED

None

Not Run

WIP -Test is incomplete

132

test_05_egress_fr5

SKIPPED

None

Not Run

WIP -Test is incomplete

133

test_06_1_egress_fr6

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

134

test_06_egress_fr6

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

135

test_07_1_egress_fr7

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

136

test_07_egress_fr7

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

137

test_08_1_egress_fr8

SKIPPED

None

Not Run

WIP -Test is incomplete

138

test_08_egress_fr8

SKIPPED

None

Not Run

WIP -Test is incomplete

139

test_09_1_egress_fr9

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

140

test_09_egress_fr9

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

141

test_10_1_egress_fr10

PASSED

None

self service

 

142

test_10_egress_fr10

PASSED

None

self service

 

143

test_11_1_egress_fr11

PASSED

None

self service

 

144

test_11_egress_fr11

PASSED

None

self service

 

145

test_12_1_egress_fr12

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

146

test_12_egress_fr12

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

147

test_13_1_egress_fr13

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

148

test_13_egress_fr13

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

149

test_01_deploy_vm_with_explicit_dedication

SKIPPED

None

self service

test can be modified to add a new host just before running this test- SIMULATOR only test

if empty_host:
self.skipTest("Did not find any empty hosts, Skipping")

150

test_01_create_sticky_policy_default_values

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

151

test_02_create_sticky_policy_custom_values

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

152

test_03_supported_policies_by_network

PASSED

None

self service

 

153

test_04_delete_lb_rule

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

154

test_05_error_alerts_after_create

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

155

test_06_release_ip

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.24

provisioning

 

156

test_07_delete_account

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

{Koushik}Not sure why delete account require ssh connection?

157

test_08_create_policy_router_stopped

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

158

test_09_create_policy_router_destroy

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

159

test_10_create_policy_enable_disable_vpn

FAILED

Connection Failed: SSH failed for VM with IP Address: 192.168.2.23

provisioning

 

160

test_11_invalid_params

PASSED

None

self service

 

161

test_01_deploy_vm_with_implicit_planner

SKIPPED

None

self service

test can be modified to add a new host just before running this test- SIMULATOR only test

if empty_host:
self.skipTest("Did not find any empty hosts, Skipping")

162

test_network_not_implemented

PASSED

None

self service

 

163

test_reservation_after_router_restart

PASSED

None

self service

 

164

test_vm_create_after_reservation

PASSED

None

self service

 

165

test_vm_create_outside_cidr_after_reservation

PASSED

None

self service

 

166

test_01_addLdapConfiguration

FAILED

addLdapConfiguration failed

self service

have proper LDAP settings configured in the test env.

167

test_01_stop_start_instance

PASSED

None

self service

 

168

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

169

test_03_delete_instance

PASSED

None

self service

 

170

test_04_deploy_multiple_vm

SKIPPED

None

self service

 

171

test_01_stop_start_instance

PASSED

None

self service

 

172

test_02_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

173

test_03_delete_instance

PASSED

None

self service

 

174

test_04_deploy_multiple_vm

FIXED

None

self service

 

175

test_01_change_service_offering

PASSED

None

self service

 

176

test_02_migrate_vm

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

177

test_03_delete_vm

PASSED

None

self service

 

178

test_04_deploy_multiple_vm

FIXED

None

self service

 

179

test_01_multiple_child_domains

PASSED

None

self service

 

180

test_01_deploy_vm_domain_limit_reached

PASSED

None

self service

 

181

test_02_deploy_vm_account_limit_reached

PASSED

None

self service

 

182

test_03_deploy_vm_project_limit_reached

PASSED

None

self service

 

183

test_04_deployVm__account_limit_reached

PASSED

None

self service

 

184

test_01_project_vmlifecycle_start_stop_instance

PASSED

None

self service

 

185

test_02_project_vmlifecycle_migrate_instance

FAILED

Execute cmd: listhosts failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

186

test_03_project_vmlifecycle_delete_instance

PASSED

None

self service

 

187

test_add_netscaler_device

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

188

ContextSuite context=TestDeleteNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

189

ContextSuite context=TestGuestNetworkShutDown>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

190

ContextSuite context=TestGuestNetworkWithNetScaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

191

test_invalid_cred

FAILED

Network service providers list should not be empty

provisioning

netscaler

192

test_invalid_private_interface

FAILED

Network service providers list should not be empty

provisioning

netscaler

193

test_invalid_public_interface

FAILED

Network service providers list should not be empty

provisioning

netscaler

194

ContextSuite context=TestNetScalerCustomCapacity>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

195

ContextSuite context=TestNetScalerDedicated>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

196

ContextSuite context=TestNetScalerNoCapacity>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

197

ContextSuite context=TestNetScalerShared>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

198

ContextSuite context=TestServiceProvider>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

199

ContextSuite context=TestAddMultipleVmsLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

200

ContextSuite context=TestDeleteCreateLBRule>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

201

ContextSuite context=TestLbOnIpWithPf>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

202

ContextSuite context=TestLbOnNonSourceNat>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

203

ContextSuite context=TestLbSourceNat>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

204

ContextSuite context=TestLoadBalancingRule>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

205

ContextSuite context=TestMultipleLbRules>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

206

ContextSuite context=TestMultipleLbRulesSameIp>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

207

ContextSuite context=TestPfOnIpWithLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

208

ContextSuite context=TestVmWithLb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

209

ContextSuite context=TestLbAlgoLcRr>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

210

ContextSuite context=TestLbAlgoLcSb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

211

ContextSuite context=TestLbAlgoRrLc>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

212

ContextSuite context=TestLbAlgoRrSb>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

213

ContextSuite context=TestLbAlgoSbLc>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

214

ContextSuite context=TestLbAlgoSbRr>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

215

ContextSuite context=TestLbWithLeastConn>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

216

ContextSuite context=TestLbWithRoundRobin>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

217

ContextSuite context=TestLbWithSourceIp>:setup

FAILED

Warning: Exception during cleanup : type object 'TestLbWithSourceIp' has no attribute '_cleanup'

provisioning

{Koushik}Is this test not dependent on Netscaler?

yes

218

ContextSuite context=TestLbStickyPolicy>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

219

test_add_mul_netscaler_diff_zone

FAILED

Atleast 2 advanced mode zones should be present for this test

provisioning

 

220

test_add_netscaler_device

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

221

ContextSuite context=TestNOWithNetscaler>:setup

FAILED

Warning: Exception in setUpClass: Execute cmd: addnetworkserviceprovider failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

222

ContextSuite context=TestNetScalerSharedMode>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

223

ContextSuite context=TestNwOffDToSUpgrade>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

224

ContextSuite context=TestNwOffDedicatedNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

225

ContextSuite context=TestNwOffNetscaler>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

 

226

ContextSuite context=TestNwOffSToDUpgrade>:setup

FAILED

Execute cmd: error failed, due to: errorCode: 432, errorText:The given command does not exist or it is not available for user

provisioning

addNetscalerLoadBalancer

227

test_01_network_off_without_conserve_mode

PASSED

None

self service

 

228

test_02_network_off_with_conserve_mode

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 460 on domR: r-794-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

{Koushik}Fixed by Rajani

229

test_create_network_with_snat

PASSED

None

self service

 

230

test_01_nwupgrade_netscaler_conserve_on

FAILED

Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

231

test_02_nwupgrade_netscaler_conserve_off

FAILED

Execute cmd: createnetworkoffering failed, due to: errorCode: 431, errorText:Unable to find the Network Element implementing the Service Provider 'Netscaler'

provisioning

 

232

ContextSuite context=TestNonContiguousVLANRanges>:setup

FAILED

Exception: Failed to find template of type BUILTIN with OSTypeID and which is in ready state: f6621e5e-9e1a-11e3-81d6-062a00000033

self service

re run

233

test_network_state_after_destroying_vms

PASSED

None

self service

 

234

test_shared_network_offering_with_persistent

PASSED

None

self service

 

235

test_upgrade_network_offering_to_persistent

PASSED

None

self service

 

236

test_associate_ip_address

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

237

test_associate_ip_address_invalid_zone

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

238

test_associate_ip_address_no_free_ip

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

239

test_associate_ip_address_services_enable_disable

SKIPPED

None

provisioning

need ssh access

240

test_create_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

rerun

241

test_create_portable_ip_range_invalid_region

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

242

test_create_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

243

test_delete_account_services_disabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

244

test_delete_account_services_enabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

245

test_delete_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

246

test_delete_portable_ip_range_in_use

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

247

test_delete_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

248

test_disassociate_ip_address_no_services

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

249

test_disassociate_ip_address_other_account

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

250

test_disassociate_ip_address_services_enabled

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

251

test_list_portable_ip_range

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

252

test_list_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

253

test_list_portable_ip_range_non_root_admin

FAILED

'NoneType' object has no attribute 'startip'

self service

cfg file doesn't have portable ip range

254

ContextSuite context=TestProjectCreationNegative>:setup

SKIPPED

None

self service

depends on global config

if not isinstance(configs, list):
raise unittest.SkipTest("List configurations has no config: allow.user.create.projects")

255

test_add_user_to_project

PASSED

None

self service

 

256

ContextSuite context=TestProjectInviteRequiredTrue>:setup

SKIPPED

None

self service

depends on global config

257

ContextSuite context=TestProjectInviteTimeout>:setup

SKIPPED

None

self service

depends on global config

258

test_admin_project_creation

PASSED

None

self service

 

259

test_maxAccountNetworks

PASSED

None

self service

 

260

test_01_project_limits

PASSED

None

self service

 

261

test_02_project_limits_normal_user

PASSED

None

self service

 

262

test_03_vm_per_project

PASSED

None

self service

 

263

test_04_publicip_per_project

PASSED

None

self service

 

264

test_05_snapshots_per_project

PASSED

None

self service

 

265

test_06_volumes_per_project

PASSED

None

self service

 

266

test_07_templates_per_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

267

ContextSuite context=TestResourceLimitsProject>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

re run

268

test_03_network_create

PASSED

None

self service

 

269

test_01_service_offerings

PASSED

None

self service

 

270

test_02_project_disk_offerings

PASSED

None

self service

 

271

test_07_associate_public_ip

PASSED

None

self service

 

272

test_06_create_snapshots_in_project

PASSED

None

self service

 

273

test_04_public_template_use_in_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

274

test_05_use_private_template_in_project

FAILED

Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None

self service

{Koushik}Failure needs investigation

re run

275

test_05_use_private_template_in_project

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

276

ContextSuite context=TestTemplates>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

re run

277

test_01_ISO_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}

self service

re run

278

test_01_lb_usage

PASSED

None

self service

 

279

test_01_nat_usage

PASSED

None

self service

 

280

test_01_public_ip_usage

PASSED

None

self service

 

281

test_01_snapshot_usage

PASSED

None

self service

 

282

test_01_template_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

re run

283

test_01_vm_usage

PASSED

None

self service

 

284

test_01_volume_usage

PASSED

None

self service

 

285

test_01_vpn_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 582 on domR: r-959-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

re run

286

test_02_cross_domain_account_add

PASSED

None

self service

 

287

test_03_delete_account_with_project

PASSED

None

self service

 

288

test_04_delete_domain_with_project

PASSED

None

self service

 

289

test_01_create_multiple_projects_by_account

PASSED

None

self service

 

290

test_05_user_project_owner_promotion

PASSED

None

self service

 

291

test_06_max_one_project_owner

PASSED

None

self service

 

292

test_07_project_resources_account_delete

PASSED

None

self service

 

293

test_08_cleanup_after_project_delete

PASSED

None

self service

 

294

test_09_project_suspend

PASSED

None

self service

 

295

test_10_project_activation

PASSED

None

self service

 

296

test_recurring_snapshot_data_disk

PASSED

None

self service

 

297

test_recurring_snapshot_root_disk

PASSED

None

self service

 

298

test_network_gc

PASSED

None

self service

 

299

test_restart_ntwk_no_cleanup

PASSED

None

self service

 

300

test_restart_ntwk_with_cleanup

PASSED

None

self service

 

301

test_enableVPNOverRvR

FAILED

Failed to create VPN for account: test-TestEnableVPNOverRvR-test_enableVPNOverRvR-X7XPFV - Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 479 on domR: r-813-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

re run

302

test_downgradeRvR_to_VR

PASSED

None

self service

 

303

test_upgradeVR_to_redundantVR

PASSED

None

self service

 

304

test_createRegionWithExistingRegionId

PASSED

None

self service

 

305

test_createRegionWithExistingRegionName

PASSED

None

self service

 

306

test_updateRegion

PASSED

None

self service

 

307

test_createAccountWithUUID

PASSED

None

self service

 

308

test_createUserWithUUID

PASSED

None

self service

 

309

test_createdomainWithUUID

PASSED

None

self service

 

310

ContextSuite context=TestResetSSHKeyUserRights>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

expand the dependent tests

311

ContextSuite context=TestResetSSHKeypair>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

expand the dependent tests

312

test_maxAccountNetworks

PASSED

None

self service

 

313

test_01_vm_per_account

PASSED

None

self service

 

314

test_02_publicip_per_account

PASSED

None

self service

 

315

test_03_snapshots_per_account

PASSED

None

self service

 

316

test_04_volumes_per_account

PASSED

None

self service

 

317

test_05_templates_per_account

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

rerun

318

test_01_publicip_per_domain

PASSED

None

self service

 

319

test_01_vm_per_domain

PASSED

None

self service

 

320

test_03_snapshots_per_domain

PASSED

None

self service

 

321

test_04_volumes_per_domain

PASSED

None

self service

 

322

test_05_templates_per_domain

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

323

ContextSuite context=TestResourceLimitsDomain>:teardown

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u"Can't delete the domain yet because it has 1 accounts to cleanup"}

self service

 

324

test_01_AdvancedZoneRouterServices

PASSED

None

self service

 

325

test_02_NetworkGarbageCollection

PASSED

None

self service

 

326

test_03_RouterStartOnVmDeploy

PASSED

None

self service

 

327

test_01_RouterStopCreateFW

FAILED

'Please provide the marvin configuration file with credentials to your hosts'

provisioning

 

328

test_01_RouterStopCreateLB

FAILED

SSH Access failed for 10.1.1.219: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

329

test_01_RouterStopCreatePF

FAILED

SSH Access failed for 192.168.2.9: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

330

test_createSharedNetwork_All

PASSED

None

self service

 

331

test_createSharedNetwork_accountSpecific

PASSED

None

self service

 

332

test_createSharedNetwork_domainSpecific

PASSED

None

self service

 

333

test_createSharedNetwork_projectSpecific

PASSED

None

self service

 

334

test_createSharedNetwork_usedVlan

SKIPPED

None

NA

remove the test

335

test_createSharedNetwork_usedVlan2

PASSED

None

self service

 

336

test_deployVM_isolatedAndShared

FAILED

SSH Access failed for 10.1.1.96: SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

337

test_deployVM_multipleSharedNetwork

PASSED

None

self service

Enhancement: add more validation to check that IPs are in the correct networks.

338

test_networkWithsubdomainaccessFalse

PASSED

None

self service

 

339

test_networkWithsubdomainaccessTrue

PASSED

None

self service

 

340

test_sharedNetworkOffering_01

PASSED

None

self service

 

341

test_sharedNetworkOffering_02

PASSED

None

self service

 

342

test_sharedNetworkOffering_03

PASSED

None

self service

 

343

test_02_accountSnapshotClean

FAILED

'simulator'

provisioning

is_snapshot_on_nfs

344

test_04_snapshot_limit

FAILED

'simulator'

provisioning

is_snapshot_on_nfs

345

test_01_createVM_snapshotTemplate

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

provisioning

 

346

test_05_snapshot_events

PASSED

None

self service

 

347

test_01_volume_from_snapshot

FAILED

SSH failed for VM: 10.1.1.233

provisioning

 

348

test_02_snapshot_data_disk

FAILED

'simulator'

provisioning

 

349

test_03_snapshot_detachedDisk

FAILED

SSH failed for VM with IP: 192.168.2.14 - SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

350

test_04_delete_snapshot

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

provisioning

 

351

test_07_template_from_snapshot

FAILED

SSH failed for VM with IP address: 10.1.1.233

provisioning

 

352

test_01_concurrent_snapshots_live_migrate

PASSED

None

self service

 

353

test_02_stop_vm_concurrent_snapshots

PASSED

None

self service

 

354

test_03_concurrent_snapshots_create_template

FAILED

Check if result exists in list item call

self service

rerun

355

test_04_concurrent_snapshots_create_volume

PASSED

None

self service

 

356

test_01_snapshot_on_rootVolume

FAILED

'simulator'

provisioning

 

357

test_01_deploy_ha_vm_startvm_false

PASSED

None

self service

 

358

test_02_deploy_ha_vm_from_iso

PASSED

None

self service

 

359

test_03_deploy_ha_vm_iso_startvm_false

PASSED

None

self service

 

360

test_deployVmOnGivenHost

PASSED

None

self service

 

361

test_01_deploy_vm_no_startvm

PASSED

None

self service

 

362

test_02_deploy_vm_startvm_true

PASSED

None

self service

 

363

test_03_deploy_vm_startvm_false

PASSED

None

self service

 

364

test_04_deploy_startvm_false_attach_volume

PASSED

None

self service

 

365

test_05_deploy_startvm_false_change_so

PASSED

None

self service

 

366

test_06_deploy_startvm_attach_detach

PASSED

None

self service

 

367

test_07_deploy_startvm_attach_iso

PASSED

None

self service

 

368

test_08_deploy_attached_volume

PASSED

None

self service

 

369

test_09_stop_vm_migrate_vol

PASSED

None

self service

 

370

test_deploy_vm_password_enabled

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

revisit the test, why template is downloaded

371

test_01_deploy_vm_no_startvm

PASSED

None

self service

 

372

test_upload_attach_volume

PASSED

None

self service

 

373

test_vm_per_account

PASSED

None

self service

 

374

test_01_migrate_vm_with_volume

FAILED

Execute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv only

provisioning

 

375

test_02_migrate_volume

SKIPPED

None

self service

if not pools:
self.skipTest("No suitable storage pools found for volume migration. Skipping")

376

test_01_lbrule_tag

PASSED

None

self service

 

377

test_02_natrule_tag

PASSED

None

self service

 

378

test_03_firewallrule_tag

PASSED

None

self service

 

379

test_04_vpn_tag

SKIPPED

None

self service

      self.skipTest("VPN resource tags are unsupported in 4.0")

380

test_05_vm_tag

PASSED

None

self service

 

381

test_06_template_tag

FAILED

Warning: Exception during cleanup : Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

382

test_07_iso_tag

PASSED

None

self service

 

383

test_08_volume_tag

PASSED

None

self service

 

384

test_09_snapshot_tag

PASSED

None

self service

 

385

test_10_network_tag

PASSED

None

self service

 

386

test_13_tag_case_insensitive

PASSED

None

self service

 

387

test_14_special_char_mutiple_tags

PASSED

None

self service

 

388

test_15_project_tag

PASSED

None

self service

 

389

test_16_query_tags_other_account

PASSED

None

self service

 

390

test_17_query_tags_admin_account

PASSED

None

self service

 

391

test_18_invalid_list_parameters

PASSED

None

self service

 

392

test_19_delete_add_same_tag

PASSED

None

self service

 

393

test_20_create_tags_multiple_resources

PASSED

None

self service

 

394

test_21_create_tag_stopped_vm

PASSED

None

self service

 

395

test_22_create_tag_destroyed_vm

PASSED

None

self service

 

396

test_01_create_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}

provisioning

test can be modified to qualify as a self service test.

397

test_01_create_template_volume

FAILED

Execute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:None

self service

rerun

398

test_03_delete_template

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

399

test_04_template_from_snapshot

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}

self service

rerun

400

test_update_vm_name

PASSED

None

self service

 

401

test_01_ISO_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete ISO'}

self service

 

402

test_01_lb_usage

PASSED

None

self service

 

403

test_01_nat_usage

PASSED

None

self service

 

404

test_01_public_ip_usage

PASSED

None

self service

 

405

test_01_snapshot_usage

PASSED

None

self service

 

406

test_01_template_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to delete template'}

self service

 

407

test_01_vm_usage

PASSED

None

self service

 

408

test_01_volume_usage

PASSED

None

self service

 

409

test_01_vpn_usage

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 213 on domR: r-383-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

410

ContextSuite context=TestVMPasswordEnabled>:setup

FAILED

SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

411

test_vmware_affinity

SKIPPED

None

provisioning

{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there

depends on vmware drs

412

test_vmware_anti_affinity

SKIPPED

None

provisioning

{Koushik}Since test name has vmware marked as provisioning for now. Check why a specific vmware affinity test is there

depends on vmware drs

413

test_vm_creation_in_fully_automated_mode

PASSED

None

provisioning

revisit.depends on vmware drs

414

ContextSuite context=TestAttachDetachVolume>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor

415

ContextSuite context=TestAttachVolume>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor


416

ContextSuite context=TestAttachVolumeISO>:setup

FAILED

object of type 'NoneType' has no len()

provisioning

{Koushik}Needs further investigation

no need to run on simulator

since this test checks max data volumes supported by a hypervisor


417

test_deployVmWithCustomDisk

PASSED

None

self service

 

418

test_01_attach_volume

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Command failed due to Internal Server Error'}

self service

 

419

test_02_detach_volume

FAILED

Execute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'The specified volume is not attached to a VM.'}

self service

 

420

test_03_delete_detached_volume

PASSED

None

self service

 

421

test_create_volume_under_domain

PASSED

None

self service

 

422

test_01_list_vpc_apis

PASSED

None

self service

 

423

test_02_restart_vpc_no_networks

PASSED

None

self service

 

424

test_03_restart_vpc_with_networks

PASSED

None

self service

 

425

test_04_delete_vpc_no_networks

PASSED

None

self service

 

426

test_05_delete_vpc_with_networks

PASSED

None

self service

 

427

test_06_list_vpc_apis_admin

PASSED

None

self service

 

428

test_07_restart_network_vm_running

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

429

test_08_delete_vpc

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

430

test_09_vpc_create

PASSED

None

self service

 

431

test_10_nonoverlaping_cidrs

PASSED

None

self service

 

432

test_11_deploy_vm_wo_network_netdomain

FAILED

Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

433

test_12_deploy_vm_with_netdomain

PASSED

None

self service

 

434

test_13_deploy_vm_with_vpc_netdomain

FAILED

Failed to SSH into VM - 192.168.2.23, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

435

test_14_deploy_vm_1

PASSED

None

self service

 

436

test_15_deploy_vm_2

PASSED

None

self service

 

437

test_16_deploy_vm_for_user_by_admin

PASSED

None

self service

 

438

test_17_deploy_vm_for_user_by_domain_admin

PASSED

None

self service

 

439

test_18_create_net_for_user_diff_domain_by_doadmin

PASSED

None

self service

 

440

test_19_create_vpc_wo_params

PASSED

None

self service

 

441

test_20_update_vpc_name_display_text

PASSED

None

self service

 

442

test_01_create_network_network_offering

PASSED

None

self service

 

443

test_01_create_network_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

444

test_02_create_network_fail_network_offering

PASSED

None

self service

 

445

test_02_create_network_fail_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

446

test_04_create_multiple_networks_with_lb_network_offering

PASSED

None

self service

 

447

test_04_create_multiple_networks_with_lb_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

448

test_06_create_network_with_rvr

SKIPPED

None

NA

"skipped - RvR didn't support VPC currently "

449

test_07_create_network_unsupported_services

PASSED

None

self service

 

450

test_08_create_network_without_sourceNAT

PASSED

None

self service

 

451

test_09_create_network_shared_nwoff_network_off_shared

PASSED

None

self service

 

452

test_09_create_network_shared_nwoff_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

453

test_10_create_network_with_conserve_mode_network_offering

PASSED

None

self service

 

454

test_10_create_network_with_conserve_mode_network_offering_vpcns

PASSED

None

self service

 

455

test_01_wait_network_gc

PASSED

None

provisioning

Enhancement: add more validation

456

test_02_start_vm_network_gc

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

457

test_03_restart_vpcvr

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

458

test_01_create_network_outside_range_network_offering

PASSED

None

self service

 

459

test_01_create_network_outside_range_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

460

test_02_create_network_outside_range

PASSED

None

self service

 

461

test_03_create_network_inside_range_network_offering

PASSED

None

self service

 

462

test_03_create_network_inside_range_network_offering_vpcns

SKIPPED

None

provisioning

{Koushik}Test name says lot of things, need to understand what all is done

requires netscaler

463

test_04_create_network_overlapping_range_network_offering

PASSED

None

self service

 

464

test_04_create_network_overlapping_range_network_offering_vpcns

SKIPPED

None

provisioning

requires netscaler

465

test_05_create_network_diff_account_network_offering

PASSED

None

self service

 

466

test_05_create_network_diff_account_network_offering_vpcns

SKIPPED

None

provisioning

requires netscaler

467

test_01_network_services_upgrade

FAILED

Failed to SSH into VM - 192.168.2.12, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

468

test_02_network_vpcvr2vr_upgrade

PASSED

None

provisioning

add proper validation before and after upgrade

469

test_01_VPC_LBRulesListing

PASSED

None

self service

 

470

test_02_VPC_CreateLBRuleInMultipleNetworks

FAILED

Failed to wget from VM=QA-579a7424-09b9-41bd-8394-f72056b7e1d9 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

471

test_03_VPC_CreateLBRuleInMultipleNetworksVRStoppedState

FAILED

Failed to wget from VM=QA-91ac472a-996e-401d-88e2-9c305c780cb8 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

472

test_04_VPC_CreateLBRuleInMultipleNetworksVRStoppedState

FAILED

Failed to wget from VM=QA-87956b8f-9c6c-432c-96c7-e48759ccb85e http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

473

test_05_VPC_CreateAndDeleteLBRule

FAILED

Failed to wget from VM=QA-4de5c732-b31b-4f6a-b784-671d9091d277 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

474

test_06_VPC_CreateAndDeleteLBRuleVRStopppedState

FAILED

Failed to wget from VM=QA-6a0f9448-94d3-476d-8271-91bc3bf6b013 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

475

test_07_VPC_CreateAndDeleteAllLBRule

FAILED

Failed to wget from VM=QA-94f2bc5d-e061-448a-877e-bd0199faf4cf http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

476

test_08_VPC_CreateAndDeleteAllLBRuleVRStoppedState

FAILED

Failed to wget from VM=QA-3e51092f-b67d-4769-908f-a0c9c776683a http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

477

test_09_VPC_LBRuleCreateFailMultipleVPC

FAILED

Failed to wget from VM=QA-2ff04344-932c-4c77-a26b-d71ba6226732 http server on public_ip=192.168.2.30 because of [Errno socket error] timed out

provisioning

 

478

test_10_VPC_FailedToCreateLBRuleNonVPCNetwork

PASSED

None

self service

 

479

test_11_VPC_LBRuleCreateNotAllowed

FAILED

Failed to wget from VM=QA-23b260c3-862e-4f3d-8fba-519d9a7e55d6 http server on public_ip=192.168.2.29 because of [Errno socket error] timed out

provisioning

 

480

test_12_VPC_LBRuleCreateFailForRouterIP

PASSED

None

self service

 

481

test_13_VPC_LBRuleCreateFailForPFSourceNATIP

FAILED

Failed to SSH into VM - 192.168.2.29

provisioning

 

482

test_14_VPC_LBRuleCreateFailForStaticNatRule

PASSED

None

self service

 

483

test_15_VPC_ReleaseIPForLBRuleCreated

PASSED

None

self service

 

484

test_01_network_services_VPC_StopCreatePF

FAILED

Failed to SSH into VM - 192.168.2.13

provisioning

 

485

test_02_network_services_VPC_CreatePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

486

test_03_network_services_VPC_StopCreateMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

487

test_04_network_services_VPC_CreateMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

488

test_05_network_services_VPC_StopDeletePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

489

test_06_network_services_VPC_DeletePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

490

test_07_network_services_VPC_StopDeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

491

test_08_network_services_VPC_DeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

492

test_09_network_services_VPC_StopDeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

493

test_10_network_services_VPC_DeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.12

provisioning

 

494

test_01_VPC_StaticNatRuleCreateStoppedState

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

495

test_02_VPC_CreateStaticNatRule

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

496

test_03_VPC_StopCreateMultipleStaticNatRuleStopppedState

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

497

test_04_VPC_CreateMultipleStaticNatRule

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

498

test_05_network_services_VPC_DeleteAllPF

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

499

test_06_network_services_VPC_DeleteAllMultiplePF

FAILED

Failed to SSH into VM - 192.168.2.8

provisioning

 

500

test_01_create_vpc_offering

PASSED

None

self service

 

501

test_02_deploy_vms_in_vpc_nw

FAILED

Failed to SSH into VM - 192.168.2.19, SSH connection has Failed. Waited 600s. Error is Connection Failed

provisioning

 

502

test_03_vpc_off_without_lb

PASSED

None

self service

 

503

test_04_vpc_off_without_static_nat

PASSED

None

self service

 

504

test_05_vpc_off_without_pf

PASSED

None

self service

 

505

test_06_vpc_off_invalid_services

PASSED

None

self service

 

506

test_07_update_vpc_off

PASSED

None

self service

 

507

test_08_list_vpc_off

PASSED

None

self service

 

508

test_01_start_stop_router_after_addition_of_one_guest_network

PASSED

None

provisioining

Ehnancement: add more validation written in the steps

509

test_02_reboot_router_after_addition_of_one_guest_network

PASSED

None

self service

 

510

test_03_migrate_router_after_addition_of_one_guest_network

FAILED

Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host isstill 09c38e9a-7a22-4591-be39-f1a2bcd138a5

provisioning

 

511

test_04_chg_srv_off_router_after_addition_of_one_guest_network

PASSED

None

self service

 

512

test_05_destroy_router_after_addition_of_one_guest_network

PASSED

None

self service

 

513

test_01_stop_start_router_after_creating_vpc

PASSED

None

self service

 

514

test_02_reboot_router_after_creating_vpc

PASSED

None

self service

 

515

test_03_migrate_router_after_creating_vpc

FAILED

Migration to host b5205777-8029-480e-9941-b7f8f89f48ba failed. The router host is still 09c38e9a-7a22-4591-be39-f1a2bcd138a5

provisioning

 

516

test_04_change_service_offerring_vpc

PASSED

None

self service

 

517

test_05_destroy_router_after_creating_vpc

PASSED

None

self service

 

518

test_01_deploy_vms_in_network

PASSED

None

self service

 

519

test_02_deploy_vms_delete_network

PASSED

None

self service

 

520

test_03_deploy_vms_delete_add_network

PASSED

None

self service

 

521

test_04_deploy_vms_delete_add_network_noLb

PASSED

None

self service

 

522

test_05_create_network_max_limit

PASSED

None

self service

 

523

test_06_delete_network_vm_running

PASSED

None

self service

 

524

test_07_delete_network_with_rules

FAILED

List public Ips 192.168.2.9 for network should list the Ip addr 192.168.2.11

self service

rerun and revisit

525

test_01_VPN_user_limit

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 583 on domR: r-961-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

526

test_02_use_vpn_port

PASSED

None

self service

 

527

test_03_enable_vpn_use_port

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 585 on domR: r-965-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

528

test_04_add_new_users

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 586 on domR: r-967-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

529

test_05_add_duplicate_user

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 587 on domR: r-969-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

530

test_06_add_VPN_user_global_admin

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 588 on domR: r-971-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

531

test_07_add_VPN_user_domain_admin

FAILED

Failed to create remote VPN access: Execute cmd: asyncquery failed, due to: {errorcode : 534, errortext : u'Resource [DataCenter:1] is unreachable: Unable to start vpn: Unable to add users to vpn in zone 1 for account 589 on domR: r-973-QA due to Unsupported command issued:com.cloud.agent.api.routing.VpnUsersCfgCommand.  Are you sure you got the right type of server?'}

self service

 

 

Self Service tests: TBA

Provisioning tests: TBA

Total no. of existing automated tests for advanced zone: TBA

BVT Report -Basic Zone

Sl. No.test casestatusError DescriptionTypeComments
1test_DeployVmAntiAffinityGroupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ed6c84c2-3602-461b-bfc0-77031d0b7b33], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self service 
2test_deploy_vmPASSEDNoneself service 
3test_deployvm_userdataPASSEDNoneself service 
4test_deployvm_userdata_postPASSEDNoneself service 
5test_deployvm_firstfitPASSEDNoneself service 
6test_deployvm_userconcentratedPASSEDNoneself service 
7test_deployvm_userdispersingPASSEDNoneself service 
8test_01_create_disk_offeringPASSEDNoneself service 
9test_02_edit_disk_offeringPASSEDNoneself service 
10test_03_delete_disk_offeringPASSEDNoneself service 
11test_UpdateConfigParamWithScopePASSEDNoneself service 
12test_01_create_isoPASSEDNoneself service 
13test_02_edit_isoPASSEDNoneself service 
14test_03_delete_isoPASSEDNoneself service 
15test_04_extract_IsoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract iso'}provisioning 
16test_05_iso_permissionsPASSEDNoneself service 
17test_06_copy_isoSKIPPEDNoneprovisioning 
18test_nic_secondaryip_add_removePASSEDNoneself service 
19test_01_nicFAILEDException during NIC test!: 'TestNic' object has no attribute 'account'test/config issuechange test tag to run only in advanced zone
20test_createPortablePublicIPRangePASSEDNoneself service 
21test_01_primary_storage_iscsiFAILEDCheck storage pool type self servicetest fix
22test_01_primary_storage_nfsPASSEDNoneself service 
23test_createRegionPASSEDNoneself service 
24test_01_reset_vm_on_rebootPASSEDNoneself service 
25test_01_router_internal_basicSKIPPEDNoneprovisioning 
26test_01_scale_vmFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'This operation not permitted for this hypervisor of the vm'}provisioning 
27test_01_sys_vm_startPASSEDNoneself service 
28test_02_sys_template_readyPASSEDNoneself service 
29test_01_create_service_offeringPASSEDNoneself service 
30test_02_edit_service_offeringPASSEDNoneself service 
31test_03_delete_service_offeringPASSEDNoneself service 
32test_01_list_sec_storage_vmPASSEDNoneself service 
33test_02_list_cpvm_vmPASSEDNoneself service 
34test_03_ssvm_internalsSKIPPEDNoneprovisioning 
35test_04_cpvm_internalsSKIPPEDNoneprovisioning 
36test_05_stop_ssvmSKIPPEDNoneprovisioning 
37test_06_stop_cpvmSKIPPEDNoneprovisioning 
38test_07_reboot_ssvmSKIPPEDNoneprovisioning 
39test_08_reboot_cpvmSKIPPEDNoneprovisioning 
40test_09_destroy_ssvmSKIPPEDNoneprovisioning 
41test_10_destroy_cpvmSKIPPEDNoneprovisioning 
42test_02_edit_templatePASSEDNoneself service 
43test_03_delete_templatePASSEDNoneself service 
44test_04_extract_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
45test_05_template_permissionsPASSEDNoneself service 
46test_06_copy_templateSKIPPEDNoneprovisioning 
47test_07_list_public_templatesPASSEDNoneself service 
48test_08_list_system_templatesPASSEDNoneself service 
49test_deploy_vmPASSEDNoneself service 
50test_01_stop_vmPASSEDNoneself service 
51test_02_start_vmPASSEDNoneself service 
52test_03_reboot_vmPASSEDNoneself service 
53test_06_destroy_vmPASSEDNoneself service 
54test_07_restore_vmPASSEDNoneself service 
55test_08_migrate_vmSKIPPEDNoneprovisioning 
56test_09_expunge_vmPASSEDNoneself service 
57test_10_attachAndDetach_isoFAILEDSSH failed for virtual machine: 60.147.41.9 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
58test_01_create_volumeFAILEDSSH access failed for VM 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
59test_02_attach_volumeFAILEDSSH failed for VM: 60.147.41.6 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
60test_03_download_attached_volumePASSEDNoneself service 
61test_04_delete_attached_volumePASSEDNoneself service 
62test_05_detach_volumePASSEDNoneself service 
63test_06_download_detached_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract volume'}provisioning 
64test_07_resize_failFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}provisioning 
65test_08_resize_volumeFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Cloudstack currently only supports volumes marked as KVM or XenServer hypervisor for resize'}provisioning 
66test_09_delete_detached_volumePASSEDNoneself service 
      
 Total time(in min)56.39521667   

Regression Test Report - Basic Zone:

 

Sl. No.test casestatusError DescriptionTypeComments
1test_01_create_accountPASSEDNoneself service 
2test_01_add_vm_to_subdomainPASSEDNoneself service 
3test_01_non_root_admin_PrivilegesPASSEDNoneself service 
4test_01_user_remove_VM_runningPASSEDNoneself service 
5test_01_service_offering_hierarchyPASSEDNoneself service 
6test_01_service_offering_siblingsPASSEDNoneself service 
7ContextSuite context=TestTemplateHierarchy>:setupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
8test_updateAdminDetailsPASSEDNoneself service 
9test_updateDomainAdminDetailsPASSEDNoneself service 
10test_updateUserDetailsPASSEDNoneself service 
11test_LoginApiDomainPASSEDNoneself service 
12test_LoginApiUuidResponsePASSEDNoneself service 
13ContextSuite context=TestFailureScenariosAddNetworkToVM>:setupSKIPPEDNoneNot Run 
14test_01_deploy_vm_another_userPASSEDNoneself service 
15test_02_create_aff_grp_userPASSEDNoneself service 
16test_03_list_aff_grp_all_usersPASSEDNoneself service 
17test_04_list_all_admin_aff_grpPASSEDNoneself service 
18test_05_list_all_users_aff_grpPASSEDNoneself service 
19test_06_list_all_users_aff_grp_by_idPASSEDNoneself service 
20test_07_delete_aff_grp_of_other_userPASSEDNoneself service 
21test_01_admin_create_aff_grpPASSEDNoneself service 
22test_02_doadmin_create_aff_grpPASSEDNoneself service 
23test_03_user_create_aff_grpPASSEDNoneself service 
24test_04_user_create_aff_grp_existing_namePASSEDNoneself service 
25test_05_create_aff_grp_same_name_diff_accPASSEDNoneself service 
26test_06_create_aff_grp_nonexisting_typePASSEDNoneself service 
27test_01_delete_aff_grp_by_namePASSEDNoneself service 
28test_02_delete_aff_grp_for_accPASSEDNoneself service 
29test_03_delete_aff_grp_with_vmsPASSEDNoneself service 
30test_05_delete_aff_grp_idPASSEDNoneself service 
31test_06_delete_aff_grp_namePASSEDNoneself service 
32test_08_delete_aff_grp_by_idPASSEDNoneself service 
33test_09_delete_aff_grp_root_adminPASSEDNoneself service 
34test_01_deploy_vm_without_aff_grpPASSEDNoneself service 
35test_02_deploy_vm_by_aff_grp_namePASSEDNoneself service 
36test_03_deploy_vm_by_aff_grp_idPASSEDNoneself service 
37test_04_deploy_vm_anti_affinity_groupFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-8ad687c5-2af6-4b80-adc1-3ddc3c33d4c2], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
38test_05_deploy_vm_by_idFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-e57ae7c4-7db9-4e3f-aeb7-4bfaf78983dd], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
39test_06_deploy_vm_aff_grp_of_other_user_by_namePASSEDNoneself service 
40test_07_deploy_vm_aff_grp_of_other_user_by_idPASSEDNoneself service 
41test_08_deploy_vm_multiple_aff_grpsPASSEDNoneself service 
42test_09_deploy_vm_multiple_aff_grpsFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-85503541-e176-4a9e-80a3-d25e7db164e4], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
43test_10_deploy_vm_by_aff_grp_name_and_idPASSEDNoneself service 
44test_01_list_aff_grps_for_vmPASSEDNoneself service 
45test_02_list_multiple_aff_grps_for_vmPASSEDNoneself service 
46test_03_list_aff_grps_by_idPASSEDNoneself service 
47test_04_list_aff_grps_by_namePASSEDNoneself service 
48test_05_list_aff_grps_by_non_existing_idPASSEDNoneself service 
49test_06_list_aff_grps_by_non_existing_namePASSEDNoneself service 
50test_07_list_all_vms_in_aff_grpPASSEDNoneself service 
51test_01_update_aff_grp_by_idsFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-9f918f00-26ca-4677-b051-44e2baec4d7c], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
52test_02_update_aff_grp_by_namesFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-ee4de048-870f-44fa-892d-c958cbb3e427], Please check the affinity groups provided, there may not be sufficient capacity to follow them'}self serviceadd enough hosts
53test_03_update_aff_grp_for_vm_with_no_aff_grpFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Unable to start a VM due to insufficient capacity'}self serviceadd enough hosts
54test_04_update_aff_grp_remove_allSKIPPEDNoneNot Run 
55test_05_update_aff_grp_on_running_vmPASSEDNoneself service 
56test_baremetalFAILEDExecute cmd: createnetwork failed, due to: errorCode: 431, errorText:Can't have more than one Guest network in zone with network type Basictest/config issuerevisit this and fix tags if required
57test_01_deploy_instance_with_is_volatile_offeringPASSEDNoneself service 
58test_02_reboot_instance_with_is_volatile_offeringPASSEDNoneself service 
59test_03_restore_vm_with_new_templatePASSEDNoneself service 
60test_04_reoccuring_snapshot_rulesFAILEDException not raisedself servicelooks like a product bug, reverify
61test_01_create_templateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
62test_01_check_template_sizeFAILEDTemplate instance has no attribute 'size'provisioning 
63test_02_check_size_snapshotTemplateFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}provisioning 
64test_03_reuse_template_nameFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to create templateNo remote endpoint to send command, check if host or ssvm is down?'}provisioning 
65test_01_custom_hostname_instancename_falsePASSEDNoneself service 
66test_01_user_provided_hostnameSKIPPEDNoneNot Run 
67test_02_instancename_from_default_configurationSKIPPEDNoneNot Run 
68test_03_duplicate_nameSKIPPEDNoneNot Run 
69test_04_edit_display_namePASSEDNoneself service 
70test_05_unsupported_chars_in_display_namePASSEDNoneself service 
71test_deployvm_userdata_postFAILEDNo JSON object could be decodedprovisioning 
72test_authorizeIngressRuleFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
73test_01_default_group_with_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
74test_01_default_group_with_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
75test_deployVM_InDefaultSecurityGroupPASSEDNoneself service 
76test_invalid_account_authroizePASSEDNoneself service 
77test_invalid_parametersPASSEDNoneself service 
78test_multiple_account_egress_rule_positiveFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
79test_multiple_account_egress_rule_negativeFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
80test_revoke_egress_ruleFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
81test_start_stop_vm_egressFAILEDSSH Access failed for 60.147.41.8: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
82test_01_deploy_vm_with_explicit_dedicationSKIPPEDNoneNot Run 
83test_01_deploy_vm_with_implicit_plannerSKIPPEDNoneNot Run 
84test_01_addLdapConfigurationFAILEDaddLdapConfiguration failedself servicefix test data
85test_01_add_ip_same_cidrPASSEDNoneself service 
86test_02_add_ip_diff_cidrPASSEDNoneself service 
87test_03_del_ip_rangePASSEDNoneself service 
88test_04_add_noncontiguous_ip_rangePASSEDNoneself service 
89test_05_add_overlapped_ip_rangePASSEDNoneself service 
90test_06_add_ip_range_overlapped_with_two_rangesPASSEDNoneself service 
91test_07_add_iprange_supersetPASSEDNoneself service 
92test_08_add_iprange_subsetPASSEDNoneself service 
93ContextSuite context=TestProjectCreationNegative>:setupSKIPPEDNoneNot Run 
94test_add_user_to_projectPASSEDNoneself service 
95ContextSuite context=TestProjectInviteRequiredTrue>:setupSKIPPEDNoneNot Run 
96ContextSuite context=TestProjectInviteTimeout>:setupSKIPPEDNoneNot Run 
97test_admin_project_creationPASSEDNoneself service 
98test_01_project_limitsPASSEDNoneself service 
99test_02_project_limits_normal_userPASSEDNoneself service 
100test_03_vm_per_projectPASSEDNoneself service 
101test_05_snapshots_per_projectPASSEDNoneself service 
102test_06_volumes_per_projectPASSEDNoneself service 
103test_07_templates_per_projectPASSEDNoneself service 
104test_01_service_offeringsPASSEDNoneself service 
105test_02_project_disk_offeringsPASSEDNoneself service 
106test_08_security_groupPASSEDNoneself service 
107test_06_create_snapshots_in_projectPASSEDNoneself service 
108test_04_public_template_use_in_projectPASSEDNoneself service 
109test_05_use_private_template_in_projectFAILEDExecute cmd: deployvirtualmachine failed, due to: errorCode: 530, errorText:Noneself servicere run
110test_01_ISO_usagePASSEDNoneself service 
111test_01_snapshot_usagePASSEDNoneself service 
112test_01_template_usagePASSEDNoneself service 
113test_01_vm_usagePASSEDNoneself service 
114test_01_volume_usagePASSEDNoneself service 
115test_02_cross_domain_account_addPASSEDNoneself service 
116test_03_delete_account_with_projectPASSEDNoneself service 
117test_04_delete_domain_with_projectPASSEDNoneself service 
118test_01_create_multiple_projects_by_accountPASSEDNoneself service 
119test_05_user_project_owner_promotionPASSEDNoneself service 
120test_06_max_one_project_ownerPASSEDNoneself service 
121test_07_project_resources_account_deletePASSEDNoneself service 
122test_08_cleanup_after_project_deletePASSEDNoneself service 
123test_09_project_suspendPASSEDNoneself service 
124test_10_project_activationPASSEDNoneself service 
125test_createRegionWithExistingRegionIdPASSEDNoneself service 
126test_createRegionWithExistingRegionNamePASSEDNoneself service 
127test_updateRegionPASSEDNoneself service 
128test_createAccountWithUUIDPASSEDNoneself service 
129test_createUserWithUUIDPASSEDNoneself service 
130test_createdomainWithUUIDPASSEDNoneself service 
131ContextSuite context=TestResetSSHKeyUserRights>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
132ContextSuite context=TestResetSSHKeypair>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
133test_01_authorizeIngressRuleFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
134test_01_deployVM_InDefaultSecurityGroupPASSEDNoneself service 
135test_02_listSecurityGroupsPASSEDNoneself service 
136test_03_accessInDefaultSecurityGroupPASSEDNoneself service 
137test_01_delete_security_grp_running_vmPASSEDNoneself service 
138test_02_delete_security_grp_withoout_running_vmPASSEDNoneself service 
139test_01_dhcpOnlyRouterFAILEDConnection Failedprovisioning 
140test_01_authorizeIngressRule_AfterDeployVMFAILEDSSH access failed for ingress rule ID: bb72e3c0-5b09-4138-9a49-5f839d229543, SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
141test_02_revokeIngressRule_AfterDeployVMFAILEDSSH access failed for ingress rule ID: c8737ff2-1a4e-42fe-b89c-b99e730fd459, SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
142test_03_stopStartVM_verifyIngressAccessFAILEDSSH access failed for ingress rule ID: 61bdad47-8f6a-47ac-8940-9db4764f2b2fprovisioning 
143test_01_revokeIngressRuleFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
144test_01_deployVMWithUserDataFAILEDSSH Access failed for 60.147.41.7: SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
145test_02_accountSnapshotCleanFAILED'simulator'provisioningcheking is_snapshot_on_nfs
146test_01_volume_from_snapshotFAILEDSSH failed for VM: 60.147.41.11provisioning 
147test_03_snapshot_detachedDiskFAILEDSSH failed for VM with IP: 60.147.41.11 - SSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
148test_01_snapshot_on_rootVolumeFAILED'simulator'provisioningcheking is_snapshot_on_nfs
149test_01_deploy_ha_vm_startvm_falsePASSEDNoneself service 
150test_02_deploy_ha_vm_from_isoFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 533, errortext : u'Unable to create a deployment for VM[User|QA-707178ea-d8f8-4401-88a2-e232a4f3f58f]'}self servicere run
151test_03_deploy_ha_vm_iso_startvm_falsePASSEDNoneself service 
152test_deployVmOnGivenHostPASSEDNoneself service 
153test_01_deploy_vm_no_startvmPASSEDNoneself service 
154test_02_deploy_vm_startvm_truePASSEDNoneself service 
155test_03_deploy_vm_startvm_falsePASSEDNoneself service 
156test_04_deploy_startvm_false_attach_volumePASSEDNoneself service 
157test_05_deploy_startvm_false_change_soPASSEDNoneself service 
158test_06_deploy_startvm_attach_detachPASSEDNoneself service 
159test_07_deploy_startvm_attach_isoPASSEDNoneself service 
160test_08_deploy_attached_volumePASSEDNoneself service 
161test_09_stop_vm_migrate_volSKIPPEDNoneNot Run 
162test_deploy_vm_password_enabledFAILEDExecute cmd: asyncquery failed, due to: {errorcode : 530, errortext : u'Failed to extract template'}provisioning 
163test_upload_attach_volumePASSEDNoneself service 
164test_vm_per_accountPASSEDNoneself service 
165test_01_migrate_vm_with_volumeFAILEDExecute cmd: findhostsformigration failed, due to: errorCode: 431, errorText:Unsupported Hypervisor Type for VM migration, we support XenServer/VMware/KVM/Ovm/Hyperv onlyprovisioning 
166test_02_migrate_volumeSKIPPEDNoneNot Run 
167test_05_vm_tagPASSEDNoneself service 
168test_06_template_tagPASSEDNoneself service 
169test_07_iso_tagPASSEDNoneself service 
170test_08_volume_tagPASSEDNoneself service 
171test_09_snapshot_tagPASSEDNoneself service 
172test_11_migrate_tagged_vm_delFAILEDlist index out of rangeself servicefix test to check null list
173test_13_tag_case_insensitivePASSEDNoneself service 
174test_14_special_char_mutiple_tagsPASSEDNoneself service 
175test_16_query_tags_other_accountPASSEDNoneself service 
176test_17_query_tags_admin_accountPASSEDNoneself service 
177test_18_invalid_list_parametersPASSEDNoneself service 
178test_19_delete_add_same_tagPASSEDNoneself service 
179test_20_create_tags_multiple_resourcesPASSEDNoneself service 
180test_21_create_tag_stopped_vmPASSEDNoneself service 
181test_22_create_tag_destroyed_vmPASSEDNoneself service 
182test_update_vm_namePASSEDNoneself service 
183test_01_ISO_usagePASSEDNoneself service 
184test_01_snapshot_usagePASSEDNoneself service 
185test_01_template_usagePASSEDNoneself service 
186test_01_vm_usagePASSEDNoneself service 
187test_01_volume_usagePASSEDNoneself service 
188ContextSuite context=TestVMPasswordEnabled>:setupFAILEDSSH connection has Failed. Waited 600s. Error is Connection Failedprovisioning 
189test_deployVmWithCustomDiskPASSEDNoneself service 
190test_create_volume_under_domainPASSEDNoneself service 
      
 Total Time(in hours)6.096176667   

 

 

  • No labels