Handset Test Report: N900 Sanity - automated 2011-02-02

Test objective
Build (image)
Test Environment
Quality Summary
Test Results

Result Summary
Test Results by Feature
Detailed Test Results

Issue Summary

Author:: Dimpy Adhikary
02 February 2011
Last modified by:: Dimpy Adhikary
02 February 2011
Test execution date, category and build id:: 02 February 2011; 1.2 ›Handset ›Sanity - Automated ›N900

Test ObjectiveBack to top

Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time.

Automated sanity tests verifies the basic functionality of the features available in meego hanset sanity image including performance data mesurements.

Build (image)Back to top

Image:
meego-handset-armv7l-n900-1.1.90.1.20110201.1-mmcblk0p.raw

Kernel version:
meego-handset-armv7l-n900-1.1.90.1.20110201.1-vmlinuz-2.6.35.9-9.2-adaptation-n900

Test EnvironmentBack to top

Hardware: N900
Network: Airtel 2.5G

Quality SummaryBack to top

Improvements

Bug 12076
Bug 9848
Bug 10291

Key issues

Bug 10147

This issue is reproducible manually, but able to execute the scripts using tool.

Functional bugs

Bug 12559 - 5
Bug 8548
Bug 10567 - 1

Automation bugs

Bug 12158 - 1
Bug 11891 - 2
Bug 10384 - 1

Test ResultsBack to top

Previous report Next report

Result Summary

Total test cases	33	-2
Passed	21	+5
Failed	8	-7
N/A	4
Run rate	88%	-1%
Pass rate of total	64%	+18%
Pass rate of executed	72%	+21%

Test Results by Feature

Feature	Total	Passed	Failed	N/A	Pass%
Home screen	3	2	1	0	67%
Audio	2	2	0	0	100%
Video	3	3	0	0	100%
Photo viewer	3	3	0	0	100%
VKB	1	0	1	0	0%
Connectivity	1	0	0	1	0%
SMS	3	0	3	0	0%
Contacts	1	0	1	0	0%
Dialer	5	1	2	2	20%
Performance	11	10	0	1	91%

Detailed Test ResultsDownload as CSVBack to top

Loading history data, please wait…

See only failed See all See history	Result	Notes
Home screen
FEA_MeeGoUX_Home_Core_Application_Launch	Pass
FEA_MeeGoUX_Home_Application_Swtiching	Fail	Bug 12158
FEA_MeeGoUX_Home_Display_Orientation_Detection	Pass	Able to rotate device using script, but manually Bug 8548 is still reproducible.
Audio
FEA_MeeGoUX_Music_Player_UI	Pass
FEA_MeeGoUX_Music_Player_Playback	Pass
Video
FEA_MeeGoUX_Video_Player_UI	Pass
FEA_MeeGoUX_Video_Player_Thumbnail	Pass
FEA_MeeGoUX_Video_Player_Playback	Pass
Photo viewer
FEA_MeeGoUX_Photos_UI	Pass
FEA_MeeGoUX_Photos_Thumbnail	Pass
FEA_MeeGoUX_Photos_Slideshow	Pass
VKB
FEA_MeeGoUX_VKB_Via_SMS	Fail	Bug 10384
Connectivity
FEA_MeeGoUX_Connectivity_Wifi_Setings	N/A
SMS
FEA_MeeGoUX_SMS_History	Fail	Bug 12559
FEA_MeeGoUX_SMS_Send_SMS	Fail	Bug 12559
FEA_MeeGoUX_SMS_Receive_SMS	Fail	Bug 12559
Contacts
FEA_MeeGoUX_Contacts_Via_Dialer_SMS	Fail	Bug 10567
Dialer
FEA_MeeGoUX_Dialer_Call_History	Fail	Bug 12559
FEA_MeeGoUX_Dialer_Outgoing_Call	Fail	Bug 12559
FEA_MeeGoUX_Dialer_Incoming_Call	N/A
FEA_MeeGoUX_Dialer_Reject_Call	N/A
FEA_MeeGoUX_Dialer_Display_Phonebook	Pass
Performance
FEA_MeeGoUX_Performance_Music_Player	Pass	1.648103 sec
FEA_MeeGoUX_Performance_Dialer	Pass	1.09343 sec
FEA_MeeGoUX_Performance_People	Pass	0.877489 sec
FEA_MeeGoUX_Performance_SMS	Pass	0.486489 sec
FEA_MeeGoUX_Performance_Chat	Pass	0.457304 sec
FEA_MeeGoUX_Performance_Calendar	Pass	0.621015 sec
FEA_MeeGoUX_Performance_Mail	Pass	0.524889 sec
FEA_MeeGoUX_Performance_SocialNetworking	Pass	0.39339 sec
FEA_MeeGoUX_Performance_Video_Player	Pass	2.924105 sec
FEA_MeeGoUX_Performance_Photos	Pass	2.134049 sec
FEA_MeeGoUX_Performance_Settings	N/A

See only failed See all See history	30/12	06/01	12/01	19/01	27/01	Current	Latest notes
Home screen
FEA_MeeGoUX_Home_Core_Application_Launch	Pass	Pass	Pass	Pass	Pass	Pass
FEA_MeeGoUX_Home_Application_Swtiching	Fail	Fail	Fail	Fail	Fail	Fail	Bug 12158
FEA_MeeGoUX_Home_Display_Orientation_Detection	Pass	-	Fail	Fail	Pass	Pass	Able to rotate device using script, but manually Bug 8548 is still reproducible.
Audio
FEA_MeeGoUX_Music_Player_UI	Pass	Pass	Fail	Fail	Fail	Pass
FEA_MeeGoUX_Music_Player_Playback	-	-	Fail	Fail	Fail	Pass
Video
FEA_MeeGoUX_Video_Player_UI	Pass	Pass	Pass	Pass	Pass	Pass
FEA_MeeGoUX_Video_Player_Thumbnail	Pass	Pass	Fail	Fail	Fail	Pass
FEA_MeeGoUX_Video_Player_Playback	Pass	-	Fail	Fail	Fail	Pass
Photo viewer
FEA_MeeGoUX_Photos_UI	Pass	Pass	Fail	Fail	Fail	Pass
FEA_MeeGoUX_Photos_Thumbnail	Pass	Fail	Fail	Fail	Fail	Pass
FEA_MeeGoUX_Photos_Slideshow	Pass	Pass	Fail	Fail	Fail	Pass
VKB
FEA_MeeGoUX_VKB_Via_SMS	-	-	Fail	Fail	Fail	Fail	Bug 10384
Connectivity
FEA_MeeGoUX_Connectivity_Wifi_Setings	-	-	N/A	N/A	N/A	N/A
SMS
FEA_MeeGoUX_SMS_History	Fail	-	Fail	N/A	Fail	Fail	Bug 12559
FEA_MeeGoUX_SMS_Send_SMS	Fail	-	Fail	N/A	Fail	Fail	Bug 12559
FEA_MeeGoUX_SMS_Receive_SMS	Fail	-	Fail	N/A	Fail	Fail	Bug 12559
Contacts
FEA_MeeGoUX_Contacts_Via_Dialer_SMS	-	-	-	-	-	Fail	Bug 10567
Dialer
FEA_MeeGoUX_Dialer_Call_History	Pass	-	Pass	Pass	Fail	Fail	Bug 12559
FEA_MeeGoUX_Dialer_Outgoing_Call	Fail	-	Pass	Pass	Fail	Fail	Bug 12559
FEA_MeeGoUX_Dialer_Incoming_Call	Fail	-	N/A	N/A	N/A	N/A
FEA_MeeGoUX_Dialer_Reject_Call	Fail	-	N/A	N/A	N/A	N/A
FEA_MeeGoUX_Dialer_Display_Phonebook	Pass	Pass	Pass	Fail	Pass	Pass
Performance
FEA_MeeGoUX_Performance_Music_Player	Pass	Pass	Pass	Pass	Pass	Pass	1.648103 sec
FEA_MeeGoUX_Performance_Dialer	Pass	Pass	Pass	Pass	Pass	Pass	1.09343 sec
FEA_MeeGoUX_Performance_People	Pass	Pass	Pass	Pass	Pass	Pass	0.877489 sec
FEA_MeeGoUX_Performance_SMS	Pass	Pass	Pass	Pass	Pass	Pass	0.486489 sec
FEA_MeeGoUX_Performance_Chat	Pass	Pass	Pass	Pass	Pass	Pass	0.457304 sec
FEA_MeeGoUX_Performance_Calendar	Pass	Pass	Pass	Pass	Pass	Pass	0.621015 sec
FEA_MeeGoUX_Performance_Mail	Pass	Pass	Pass	Pass	Pass	Pass	0.524889 sec
FEA_MeeGoUX_Performance_SocialNetworking	Pass	Pass	Pass	Pass	Pass	Pass	0.39339 sec
FEA_MeeGoUX_Performance_Video_Player	Pass	Pass	Pass	Pass	Pass	Pass	2.924105 sec
FEA_MeeGoUX_Performance_Photos	Pass	Pass	Pass	Pass	Pass	Pass	2.134049 sec
FEA_MeeGoUX_Performance_Settings	-	-	N/A	N/A	N/A	N/A

Issue SummaryBack to top

New issues reported
No new bug reported.

Top issues

Bug 10567
Bug 12559
Bug 8548
Bug 12158
Bug 11891
Bug 10384

Original Result Files

No result files available

MeeGo | QA Reports

Handset Test Report: N900 Sanity - automated 2011-02-02

Contents

Test ObjectiveBack to top

Build (image)Back to top

Test EnvironmentBack to top

Quality SummaryBack to top

Test ResultsBack to top

Result Summary

Test Results by Feature

Detailed Test ResultsDownload as CSVBack to top

Issue SummaryBack to top

Original Result Files

test case name

Usage

test case name

Usage

test case name

Legend

Usage