Print

Handset Test Report: N900 Sanity - Automated 2011-05-04

Contents

  1. Test objective
  2. Build (image)
  3. Test Environment
  4. Quality Summary
  5. Test Results
    1. Result Summary
    2. Test Results by Feature
    3. Detailed Test Results
  6. Issue Summary
  7. Attachments
Author:
Dimpy Adhikary
04 May 2011
Last modified by:
Dimpy Adhikary
04 May 2011
Test execution date, category and build id:
04 May 2011
1.3 ›Handset ›Sanity - Automated ›N900

Test ObjectiveBack to top

Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time.

Automated sanity tests verifies the basic functionality of the features available in MeeGo handset sanity image including performance data measurements.

Build (image)Back to top

Image
http://download.meego.com/trunk-daily/builds/trunk/1.2.80.0.20110502.2/images/meego-handset-armv7hl-n900/meego-handset-armv7hl-n900-1.2.80.0.20110502.2-mmcblk0p.raw.bz2

kernel
http://download.meego.com/trunk-daily/builds/trunk/1.2.80.0.20110502.2/images/meego-handset-armv7hl-n900/meego-handset-armv7hl-n900-1.2.80.0.20110502.2-vmlinuz-2.6.37-11.1-adaptation-n900

ks file
http://download.meego.com/trunk-daily/builds/trunk/1.2.80.0.20110502.2/images/meego-handset-armv7hl-n900/meego-handset-armv7hl-n900-1.2.80.0.20110502.2.ks

Test EnvironmentBack to top

  • Hardware: N900
  • Operator: Airtel 2.5G

Quality SummaryBack to top

Improvements
Bug 16660

Key issues
Bug 16652
Bug 15947
Bug 16664
Bug 16852
Bug 14135
Bug 13856
Bug 12616
Bug 11205
Bug 11079
Bug 11524
Bug 16430

Automation bugs
Bug 11891
Bug 14306
Bug 14305

Crash/Hang
Bug 16664

Other comments
Display is going off frequently during execution (Bug 16652).
Unable to close sms application if try to send sms once.

Test ResultsBack to top

Result Summary

Total test cases35
Passed7
Failed20
N/A8
Run rate77%
Pass rate of total20%
Pass rate of executed26%

Test Results by Feature

FeatureTotalPassedFailedN/APass% CommentsGrading
Home screen30300%
 
 
 
  
Camera20200%
 
 
 
  
Audio20200%
 
 
 
  
Video30300%
 
 
 
  
Photo viewer30300%
 
 
 
  
VKB10010%
 
 
 
  
Connectivity10010%
 
 
 
  
SMS30030%
 
 
 
  
Contacts10100%
 
 
 
  
Dialer50320%
 
 
 
  
Performance1173164%
 
 
 
  
0,7
0,20
0,8
,Current

Detailed Test ResultsDownload as CSVBack to top

Loading history data, please wait…
See only failedSee allSee historyResultNotes
Home screen
FEA_MeeGoUX_Home_Core_Application_LaunchFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Home_Application_SwtichingFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Home_Display_Orientation_DetectionFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
Camera
FEA_MeeGoUX_Camera_UIFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Camera_Capture_ImageFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
Audio
FEA_MeeGoUX_Music_Player_UIFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Music_Player_PlaybackFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
Video
FEA_MeeGoUX_Video_Player_UIFail
Error message 1: Socket reading timeout (25) exceeded for 12 bytes (IOError).
Error message 2: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Video_Player_ThumbnailFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
FEA_MeeGoUX_Video_Player_PlaybackFail
Error message: Unable to connect QTTAS server, verify that it is running properly (192.168.2.15:55535): .
Photo viewer
FEA_MeeGoUX_Photos_UIFail
Bug 16023
FEA_MeeGoUX_Photos_ThumbnailFail
Bug 16023
FEA_MeeGoUX_Photos_SlideshowFail
Bug 16023
VKB
FEA_MeeGoUX_VKB_Via_SMSN/A
Bug 16664
Connectivity
FEA_MeeGoUX_Connectivity_Wifi_SetingsN/A
Bug 11891
SMS
FEA_MeeGoUX_SMS_Send_SMSN/A
Bug 16664
FEA_MeeGoUX_SMS_Receive_SMSN/A
Bug 16664
FEA_MeeGoUX_SMS_HistoryN/A
Bug 16664
Contacts
FEA_MeeGoUX_Contacts_Via_Dialer_SMSFail
Bug 15947
Dialer application did not launch
Dialer
FEA_MeeGoUX_Dialer_Call_HistoryFail
Bug 15947
Dialer application did not launch
FEA_MeeGoUX_Dialer_Outgoing_CallFail
Bug 15947
Dialer application did not launch
FEA_MeeGoUX_Dialer_Incoming_CallN/A
Not supported using single device and commercial operator sim.
FEA_MeeGoUX_Dialer_Reject_CallN/A
Not supported using single device and commercial operator sim.
FEA_MeeGoUX_Dialer_Display_PhonebookFail
Bug 15947
Dialer application did not launch
Performance
FEA_MeeGoUX_Performance_DialerFail
Bug 15947
Dialer application did not launch
FEA_MeeGoUX_Performance_ChatFail
Bug 15947
Dialer application did not launch
FEA_MeeGoUX_Performance_PhotosFail
35.313231 sec
Error Application did not close in time. (RuntimeError) observed while closing Photos application
FEA_MeeGoUX_Performance_SettingsN/A
Bug 11891

Issue SummaryBack to top

Bug 16652
Bug 15947
Bug 16664
Bug 16852
Bug 14135
Bug 13856
Bug 12616
Bug 11205
Bug 11079
Bug 11524
Bug 16430
Bug 11891
Bug 14306
Bug 14305

Original Result Files