Print

Netbook Test Report: Pinetrail Sanity 2011-01-12

Contents

  1. Test objective
  2. Build (image)
  3. Test Environment
  4. Quality Summary
  5. Test Results
    1. Result Summary
    2. Test Results by Feature
    3. Detailed Test Results
  6. Issue Summary
Author:
Daniel Tao
12 January 2011
Last modified by:
Daniel Tao
12 January 2011
Test execution date, category and build id:
12 January 2011
1.2 ›Netbook ›Sanity ›Pinetrail

Test ObjectiveBack to top

Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.

Build (image)Back to top

meego-netbook-ia32-1.1.80.14.20110111.8.img

Test EnvironmentBack to top

  • Hardware: Pinetrail

Quality SummaryBack to top

Sanity pass ratio is 75%, whole quality keep stably. Expect some old bugs ,such as boot time has 7s increase(9527) , device panel doesn’t work(11148) and etc, no regression issue found by QA. latest boot time on HHD is 29.015s.

Improvement:
  • N/A;
Key Issues:
  • The boot time is increased 7 seconds (9527);
  • Language and Time&Date pages in settings menu: missing content (9101);
  • [REG] device panel doesn't work(11148);
  • [REG]garage unable to launch(11143)
  • [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client(12011)

Performance data:
  • Boot time is 29.015s on HDD disk, 18.907son SSD disk on Dell mini;

Test ResultsBack to top

Result Summary

Total test cases28
Passed21
Failed7
N/A0
Run rate100%
Pass rate of total75%
Pass rate of executed75%

Test Results by Feature

FeatureTotalPassedFailedN/APass% CommentsGrading
Basic linux command such as Zypper install/ debuginfo-install1100100%
 
 
 
  
Peripheral devices (touchpad; USB; SD; LCD)4400100%
 
 
 
  
Device Panel10100%
 
 
 
  
Multimedia -- audio/video/photo playback; and play views switch3300100%
 
 
 
  
Internet Applications -- Multi-tabs websites surfing and flash plugin check211050%
 
 
 
  
Myzone - web service; event; favorite apps basic check431075%
 
 
 
  
UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications321067%
 
 
 
  
Network/connectivity - ethernet; wifi connection basic check211050%
 
 
 
  
Stability211050%
 
 
 
  
Powertop Log1100100%
 
 
 
  
Suspend & resume211050%
 
 
 
  
System startup & shutdown2200100%
 
 
 
  
Image update1100100%
 
 
 
  
21,21,21
7,7,7
0,0,0
2011-01-10,2011-01-11,Current

Detailed Test ResultsDownload as CSVBack to top

Loading history data, please wait…
See only failedSee allSee historyResultNotes
Basic linux command such as Zypper install/ debuginfo-install
Peripheral devices (touchpad; USB; SD; LCD)
Device Panel
Check if the device panel could basically workFail
11148 - [REG] device panel doesn't work
Multimedia -- audio/video/photo playback; and play views switch
Internet Applications -- Multi-tabs websites surfing and flash plugin check
Check if flash plugin could basically workFail
10894 - [REG]Flash plug-in is missed
Myzone - web service; event; favorite apps basic check
Check if web services could be fetched;Fail
12011 - [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client
UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications
App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched;Fail
9101 - Language and Time&Date pages in settings menu: missing content
11143- [REG]garage unable to launch
Network/connectivity - ethernet; wifi connection basic check
Wifi scan & associate (check from carrick)Fail
11068 -[REG] ConnMan fails to connect unencrypted hidden wifi
Stability
Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpointsFail
unable to launch Meego Help.
Powertop Log
Suspend & resume
ResumeFail
3.469s on Dell Mini
9189 - fail to resume from S3 on Dell Mini1012
System startup & shutdown
Image update

Issue SummaryBack to top

Top bugs (6):
  • Boot-time for MeeGo1.2 has 7 secs increment(9527);
  • Language and Time&Date pages in settings menu: missing content (9101);
  • [REG] device panel doesn't work(11148);
  • [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client(12011)
  • [REG]Flash plug-in is missed(10894)
  • garage unable to launch(11143)

Original Result Files

No result files available