Print

Netbook Test Report: Pinetrail Sanity 2010-12-01

Contents

  1. Test objective
  2. Build (image)
  3. Test Environment
  4. Quality Summary
  5. Test Results
    1. Result Summary
    2. Test Results by Feature
    3. Detailed Test Results
  6. Issue Summary
Author:
Daniel Tao
01 December 2010
Last modified by:
Daniel Tao
03 December 2010
Test execution date, category and build id:
01 December 2010
1.2 ›Netbook ›Sanity ›Pinetrail

Test ObjectiveBack to top

Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.

Build (image)Back to top

meego-netbook-ia32-1.1.80.8.20101130.1.img

Test EnvironmentBack to top

  • Hardware: Pinetrail

Quality SummaryBack to top

Sanity Pass ratio is 89.7% and whole image quality is improved (86.2% -> 89.7%) compared with 1126 image. Evolution is updated, we can send and receive email by evolution now. But Several 1.1 release block bug fixes are not integrated into trunk image.

Improvement:
  • Evolution is updated and we can send and receive email now;
Key Issues:
Netbook UX:
  • The boot time is increased 7 seconds (9527);
  • Language and Time&Date pages in settings menu: missing content (9101);
  • 3 icons missing in setting UI (9102);
Core:
  • We can’t use V4L2 to record media stream, but cheese works well.
Performance data:
  • Boot time is 23.227s on HDD disk, 19.887s on SSD disk

Test ResultsBack to top

Result Summary

Total test cases28
Passed25+1
Failed3-1
N/A0
Run rate100%
Pass rate of total89%+4%
Pass rate of executed89%+4%

Test Results by Feature

FeatureTotalPassedFailedN/APass% CommentsGrading
Basic linux command such as Zypper install/ debuginfo-install1100100%
 
 
 
  
Peripheral devices (touchpad; USB; SD; LCD)4400100%
 
 
 
  
Device Panel1100100%
 
 
 
  
Multimedia -- audio/video/photo playback; and play views switch3300100%
 
 
 
  
Internet Applications -- Multi-tabs websites surfing and flash plugin check2200100%
 
 
 
  
Myzone - web service; event; favorite apps basic check431075%
 
 
 
  
UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications321067%
 
 
 
  
Network/connectivity - ethernet; wifi connection basic check2200100%
 
 
 
  
Stability2200100%
 
 
 
  
Powertop Log1100100%
 
 
 
  
Suspend & resume211050%
 
 
 
  
System startup & shutdown2200100%
 
 
 
  
Image update1100100%
 
 
 
  
25,24,25
3,4,3
0,0,0
2010-11-24,2010-11-29,Current

Detailed Test ResultsDownload as CSVBack to top

Loading history data, please wait…
See only failedSee allSee historyResultNotes
Basic linux command such as Zypper install/ debuginfo-install
Peripheral devices (touchpad; USB; SD; LCD)
Device Panel
Multimedia -- audio/video/photo playback; and play views switch
Internet Applications -- Multi-tabs websites surfing and flash plugin check
Myzone - web service; event; favorite apps basic check
Check if UI is correct;Fail
9102 - 3 icons missing in setting UI
UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications
App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched;Fail
9101 - Language and Time&Date pages in settings menu: missing content
Network/connectivity - ethernet; wifi connection basic check
Stability
Powertop Log
Suspend & resume
ResumeFail
3.897s on Dell Mini
9189 - fail to resume from S3 on Dell Mini1012
System startup & shutdown
Image update

Issue SummaryBack to top

Top bugs (3):
  • 9527 - Boot-time for MeeGo1.2 has 7 secs increment
  • 9101 - Language and Time&Date pages in settings menu: missing content
  • 9102 - 3 icons missing in setting UI
New bugs (0):
  • N/A
Verified bugs (0):
  • N/A

Original Result Files

No result files available