Netbook Test Report: Pinetrail Sanity 2010-12-01
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.
meego-netbook-ia32-1.1.80.8.20101130.1.img
Sanity Pass ratio is 89.7% and whole image quality is improved (86.2% -> 89.7%) compared with 1126 image. Evolution is updated, we can send and receive email by evolution now. But Several 1.1 release block bug fixes are not integrated into trunk image.
Improvement:
- Evolution is updated and we can send and receive email now;
Key Issues:
Netbook UX:
- The boot time is increased 7 seconds (9527);
- Language and Time&Date pages in settings menu: missing content (9101);
- 3 icons missing in setting UI (9102);
Core:
- We can’t use V4L2 to record media stream, but cheese works well.
Performance data:
- Boot time is 23.227s on HDD disk, 19.887s on SSD disk
Result Summary
| Total test cases | 28 | | |
| Passed | 25 | +1 |
| Failed | 3 | -1 |
| N/A | 0 | |
| Run rate | 100% | |
| Pass rate of total | 89% | +4% |
| Pass rate of executed | 89% | +4% |
Test Results by Feature
25,24,25
3,4,3
0,0,0
2010-11-24,2010-11-29,Current
Loading history data, please wait…
| See only failedSee allSee history | Result | Notes |
|---|
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | 9087 - signature verification fail when install package with zypper
|
| Peripheral devices (touchpad; USB; SD; LCD) |
| Touchpad | Pass | |
| USB keyboard/mouse | Pass | |
| External monitor | Pass | |
| USB stick/SD/LCD | Pass | |
| Device Panel |
| Check if the device panel could basically work | Pass | |
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | |
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | |
| Check if flash plugin could basically work | Pass | |
| Myzone - web service; event; favorite apps basic check |
| Check if UI is correct; | Fail | 9102 - 3 icons missing in setting UI
|
| Check if web services could be fetched; | Pass | |
| Check if new dates&tasks could be displayed | Pass | |
| Check browser history and recent docs | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | 9101 - Language and Time&Date pages in settings menu: missing content
|
| Network/connectivity - ethernet; wifi connection basic check |
| Check Ethernet connection | Pass | |
| Wifi scan & associate (check from carrick) | Pass | |
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Pass | |
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | C4 mwait 2.8ms (36.4%) Wakeups/60Sec :178.6 on DELL mini
|
| Suspend & resume |
| Suspend via closing lid and cmd | Pass | 4.221s on Dell Mini
|
| Resume | Fail | 3.897s on Dell Mini 9189 - fail to resume from S3 on Dell Mini1012
|
| System startup & shutdown |
| Boot from local disk | Pass | Stopwatch: 24.050s on Dell mini; 16.425s on Eeepc; Bootchart: 23.227s on Dell mini; 19.887s on Eeepc;
|
| Shutdown | Pass | 5.717s on Dell Mini
|
| Image update |
| Packages can be updated by system update app | Pass | |
| See only failedSee allSee history | 15/11 |
17/11 |
22/11 |
24/11 |
29/11 | Current | Latest notes |
|---|
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | Pass | Pass | Pass | Pass | Pass | 9087 - signature verification fail when install package with zypper
|
| Peripheral devices (touchpad; USB; SD; LCD) |
| Touchpad | Pass | Pass | Pass | Pass | Pass | Pass | |
| USB keyboard/mouse | Pass | Pass | Pass | Pass | Pass | Pass | |
| External monitor | Pass | Pass | Pass | Pass | Pass | Pass | |
| USB stick/SD/LCD | Pass | Pass | Pass | Pass | Pass | Pass | |
| Device Panel |
| Check if the device panel could basically work | Pass | Pass | Pass | Pass | Pass | Pass | |
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | Pass | Pass | Pass | Pass | Pass | |
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if flash plugin could basically work | Pass | Pass | Pass | Pass | Pass | Pass | |
| Myzone - web service; event; favorite apps basic check |
| Check if UI is correct; | Fail | Fail | Fail | Fail | Fail | Fail | 9102 - 3 icons missing in setting UI
|
| Check if web services could be fetched; | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if new dates&tasks could be displayed | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check browser history and recent docs | Pass | Pass | Pass | Pass | Pass | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Pass | Pass | Pass | Pass | Pass | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | Pass | Pass | Pass | Pass | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | Fail | Fail | Fail | Fail | Fail | 9101 - Language and Time&Date pages in settings menu: missing content
|
| Network/connectivity - ethernet; wifi connection basic check |
| Check Ethernet connection | Pass | Pass | Pass | Pass | Pass | Pass | |
| Wifi scan & associate (check from carrick) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | Pass | Pass | Pass | Pass | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Pass | Pass | Pass | Pass | Fail | Pass | |
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | Pass | Pass | Pass | Pass | Pass | C4 mwait 2.8ms (36.4%) Wakeups/60Sec :178.6 on DELL mini
|
| Suspend & resume |
| Suspend via closing lid and cmd | Pass | Pass | Pass | Pass | Pass | Pass | 4.221s on Dell Mini
|
| Resume | Fail | Fail | Fail | Fail | Fail | Fail | 3.897s on Dell Mini 9189 - fail to resume from S3 on Dell Mini1012
|
| System startup & shutdown |
| Boot from local disk | Pass | Pass | Pass | Pass | Pass | Pass | Stopwatch: 24.050s on Dell mini; 16.425s on Eeepc; Bootchart: 23.227s on Dell mini; 19.887s on Eeepc;
|
| Shutdown | Pass | Pass | Pass | Pass | Pass | Pass | 5.717s on Dell Mini
|
| Image update |
| Packages can be updated by system update app | Pass | Pass | Pass | Pass | Pass | Pass | |
Top bugs (3):
- 9527 - Boot-time for MeeGo1.2 has 7 secs increment
- 9101 - Language and Time&Date pages in settings menu: missing content
- 9102 - 3 icons missing in setting UI
New bugs (0):
Verified bugs (0):

Original Result Files
No result files available