Netbook Test Report: Pinetrail Sanity 2011-01-12
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.
meego-netbook-ia32-1.1.80.14.20110111.8.img
Sanity pass ratio is 75%, whole quality keep stably. Expect some old bugs ,such as boot time has 7s increase(9527) , device panel doesn’t work(11148) and etc, no regression issue found by QA. latest boot time on HHD is 29.015s.
Improvement:
Key Issues:
- The boot time is increased 7 seconds (9527);
- Language and Time&Date pages in settings menu: missing content (9101);
- [REG] device panel doesn't work(11148);
- [REG]garage unable to launch(11143)
- [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client(12011)
Performance data:
- Boot time is 29.015s on HDD disk, 18.907son SSD disk on Dell mini;
Result Summary
| Total test cases | 28 | | |
| Passed | 21 | |
| Failed | 7 | |
| N/A | 0 | |
| Run rate | 100% | |
| Pass rate of total | 75% | |
| Pass rate of executed | 75% | |
Test Results by Feature
21,21,21
7,7,7
0,0,0
2011-01-10,2011-01-11,Current
Loading history data, please wait…
| See only failedSee allSee history | Result | Notes |
|---|
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | |
| Peripheral devices (touchpad; USB; SD; LCD) |
| Touchpad | Pass | 6176 - occasionally touch pad unable to work in some netbooks
|
| USB keyboard/mouse | Pass | |
| External monitor | Pass | |
| USB stick/SD/LCD | Pass | |
| Device Panel |
| Check if the device panel could basically work | Fail | 11148 - [REG] device panel doesn't work
|
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | |
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | |
| Check if flash plugin could basically work | Fail | 10894 - [REG]Flash plug-in is missed
|
| Myzone - web service; event; favorite apps basic check |
| Check if UI is correct; | Pass | |
| Check if web services could be fetched; | Fail | 12011 - [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client
|
| Check if new dates&tasks could be displayed | Pass | |
| Check browser history and recent docs | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | 9101 - Language and Time&Date pages in settings menu: missing content 11143- [REG]garage unable to launch
|
| Network/connectivity - ethernet; wifi connection basic check |
| Check Ethernet connection | Pass | |
| Wifi scan & associate (check from carrick) | Fail | 11068 -[REG] ConnMan fails to connect unencrypted hidden wifi
|
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Fail | unable to launch Meego Help.
|
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | C4 mwait 3.0ms (45.4%) Wakeups/60Sec :220.3on DELL mini
|
| Suspend & resume |
| Suspend via closing lid and cmd | Pass | 5.359s on Dell Mini
|
| Resume | Fail | 3.469s on Dell Mini 9189 - fail to resume from S3 on Dell Mini1012
|
| System startup & shutdown |
| Boot from local disk | Pass | Stopwatch:s 29.562s on Dell mini; 18.568s on Eeepc; Bootchart: 29.015s on Dell mini; 18.907s on Eeepc;
|
| Shutdown | Pass | 7.344s on Dell Mini
|
| Image update |
| Packages can be updated by system update app | Pass | |
| See only failedSee allSee history | 21/12 |
23/12 |
06/01 |
10/01 |
11/01 | Current | Latest notes |
|---|
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | Pass | Pass | Pass | Pass | Pass | |
| Peripheral devices (touchpad; USB; SD; LCD) |
| Touchpad | Pass | Pass | Pass | Pass | Pass | Pass | 6176 - occasionally touch pad unable to work in some netbooks
|
| USB keyboard/mouse | Pass | Pass | Pass | Pass | Pass | Pass | |
| External monitor | Pass | Pass | Pass | Pass | Pass | Pass | |
| USB stick/SD/LCD | Pass | Pass | Pass | Pass | Pass | Pass | |
| Device Panel |
| Check if the device panel could basically work | Fail | Fail | Fail | Fail | Fail | Fail | 11148 - [REG] device panel doesn't work
|
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | Pass | Pass | Pass | Pass | Pass | |
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if flash plugin could basically work | Fail | Fail | Fail | Fail | Fail | Fail | 10894 - [REG]Flash plug-in is missed
|
| Myzone - web service; event; favorite apps basic check |
| Check if UI is correct; | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if web services could be fetched; | Fail | Fail | Fail | Fail | Fail | Fail | 12011 - [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client
|
| Check if new dates&tasks could be displayed | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check browser history and recent docs | Pass | Pass | Pass | Pass | Pass | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Fail | Pass | Pass | Pass | Pass | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | Pass | Pass | Pass | Pass | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | Fail | Fail | Fail | Fail | Fail | 9101 - Language and Time&Date pages in settings menu: missing content 11143- [REG]garage unable to launch
|
| Network/connectivity - ethernet; wifi connection basic check |
| Check Ethernet connection | Pass | Pass | Pass | Pass | Pass | Pass | |
| Wifi scan & associate (check from carrick) | Pass | Fail | Fail | Fail | Fail | Fail | 11068 -[REG] ConnMan fails to connect unencrypted hidden wifi
|
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | Pass | Pass | Pass | Pass | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Fail | Fail | - | - | Fail | Fail | unable to launch Meego Help.
|
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | Pass | Pass | Pass | Pass | Pass | C4 mwait 3.0ms (45.4%) Wakeups/60Sec :220.3on DELL mini
|
| Suspend & resume |
| Suspend via closing lid and cmd | Pass | Pass | Pass | Pass | Pass | Pass | 5.359s on Dell Mini
|
| Resume | Fail | Fail | Fail | Fail | Fail | Fail | 3.469s on Dell Mini 9189 - fail to resume from S3 on Dell Mini1012
|
| System startup & shutdown |
| Boot from local disk | Pass | Pass | Pass | Pass | Pass | Pass | Stopwatch:s 29.562s on Dell mini; 18.568s on Eeepc; Bootchart: 29.015s on Dell mini; 18.907s on Eeepc;
|
| Shutdown | Pass | Pass | Pass | Pass | Pass | Pass | 7.344s on Dell Mini
|
| Image update |
| Packages can be updated by system update app | Pass | Pass | Pass | Pass | Pass | Pass | |
Top bugs (6):
- Boot-time for MeeGo1.2 has 7 secs increment(9527);
- Language and Time&Date pages in settings menu: missing content (9101);
- [REG] device panel doesn't work(11148);
- [REG][testing-daily]Fail to login Gtalk/jabber/MSN by IM client(12011)
- [REG]Flash plug-in is missed(10894)
- garage unable to launch(11143)

Original Result Files
No result files available