11713 - [Trunk:Testing] [REG] zypper & openssh-client is not integrated into netbook image
Netbook Test Report: Pinetrail Sanity 2010-12-15
Contents
Test ObjectiveBack to top
Sanity test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in sanity test reflects the most important and basic functionality of the distribution. Basic performance indicators are also collected in sanity test, including: boot time, shutdown time, suspend time, resume time, and logs will also be collected to help analyzing performance issues if there are any.
Build (image)Back to top
meego-netbook-ia32-1.1.80.10.20101214.1.img
Test EnvironmentBack to top
- Hardware: Pinetrail
Quality SummaryBack to top
Compare with 1207's trunk image sanity pass ratio downgrade to 82%(89%->82%) .Some trunk testing updated packages were be integrated into today's image, whole quality no distinct improvement and device panel & network panel still not work;
Improvement:
Netbook UX:
Performance data:
Improvement:
- mutter,vala,qtcontacts-tracker,testrunner-lite and mutter-meego has updated;
Netbook UX:
- The boot time is increased 7 seconds (9527);
- Language and Time&Date pages in settings menu: missing content (9101);
- Sub-menu of downloads in browser doesn't work(11067);
- [REG] device panel doesn't work(11148);
- [REG] carrick doesn't work(11144);
- [REG] Flash plug-in missed(10894);
- Build-in MIC of Lenovo s10-3t doesn't work(11003);
- [REG]ConnMan fails to connect unencrypted hidden wifi(11068);
Performance data:
- Boot time is 25.744s on HDD disk, 18.354s on SSD disk
Test ResultsBack to top
Result Summary
| Total test cases | 28 | ||
| Passed | 23 | -2 | |
| Failed | 5 | +2 | |
| N/A | 0 | ||
| Run rate | 100% | ||
| Pass rate of total | 82% | -7% | |
| Pass rate of executed | 82% | -7% |
Test Results by Feature
| Feature | Total | Passed | Failed | N/A | Pass% | Comments | Grading | |
|---|---|---|---|---|---|---|---|---|
| Basic linux command such as Zypper install/ debuginfo-install | 1 | 1 | 0 | 0 | 100% | |||
| Peripheral devices (touchpad; USB; SD; LCD) | 4 | 4 | 0 | 0 | 100% | |||
| Device Panel | 1 | 0 | 1 | 0 | 0% | |||
| Multimedia -- audio/video/photo playback; and play views switch | 3 | 3 | 0 | 0 | 100% | |||
| Internet Applications -- Multi-tabs websites surfing and flash plugin check | 2 | 1 | 1 | 0 | 50% | |||
| Myzone - web service; event; favorite apps basic check | 4 | 4 | 0 | 0 | 100% | |||
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications | 3 | 2 | 1 | 0 | 67% | |||
| Network/connectivity - ethernet; wifi connection basic check | 2 | 1 | 1 | 0 | 50% | |||
| Stability | 2 | 2 | 0 | 0 | 100% | |||
| Powertop Log | 1 | 1 | 0 | 0 | 100% | |||
| Suspend & resume | 2 | 1 | 1 | 0 | 50% | |||
| System startup & shutdown | 2 | 2 | 0 | 0 | 100% | |||
| Image update | 1 | 1 | 0 | 0 | 100% |
Detailed Test ResultsDownload as CSVBack to top
| See only failedSee allSee history | Result | Notes |
|---|---|---|
| Basic linux command such as Zypper install/ debuginfo-install | ||
| Peripheral devices (touchpad; USB; SD; LCD) | ||
| Device Panel | ||
| Check if the device panel could basically work | Fail | 11148 - [REG] device panel doesn't work |
| Multimedia -- audio/video/photo playback; and play views switch | ||
| Internet Applications -- Multi-tabs websites surfing and flash plugin check | ||
| Check if flash plugin could basically work | Fail | 10894 - [REG]Flash plug-in is missed |
| Myzone - web service; event; favorite apps basic check | ||
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications | ||
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | 9101 - Language and Time&Date pages in settings menu: missing content 11143- [REG]garage unable to launch |
| Network/connectivity - ethernet; wifi connection basic check | ||
| Wifi scan & associate (check from carrick) | Fail | 11068 -[REG] ConnMan fails to connect unencrypted hidden wifi 11268 - unable to connect 3G network. |
| Stability | ||
| Powertop Log | ||
| Suspend & resume | ||
| Resume | Fail | 3.745s on Dell Mini 9189 - fail to resume from S3 on Dell Mini1012 |
| System startup & shutdown | ||
| Image update | ||
Issue SummaryBack to top
Top bugs (5):
- Boot-time for MeeGo1.2 has 7 secs increment(9527);
- Language and Time&Date pages in settings menu: missing content (9101);
- Sub-menu of downloads in browser doesn't work(11067);
- [REG] device panel doesn't work(11148);
- [REG] carrick doesn't work(11144);
- UI of Chinese system show abnormally(11319);
- Icons in Toolbar settings show abnormally(11321);
- screen brightness change dark after executed "xrandr -o 0" to change display direction in terminal(11323);
- packages queue show in "manage-app" instead of blank(11324);
- "all settings" button is not localized in every settings window(9000);
- [i18N]The title of the Settings window in the zones is not localized(8999);
- [i18N]The title of the Settings window in the zones is not localized(6744);
- "manage app" show duplicate records when press enter key many times(9900);
