Netbook Test Report: Pinetrail Sanity 2011-09-06
MeeGo 1.1 Update 7daily test is a very brief run-through of the functionality of entire MeeGo 1.1 system updated distribution (Netbook, Core, ), to assure that the basic health of the distribution after system update and report major regressions at the earliest time. 2 kinds of checkpoints will be covered in 1.1 update 7daily test: sanity checkpoints to cover the most important and basic functionalities of the updated distribution with basic performance indicators, and user data preserving checkpoints to ensure user data/setting will not be changed after system update.
- Image: 1.1 release: meego-netbook-ia32-1.1.img
- Update repo(Official):http://repo.meego.com/MeeGo/updates/1.1/
- Hardware: Sumsung NP-NC110,Lenovo S10-3t
QA completed sanity testing for 1.1 SW update cover UX and Core, pass ratio is 92%, the whole quality is stable, compare with 0825's update. No new update regression issue was found by QA.
Improvement:
■
22757Key Issues:
•
22643•
15481•
16936Result Summary
| Total test cases | 69 | | |
| Passed | 53 | -1 |
| Failed | 4 | -1 |
| N/A | 12 | +2 |
| Run rate | 83% | -3% |
| Pass rate of total | 77% | -1% |
| Pass rate of executed | 93% | +1% |
Test Results by Feature
54,54,53
4,5,4
11,10,12
2011-08-15,2011-08-25,Current
Loading history data, please wait…
| See only failedSee allSee history | Result | Notes |
|---|
| OpenGL ES2 |
| OpenGL-Simple triangle | Fail | Bug 22643 - Test Cases for OpenGL Failed
|
| OpenGL-Blit with blend and animated widgets with shadows | Fail | Bug 22643 - Test Cases for OpenGL Failed
|
| Network/connectivity - ethernet; wifi connection basic check |
| Wifi scan & associate (check from carrick) | N/A | no wifi panel in network panel samsung np-nc110
|
| Check Ethernet connection | Pass | |
| PulseAudio |
| Audio playback | Pass | |
| Audio record | Pass | |
| Telepathy (IM) |
| Send gtalk IM | N/A | Bug 12069 - Sometimes, audio call unable to answer in IM.
|
| Receive gtalk IM | N/A | Bug 12069 - Sometimes, audio call unable to answer in IM.
|
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | |
| Check if flash plugin could basically work | Fail | Bug 15481 - [REG][chromium]Flash plug-in is out of date
|
| ALSA |
| Audio record | Pass | |
| Audio playback (PCM) | Pass | |
| Startup |
| system bootup and shutdown | Pass | |
| no obvious regression on boot time | Pass | |
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | |
| Image update |
| Packages can be updated by system update app | Pass | |
| V4L2 |
| video capture with V4L2 interface | Pass | |
| still image capture | Pass | |
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | |
| Device Panel |
| Check if the device panel could basically work | Pass | |
| System startup & shutdown |
| Shutdown | Pass | 7.437s on samsung np-nc110
|
| Boot from local disk | Pass | Stopwatch: 23.719s on samsung np-nc110
Bootchart:
22.448s on samsung np-nc110
|
| oFono |
| accept an incoming call | N/A | |
| make a call successfully | N/A | |
| Send sms | N/A | |
| Receive sms | N/A | |
| Sensorfw |
| To be added | N/A | |
| Myzone - web service; event; favorite apps basic check |
| Check if web services could be fetched; | Pass | |
| Check if new dates&tasks could be displayed | Pass | |
| Check browser history and recent docs | Pass | |
| Check if UI is correct; | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | Bug 16936 - [REG]Error initializing garage client services library
|
| Connman |
| Guest WiFi nework | N/A | |
| 3G data connection | Pass | SumSung 005
doesn't have build-in 3G modem
|
| Ethernet nework | Pass | |
| Bluetooth |
| Bluetooth Scan | Pass | |
| Peripheral devices (touchpad; USB; SD; LCD) |
| USB stick/SD/LCD | Pass | |
| Touchpad | Pass | |
| USB keyboard/mouse | Pass | |
| External monitor | Pass | |
| Tracker |
| search out music files | Pass | |
| Search out image files | Pass | |
| search out video files | Pass | |
| syncevolution |
| all contacts are synced and contacts on client and server keep identical after each sync | Pass | |
| X11 |
| Display rotate | Pass | |
| sets resolution with xrandr | Pass | |
| Overall |
| no process eats unusual memory | Pass | |
| usb storage can be recognized | Pass | |
| no process to eat CPU incrediblely a lot | Pass | |
| Suspend & resume |
| Resume | Pass | 4.531 on samsung np-nc110
|
| Suspend via closing lid and cmd | Pass | 3.5s on samsung np-nc110
|
| QT paint |
| Transformation of QPainter rendered graphics primitives | N/A | |
| QPainter class basic functions | N/A | |
| QPainterPath clas basic functions | N/A | |
| Input |
| Keypad works | Pass | |
| touchscreen works | Pass | |
| Power Button works | Pass | |
| Package Management |
| pkcon: install/remove/update packages | Pass | |
| PIM Service |
| add a contact | Pass | |
| search the contact | Pass | |
| remove a contact | Pass | |
| Gstreamer |
| video playback (ogg) | Pass | |
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Pass | |
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | C4 mwait 19.3ms(97.6%)
wakeups 36.5 interval:60.0s
|
| See only failedSee allSee history | 18/05 |
14/06 |
08/07 |
15/08 |
25/08 | Current | Latest notes |
|---|
| OpenGL ES2 |
| OpenGL-Simple triangle | - | - | Fail | Fail | Fail | Fail | Bug 22643 - Test Cases for OpenGL Failed
|
| OpenGL-Blit with blend and animated widgets with shadows | - | - | Fail | Fail | Fail | Fail | Bug 22643 - Test Cases for OpenGL Failed
|
| Network/connectivity - ethernet; wifi connection basic check |
| Wifi scan & associate (check from carrick) | Pass | Pass | Fail | N/A | Pass | N/A | no wifi panel in network panel samsung np-nc110
|
| Check Ethernet connection | Pass | Pass | Pass | Pass | Pass | Pass | |
| PulseAudio |
| Audio playback | - | - | Pass | Pass | Pass | Pass | |
| Audio record | - | - | Pass | Pass | Pass | Pass | |
| Telepathy (IM) |
| Send gtalk IM | - | - | N/A | N/A | N/A | N/A | Bug 12069 - Sometimes, audio call unable to answer in IM.
|
| Receive gtalk IM | - | - | N/A | N/A | N/A | N/A | Bug 12069 - Sometimes, audio call unable to answer in IM.
|
| Internet Applications -- Multi-tabs websites surfing and flash plugin check |
| Open 2 tabs to surf 2 websites | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if flash plugin could basically work | Fail | Fail | Pass | Fail | Fail | Fail | Bug 15481 - [REG][chromium]Flash plug-in is out of date
|
| ALSA |
| Audio record | Pass | Pass | Pass | Pass | Pass | Pass | |
| Audio playback (PCM) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Startup |
| system bootup and shutdown | - | - | Pass | Pass | Pass | Pass | |
| no obvious regression on boot time | - | - | Pass | Pass | Pass | Pass | |
| Multimedia -- audio/video/photo playback; and play views switch |
| Check if the UI is correct (top bar; side bar; play queue) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if thumbnail/index of sample picture/video works | Pass | Pass | Fail | Pass | Pass | Pass | |
| Check if sample audio/video/photo could playback successfully. | Pass | Pass | Pass | Pass | Pass | Pass | |
| Image update |
| Packages can be updated by system update app | Pass | Pass | Pass | Pass | Fail | Pass | |
| V4L2 |
| video capture with V4L2 interface | Pass | Pass | Pass | Pass | Pass | Pass | |
| still image capture | Pass | Pass | Pass | Pass | Pass | Pass | |
| Basic linux command such as Zypper install/ debuginfo-install |
| Zypper install/default repo configuration | Pass | Pass | Pass | Pass | Pass | Pass | |
| Device Panel |
| Check if the device panel could basically work | Pass | Pass | Pass | Pass | Pass | Pass | |
| System startup & shutdown |
| Shutdown | Pass | Pass | Pass | Pass | Pass | Pass | 7.437s on samsung np-nc110
|
| Boot from local disk | Pass | Pass | Pass | Pass | Pass | Pass | Stopwatch: 23.719s on samsung np-nc110
Bootchart:
22.448s on samsung np-nc110
|
| oFono |
| accept an incoming call | - | - | N/A | N/A | N/A | N/A | |
| make a call successfully | - | - | N/A | N/A | N/A | N/A | |
| Send sms | - | - | N/A | N/A | N/A | N/A | |
| Receive sms | - | - | N/A | N/A | N/A | N/A | |
| Sensorfw |
| To be added | - | - | N/A | N/A | N/A | N/A | |
| Myzone - web service; event; favorite apps basic check |
| Check if web services could be fetched; | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if new dates&tasks could be displayed | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check browser history and recent docs | Pass | Pass | Pass | Pass | Pass | Pass | |
| Check if UI is correct; | Pass | Pass | Pass | Pass | Pass | Pass | |
| UI shell - dropdown panels basic check; zones switch; application launcher to launch key applications |
| Dropdown panel: click icons on drop down panel to check corresponding panels could launched | Pass | Pass | Pass | Pass | Pass | Pass | |
| Zones: switch in zone panel; drag application to another zone; switch by alt+tab | Pass | Pass | Pass | Pass | Pass | Pass | |
| App-launcher: check if the UI is correct; check if key applications (browser; media; about MeeGo; settings) could be launched; | Fail | Fail | Fail | Fail | Fail | Fail | Bug 16936 - [REG]Error initializing garage client services library
|
| Connman |
| Guest WiFi nework | - | - | Pass | Pass | Pass | N/A | |
| 3G data connection | - | - | N/A | Pass | Pass | Pass | SumSung 005
doesn't have build-in 3G modem
|
| Ethernet nework | - | - | Pass | Pass | Pass | Pass | |
| Bluetooth |
| Bluetooth Scan | Pass | Pass | Pass | Pass | Pass | Pass | |
| Peripheral devices (touchpad; USB; SD; LCD) |
| USB stick/SD/LCD | Pass | Pass | Pass | Pass | Pass | Pass | |
| Touchpad | Pass | Pass | Pass | Pass | Pass | Pass | |
| USB keyboard/mouse | Pass | Pass | Pass | Pass | Pass | Pass | |
| External monitor | Pass | Pass | Pass | Pass | Pass | Pass | |
| Tracker |
| search out music files | - | - | Pass | Pass | Pass | Pass | |
| Search out image files | - | - | Pass | Pass | Pass | Pass | |
| search out video files | - | - | Pass | Pass | Pass | Pass | |
| syncevolution |
| all contacts are synced and contacts on client and server keep identical after each sync | - | - | N/A | Pass | Pass | Pass | |
| X11 |
| Display rotate | - | - | Pass | Pass | Pass | Pass | |
| sets resolution with xrandr | - | - | Pass | Pass | Pass | Pass | |
| Overall |
| no process eats unusual memory | - | - | Pass | Pass | Pass | Pass | |
| usb storage can be recognized | - | - | Pass | Pass | Pass | Pass | |
| no process to eat CPU incrediblely a lot | - | - | Pass | Pass | Pass | Pass | |
| Suspend & resume |
| Resume | Pass | Pass | Pass | Pass | Pass | Pass | 4.531 on samsung np-nc110
|
| Suspend via closing lid and cmd | Pass | Pass | Pass | Pass | Pass | Pass | 3.5s on samsung np-nc110
|
| QT paint |
| Transformation of QPainter rendered graphics primitives | - | - | N/A | N/A | N/A | N/A | |
| QPainter class basic functions | - | - | N/A | N/A | N/A | N/A | |
| QPainterPath clas basic functions | - | - | N/A | N/A | N/A | N/A | |
| Input |
| Keypad works | - | - | Pass | Pass | Pass | Pass | |
| touchscreen works | - | - | Pass | Pass | Pass | Pass | |
| Power Button works | - | - | Pass | Pass | Pass | Pass | |
| Package Management |
| pkcon: install/remove/update packages | - | - | Pass | Pass | Pass | Pass | |
| PIM Service |
| add a contact | - | - | N/A | Pass | Pass | Pass | |
| search the contact | - | - | N/A | Pass | Pass | Pass | |
| remove a contact | - | - | N/A | Pass | Pass | Pass | |
| Gstreamer |
| video playback (ogg) | - | - | Pass | Pass | Pass | Pass | |
| Stability |
| Shutdown and Reboot system 10 times without failure or crash | Pass | Pass | Pass | Pass | Pass | Pass | |
| Use multiple applications (>8; media player; browser; IM; email; and so on) based on scopes defined in other checkpoints | Pass | Pass | Pass | Pass | Pass | Pass | |
| Powertop Log |
| Cn state avg residency
Wakeup times | Pass | Pass | Pass | Pass | Pass | Pass | C4 mwait 19.3ms(97.6%)
wakeups 36.5 interval:60.0s
|
Top bugs (3):
•
22643•
15481•
16936
Original Result Files