Handset Test Report: N900CE Acceptance 2011-09-16
Acceptance test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in acceptance test reflects the most important and basic functionalities of the distribution. We do the acceptance test against DE Trunk:Testing repo. Main focus areas are 'voice call, SMS, Broeser, common SW and Camera'
Image: http://repository.maemo.org/meego/n900-de/daily/1.2.90.3.0.20110909.81.CE.2011-09-15.1/images/mg-handset-armv7nhl-n900-ce-testing/
Improvements:172311740822524Key Issues:182981139116834172592313023132231332313523138231412314223143Run rate and Pass rate affected because of following reasons:2313023132113911829822662231352314116834160311725923143231372313923142Performance data:- Device Boot up time 76 sec
- Browser (fennec) N/A
- Browser (Helium) start time 9 sec
- Dialer start time N/A
- SMS start time N/A
Key Packages
mobilebrowser.armv7hl 1.0-2.15.CE
meego-handset-dialer - this package is missing, from packages!!!
meego-handset-sms.armv7hl 0.1.2-7.1.CE
ofono.armv7hl 0.52-3.2
phonesim-* - this package is missing, from packages!!!
Result Summary
| Total test cases | 47 | | |
| Passed | 16 | -22 |
| Failed | 16 | +7 |
| N/A | 15 | +15 |
| Run rate | 68% | -32% |
| Pass rate of total | 34% | -47% |
| Pass rate of executed | 50% | -31% |
Test Results by Feature
See build pass%37,38,16
10,9,16
0,0,15
2011-08-22,2011-08-30,Current
Loading history data, please wait…
| See only failedSee allSee historySee build | Result | Notes |
|---|
| Browser use over WLAN |
| Open a complex modern website (e.g. gmail.com) :- Complex webpage | Pass | |
| Able to connect to WLAN AP (with security etc.) | Pass | |
| Open a complex modern website (e.g. gmail.com) :- Security (HTTPS) support | Pass | |
| Camera |
| Support for N900 keys (zoom, capture): Photo capture with HW button | Pass | |
| Support for N900 keys (zoom, capture): Zoom with volume keys | Pass | |
| Still image capture : Photo capture with SW button | Pass | |
| Still image capture : Photos taken with Camera are shown in Photos application | Fail | |
| Common SW |
| System UI : Check if bluetooth icon appears to systemUI | Fail | |
| Settings : Check if applicable licenses and basic device HW and SW data can be shown in About box | Pass | |
| Settings: Check if Profile can be changed | Fail | |
| Lock : Check if lock screen works | Fail | |
| Settings : Check if user can change device wallpaper | Fail | |
| System UI : Check if wifi icon appears on systemUI | Pass | |
| System UI : Check if new call notification appears on systemUI | Fail | |
| xterm : xterm usage | Pass | |
| Calculator: Calculator basic usage | N/A | Isn't included in 1.3 release
|
| Calendar: Opening, orientation, and closing | N/A | Isn't included in 1.3 release
|
| Settings: GPRS UI | Fail | |
| System UI : Check if home screen layout is correct after rotate screen | Pass | |
| Lock : Check if unlock screen works | N/A | |
| Notes: Opening, basic usage, orientation, and closing | N/A | Isn't included in 1.3 release
|
| Settings: Check if user can set system time and date | Fail | |
| Settings: Check if user can select time and date formats | Pass | |
| System UI : Check if network strength icon appears on systemUI | Pass | |
| System UI : Check if correct battery status appears on systemUI while battery is charged | Fail | |
| Clock: Opening, basic usage, orientation, and closing | N/A | Isn't included in 1.3 release
|
| System UI : Check if updated date and time appears on systemUI | Fail | |
| Settings : Check if user can change device theme | N/A | Cannot change Theme since only 1 theme is available
|
| System UI : Check if correct battery status appears on systemUI while battery is not charged | Fail | |
| System UI : Check if applications can be launched from quick launcher bar | Pass | |
| Tasks: Opening, basic usage, orientation, and closing | N/A | Isn't included in 1.3 release
|
| Settings: Check if USB connection can be made | Fail | |
| Settings: WiFi with wrong password | Pass | 17231Was able to reconnect only after device reboot. |
| SMS |
| Send new SMS:- Send from Contacts | N/A | |
| Send new SMS:- Direct number input (QWERTY) | Fail | |
| Receive SMS, and reply to sender :- Receive SMS | N/A | |
| Receive SMS, and reply to sender :- Reply SMS | N/A | |
| Voice Call |
| Make voice calls :- Initiate from Call History | N/A | |
| SIM PIN Query enabled | Pass | |
| Make voice calls :- Direct number input (QWERTY) | Fail | |
| Receive calls | N/A | |
| Default ring tone plays | N/A | |
| Volume control works via System UI | N/A | |
| Make voice calls :- Initiate from Contacts | N/A | |
| SIM PIN Query disabled | Pass | |
| Package Manager |
| Refreshing cache | Fail | |
| Check package details | Fail | |
| See only failedSee allSee historySee build | 08/08 |
11/08 |
16/08 |
22/08 |
30/08 | Current | Latest notes |
|---|
| Browser use over WLAN |
| Open a complex modern website (e.g. gmail.com) :- Complex webpage | Pass | Pass | Pass | Pass | Pass | Pass | |
| Able to connect to WLAN AP (with security etc.) | Pass | Pass | Pass | Pass | Pass | Pass | |
| Open a complex modern website (e.g. gmail.com) :- Security (HTTPS) support | Pass | Pass | Pass | Pass | Pass | Pass | |
| Camera |
| Support for N900 keys (zoom, capture): Photo capture with HW button | Fail | Fail | Fail | Fail | Fail | Pass | |
| Support for N900 keys (zoom, capture): Zoom with volume keys | Pass | Pass | Pass | Pass | Pass | Pass | |
| Still image capture : Photo capture with SW button | Pass | Pass | Pass | Pass | Pass | Pass | |
| Still image capture : Photos taken with Camera are shown in Photos application | Pass | Pass | Pass | Pass | Pass | Fail | |
| Common SW |
| System UI : Check if bluetooth icon appears to systemUI | Fail | Fail | Fail | Fail | Fail | Fail | |
| Settings : Check if applicable licenses and basic device HW and SW data can be shown in About box | Pass | Pass | Pass | Pass | Pass | Pass | |
| Settings: Check if Profile can be changed | Fail | Fail | Fail | Fail | Fail | Fail | |
| Lock : Check if lock screen works | Pass | Pass | Pass | Pass | Pass | Fail | |
| Settings : Check if user can change device wallpaper | Fail | Fail | Fail | Fail | Fail | Fail | |
| System UI : Check if wifi icon appears on systemUI | Fail | Fail | Fail | Fail | Pass | Pass | |
| System UI : Check if new call notification appears on systemUI | Pass | Pass | Pass | Pass | Pass | Fail | |
| xterm : xterm usage | Pass | Pass | Pass | Pass | Pass | Pass | |
| Calculator: Calculator basic usage | Fail | Fail | Fail | Fail | Fail | N/A | Isn't included in 1.3 release
|
| Calendar: Opening, orientation, and closing | Fail | Fail | Fail | Fail | Fail | N/A | Isn't included in 1.3 release
|
| Settings: GPRS UI | Pass | Pass | Pass | Pass | Pass | Fail | |
| System UI : Check if home screen layout is correct after rotate screen | Pass | Pass | Pass | Pass | Pass | Pass | |
| Lock : Check if unlock screen works | Pass | Pass | Pass | Pass | Pass | N/A | |
| Notes: Opening, basic usage, orientation, and closing | Pass | Pass | Pass | Pass | Pass | N/A | Isn't included in 1.3 release
|
| Settings: Check if user can set system time and date | Pass | Pass | Pass | Pass | Pass | Fail | |
| Settings: Check if user can select time and date formats | Pass | Pass | Pass | Pass | Pass | Pass | |
| System UI : Check if network strength icon appears on systemUI | Pass | Pass | Pass | Pass | Pass | Pass | |
| System UI : Check if correct battery status appears on systemUI while battery is charged | Pass | Pass | Pass | Pass | Pass | Fail | |
| Clock: Opening, basic usage, orientation, and closing | Pass | Pass | Pass | Pass | Pass | N/A | Isn't included in 1.3 release
|
| System UI : Check if updated date and time appears on systemUI | Pass | Pass | Pass | Pass | Pass | Fail | |
| Settings : Check if user can change device theme | Pass | Pass | Pass | Pass | Pass | N/A | Cannot change Theme since only 1 theme is available
|
| System UI : Check if correct battery status appears on systemUI while battery is not charged | Fail | Fail | Fail | Fail | Fail | Fail | |
| System UI : Check if applications can be launched from quick launcher bar | Pass | Pass | Pass | Pass | Pass | Pass | |
| Tasks: Opening, basic usage, orientation, and closing | Fail | Fail | Fail | Fail | Fail | N/A | Isn't included in 1.3 release
|
| Settings: Check if USB connection can be made | Fail | Fail | Fail | Fail | Fail | Fail | |
| Settings: WiFi with wrong password | Pass | Pass | Pass | Pass | Pass | Pass | 17231Was able to reconnect only after device reboot. |
| SMS |
| Send new SMS:- Send from Contacts | Pass | Pass | Pass | Pass | Pass | N/A | |
| Send new SMS:- Direct number input (QWERTY) | Pass | Pass | Pass | Pass | Pass | Fail | |
| Receive SMS, and reply to sender :- Receive SMS | Pass | Pass | Pass | Pass | Pass | N/A | |
| Receive SMS, and reply to sender :- Reply SMS | Pass | Pass | Pass | Pass | Pass | N/A | |
| Voice Call |
| Make voice calls :- Initiate from Call History | Pass | Pass | Pass | Pass | Pass | N/A | |
| SIM PIN Query enabled | Pass | Pass | Pass | Pass | Pass | Pass | |
| Make voice calls :- Direct number input (QWERTY) | Pass | Pass | Pass | Pass | Pass | Fail | |
| Receive calls | Pass | Pass | Pass | Pass | Pass | N/A | |
| Default ring tone plays | Pass | Pass | Pass | Pass | Pass | N/A | |
| Volume control works via System UI | Pass | Pass | Pass | Pass | Pass | N/A | |
| Make voice calls :- Initiate from Contacts | Pass | Pass | Pass | Pass | Pass | N/A | |
| SIM PIN Query disabled | Pass | Pass | Pass | Pass | Pass | Pass | |
| Package Manager |
| Refreshing cache | Pass | Pass | Pass | Pass | Pass | Fail | |
| Check package details | Pass | Pass | Pass | Pass | Pass | Fail | |
| See only failedSee allSee history See build | 1.2.0.90.12.20110810.2.DE.2011-08-22.1 |
1.2.0.90.12.20110810.2.DE.2011-08-29.1 |
1.2.0.90.7.20110708.2.DE.2011-07-11.1 |
1.2.0.90.8.20110715.2.DE.2011-07-18.2 | *1.2.90.3.0.20110909.81.CE.2011-09-15.1 | |
|---|
| Browser use over WLAN |
| Open a complex modern website (e.g. gmail.com) :- Complex webpage | Pass | Pass | Pass | Pass | Pass | |
| Able to connect to WLAN AP (with security etc.) | Pass | Pass | Pass | Pass | Pass | |
| Open a complex modern website (e.g. gmail.com) :- Security (HTTPS) support | Pass | Pass | Pass | Pass | Pass | |
| Camera |
| Support for N900 keys (zoom, capture): Photo capture with HW button | Fail | Fail | Pass | Pass | Pass | |
| Support for N900 keys (zoom, capture): Zoom with volume keys | Pass | Pass | Pass | Pass | Pass | |
| Still image capture : Photo capture with SW button | Pass | Pass | Pass | Pass | Pass | |
| Still image capture : Photos taken with Camera are shown in Photos application | Pass | Pass | Pass | Pass | Fail | |
| Common SW |
| System UI : Check if bluetooth icon appears to systemUI | Fail | Fail | Fail | Fail | Fail | |
| Settings : Check if applicable licenses and basic device HW and SW data can be shown in About box | Pass | Pass | Pass | Pass | Pass | |
| Settings: Check if Profile can be changed | Fail | Fail | Fail | Fail | Fail | |
| Lock : Check if lock screen works | Pass | Pass | Pass | Pass | Fail | |
| Settings : Check if user can change device wallpaper | Fail | Fail | Fail | Fail | Fail | |
| System UI : Check if wifi icon appears on systemUI | Fail | Pass | Fail | Fail | Pass | |
| System UI : Check if new call notification appears on systemUI | Pass | Pass | Fail | Fail | Fail | |
| xterm : xterm usage | Pass | Pass | Pass | Pass | Pass | |
| Calculator: Calculator basic usage | Fail | Fail | Fail | Fail | N/A | |
| Calendar: Opening, orientation, and closing | Fail | Fail | Fail | Fail | N/A | |
| Settings: GPRS UI | Pass | Pass | Pass | Pass | Fail | |
| System UI : Check if home screen layout is correct after rotate screen | Pass | Pass | Pass | Pass | Pass | |
| Lock : Check if unlock screen works | Pass | Pass | Pass | Pass | N/A | |
| Notes: Opening, basic usage, orientation, and closing | Pass | Pass | Fail | Pass | N/A | |
| Settings: Check if user can set system time and date | Pass | Pass | Pass | Pass | Fail | |
| Settings: Check if user can select time and date formats | Pass | Pass | Pass | Pass | Pass | |
| System UI : Check if network strength icon appears on systemUI | Pass | Pass | Pass | Pass | Pass | |
| System UI : Check if correct battery status appears on systemUI while battery is charged | Pass | Pass | Pass | Pass | Fail | |
| Clock: Opening, basic usage, orientation, and closing | Pass | Pass | Fail | Pass | N/A | |
| System UI : Check if updated date and time appears on systemUI | Pass | Pass | Pass | Pass | Fail | |
| Settings : Check if user can change device theme | Pass | Pass | Pass | Pass | N/A | |
| System UI : Check if correct battery status appears on systemUI while battery is not charged | Fail | Fail | Fail | Fail | Fail | |
| System UI : Check if applications can be launched from quick launcher bar | Pass | Pass | Pass | Pass | Pass | |
| Tasks: Opening, basic usage, orientation, and closing | Fail | Fail | Fail | Fail | N/A | |
| Settings: Check if USB connection can be made | Fail | Fail | Fail | Fail | Fail | |
| Settings: WiFi with wrong password | Pass | Pass | Fail | Pass | Pass | |
| SMS |
| Send new SMS:- Send from Contacts | Pass | Pass | Pass | Pass | N/A | |
| Send new SMS:- Direct number input (QWERTY) | Pass | Pass | Pass | Pass | Fail | |
| Receive SMS, and reply to sender :- Receive SMS | Pass | Pass | Pass | Pass | N/A | |
| Receive SMS, and reply to sender :- Reply SMS | Pass | Pass | Pass | Pass | N/A | |
| Voice Call |
| Make voice calls :- Initiate from Call History | Pass | Pass | Pass | Pass | N/A | |
| SIM PIN Query enabled | Pass | Pass | Pass | Pass | Pass | |
| Make voice calls :- Direct number input (QWERTY) | Pass | Pass | Pass | Pass | Fail | |
| Receive calls | Pass | Pass | Pass | Pass | N/A | |
| Default ring tone plays | Pass | Pass | Pass | Pass | N/A | |
| Volume control works via System UI | Pass | Pass | Pass | Pass | N/A | |
| Make voice calls :- Initiate from Contacts | Pass | Pass | Pass | Pass | N/A | |
| SIM PIN Query disabled | Pass | Pass | Pass | Pass | Pass | |
| Package Manager |
| Refreshing cache | Pass | Pass | Pass | Pass | Fail | |
| Check package details | Pass | Pass | Pass | Pass | Fail | |
2313023132149842313523133113911829822662170072010016916231412098216834231361603123138172592049720793207902314323144231372313923142158841577022704 -> Helium bug
162313223133231352313623137231382313923141231422314323144General comments:
General comments:
- Can not refresh cashe in package manager
- Wallpaper thumbnails are not displayed
- Unable to open package information
- Fields are not visible in APN Settings UI
Original Result Files