Handset Test Report: N900 Acceptance 2011-02-03
Acceptance test is a very brief run-through of the functionality of the entire MeeGo distribution, to assure that the basic health of the distribution and report major regressions at the earliest time. All the checkpoints in acceptance test reflects the most important and basic functionalities of the distribution. We do the acceptance test against Trunk:Test repo.
http://download.meego.com/testing-daily/builds/1.1.90/1.1.90.1.20110202.88/handset/images/meego-handset-armv7l-n900/
Kernel version: kernel-adaptation-n900.armv7l 2.6.35.9-10.5
Improvements:
Bugs not observed:
1014711261Key Issues:
4049126998043707410107Run rate and Pass rate affected by following bugs:-
Touch screen is working
10147Performance data:
- Device Boot up time 100s
- Browser start time 29s
- Dialer start time 13s
Key Packages
fennec-qt.armv7l 4.0b8pre1109.5-1.56
meego-handset-dialer.armv7l 0.1.17-3.6
ofono.armv7l 0.39-2.1
phonesim.armv7l 1.8-1.71
Result Summary
| Total test cases | 43 | | |
| Passed | 20 | +15 |
| Failed | 4 | +2 |
| N/A | 19 | -17 |
| Run rate | 56% | +40% |
| Pass rate of total | 47% | +35% |
| Pass rate of executed | 83% | +12% |
Test Results by Feature
4,5,20
2,2,4
37,36,19
2011-02-01,2011-02-02,Current
Loading history data, please wait…
| See only failedSee allSee history | Result | Notes |
|---|
| Email |
| Check if email application support send email | N/A | applications will be updated schedule not known
|
| Check if email application support received email via POP3 and IMAP4 | N/A | applications will be updated schedule not known
|
| Installation |
| Use zypper to install a package | Pass | |
| Touchscreen |
| Use touch screen to operate the system | Pass | |
| Security & Power |
| Check PIN activation/deactivation (Need GUI support) | N/A | applications will be updated schedule not known
|
| PIN requested at boot | N/A | applications will be updated schedule not known
|
| Power Off / Power On | Pass | device goes to reboot while pressing on power button when USB cable is connected, but when cable is not connected device powers off succesfully.
Note: tried with as USB data cable as USB charger cable
|
| Camera |
| Check if the camera application UI is correct (top bar, menu, button, etc.) | N/A | applications will be updated schedule not known
|
| Check if photos can be taken using the camera | N/A | applications will be updated schedule not known
|
| Check if videos can be recorded using the camera | N/A | applications will be updated schedule not known
|
| Contacts |
| Check if it works with dialer, SMS | N/A | applications will be updated schedule not known
|
| Video |
| Check if the UI is correct (top bar, menu, button, play queue etc.) | N/A | applications will be updated schedule not known
|
| Check if video thumbnail index works | N/A | applications will be updated schedule not known
|
| Check if video could be played (ogg only) | N/A | applications will be updated schedule not known
|
| Audio |
| Check if the UI is correct (top bar, menu, button, play queue etc.) | N/A | applications will be updated schedule not known
|
| Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker | N/A | applications will be updated schedule not known
|
| Photo viewer |
| Check if the UI is correct (top bar, menu, button, etc.) | N/A | applications will be updated schedule not known
|
| Check if photo thumbnail index works | N/A | applications will be updated schedule not known
|
| Check if photo could be played | N/A | applications will be updated schedule not known
|
| Virtual keyboard |
| Check if virtual keyboard can be launched automatically with apps whichneed input text field (fennec, SMS) | Pass | 11721 VKB not fully displayed in landscape mode |
| Support text input | Pass | |
| Run time status/Settings/Control Panel |
| Check if runtime status are correct on toolbar | Fail | |
| Connectivity |
| can wifi, check wifi connection and disconnection | Fail | Settings app crashes after tapping on Apply button when adding new network. 8043 Settings application crashes when connecting to wlan |
| Browse website and download some files through wifi | Pass | Wlan was connected via Terminal.
|
| check bluetooth connection (pairing and connect to bluetooth handset) | Pass | Headset was connected/disconnected from UI, however no sound on headset.
|
| Connect device to computer with usb cable, check the usb mass storage device is detected by computer | Fail | |
| Check sshd connection: connect board using usb gadget | Pass | |
| SMS |
| Send SMS ( phonesim, 2G & 3G ) (based on real modem ) | N/A | applications will be updated schedule not known
|
| Receive SMS ( 2G & 3G ) (based on real modem) | N/A | applications will be updated schedule not known
|
| Check message history (received, sent, draft) | N/A | applications will be updated schedule not known
|
| Dialer |
| Dial one outgoing call, accept by other party, terminate this call (GSM & WCDMA) (based on real modem) | Pass | during Dialer application launch I had an error message: "Failed to connect to org.ofono.Manager: is ofonod running?" after what i was unable to open Dialer, there was only black screen with the application name "Dialer", but it was only once and after the phone reboot it was possible to open "Dialer" again and work with it. When user makes an outgoing call and refrence phone is already calling, it is still possible to add some other numbers to the cantact's number or erase the contact's number from the "Enter" field ( but it doesn't influence the outgoing call)
|
| Receive a call, accept the call, terminate this call (GSM & WCDMA) (based real modem) | Pass | 10107 contact name displayed as a number when incomming call 7074 Incomming call can be answered only when dialer is opened |
| Receive one call, reject this call without accepting the call(GSM & WCDMA)(based on real modem) | Pass | 10107 ontact name displayed as a number when incomming call 7074 Incomming call can be answered only when dialer is opened |
| Display PhoneBook | Pass | 7469 Call icon in people page not working |
| Check call history | Pass | 7467 Call icon in call history does not work 7711 Call information colors are incorrect |
| Fennec browser |
| Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) | Pass | |
| Browsing website over 3G (WCDMA) | Pass | 3G connected manually form terminal
|
| Browser gesture support | Pass | |
| Home screen |
| Check if core applications can be launched from app-launcher | Pass | |
| switch between different applications | Pass | |
| Check home screen theme and layout | Fail | 12699 x-term and lock application icons not displayed in landscape |
| Display orientation detection | Pass | |
| System startup |
| Image Boot from SD card | Pass | |
| See only failedSee allSee history | 26/01 |
27/01 |
28/01 |
01/02 |
02/02 | Current | Latest notes |
|---|
| Email |
| Check if email application support send email | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if email application support received email via POP3 and IMAP4 | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Installation |
| Use zypper to install a package | Pass | Pass | Pass | Pass | Pass | Pass | |
| Touchscreen |
| Use touch screen to operate the system | N/A | N/A | N/A | N/A | N/A | Pass | |
| Security & Power |
| Check PIN activation/deactivation (Need GUI support) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| PIN requested at boot | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Power Off / Power On | Pass | Pass | Pass | Pass | Pass | Pass | device goes to reboot while pressing on power button when USB cable is connected, but when cable is not connected device powers off succesfully.
Note: tried with as USB data cable as USB charger cable
|
| Camera |
| Check if the camera application UI is correct (top bar, menu, button, etc.) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if photos can be taken using the camera | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if videos can be recorded using the camera | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Contacts |
| Check if it works with dialer, SMS | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Video |
| Check if the UI is correct (top bar, menu, button, play queue etc.) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if video thumbnail index works | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if video could be played (ogg only) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Audio |
| Check if the UI is correct (top bar, menu, button, play queue etc.) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if music could be played (WAV, AAC & MP3 format ) on loudspeaker | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Photo viewer |
| Check if the UI is correct (top bar, menu, button, etc.) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if photo thumbnail index works | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check if photo could be played | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Virtual keyboard |
| Check if virtual keyboard can be launched automatically with apps whichneed input text field (fennec, SMS) | N/A | N/A | N/A | N/A | N/A | Pass | 11721 VKB not fully displayed in landscape mode |
| Support text input | N/A | N/A | N/A | N/A | N/A | Pass | |
| Run time status/Settings/Control Panel |
| Check if runtime status are correct on toolbar | N/A | N/A | N/A | N/A | N/A | Fail | |
| Connectivity |
| can wifi, check wifi connection and disconnection | N/A | N/A | N/A | N/A | N/A | Fail | Settings app crashes after tapping on Apply button when adding new network. 8043 Settings application crashes when connecting to wlan |
| Browse website and download some files through wifi | N/A | N/A | N/A | N/A | N/A | Pass | Wlan was connected via Terminal.
|
| check bluetooth connection (pairing and connect to bluetooth handset) | N/A | N/A | N/A | N/A | N/A | Pass | Headset was connected/disconnected from UI, however no sound on headset.
|
| Connect device to computer with usb cable, check the usb mass storage device is detected by computer | Fail | Fail | Fail | Fail | Fail | Fail | |
| Check sshd connection: connect board using usb gadget | Pass | Pass | Pass | Pass | Pass | Pass | |
| SMS |
| Send SMS ( phonesim, 2G & 3G ) (based on real modem ) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Receive SMS ( 2G & 3G ) (based on real modem) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Check message history (received, sent, draft) | N/A | N/A | N/A | N/A | N/A | N/A | applications will be updated schedule not known
|
| Dialer |
| Dial one outgoing call, accept by other party, terminate this call (GSM & WCDMA) (based on real modem) | N/A | N/A | N/A | N/A | N/A | Pass | during Dialer application launch I had an error message: "Failed to connect to org.ofono.Manager: is ofonod running?" after what i was unable to open Dialer, there was only black screen with the application name "Dialer", but it was only once and after the phone reboot it was possible to open "Dialer" again and work with it. When user makes an outgoing call and refrence phone is already calling, it is still possible to add some other numbers to the cantact's number or erase the contact's number from the "Enter" field ( but it doesn't influence the outgoing call)
|
| Receive a call, accept the call, terminate this call (GSM & WCDMA) (based real modem) | N/A | N/A | N/A | N/A | N/A | Pass | 10107 contact name displayed as a number when incomming call 7074 Incomming call can be answered only when dialer is opened |
| Receive one call, reject this call without accepting the call(GSM & WCDMA)(based on real modem) | N/A | N/A | N/A | N/A | N/A | Pass | 10107 ontact name displayed as a number when incomming call 7074 Incomming call can be answered only when dialer is opened |
| Display PhoneBook | N/A | N/A | N/A | N/A | N/A | Pass | 7469 Call icon in people page not working |
| Check call history | N/A | N/A | N/A | N/A | N/A | Pass | 7467 Call icon in call history does not work 7711 Call information colors are incorrect |
| Fennec browser |
| Browsing website over wifi (WEP secured by default, WPA is WEP is not testable) | N/A | N/A | N/A | N/A | N/A | Pass | |
| Browsing website over 3G (WCDMA) | N/A | N/A | N/A | N/A | N/A | Pass | 3G connected manually form terminal
|
| Browser gesture support | N/A | N/A | N/A | N/A | N/A | Pass | |
| Home screen |
| Check if core applications can be launched from app-launcher | Fail | Fail | Fail | Fail | Fail | Pass | |
| switch between different applications | N/A | N/A | N/A | N/A | N/A | Pass | |
| Check home screen theme and layout | N/A | N/A | N/A | N/A | N/A | Fail | 12699 x-term and lock application icons not displayed in landscape |
| Display orientation detection | N/A | N/A | N/A | N/A | Pass | Pass | |
| System startup |
| Image Boot from SD card | Pass | Pass | Pass | Pass | Pass | Pass | |
Original Result Files
No result files available