Core Test Report: N900 Dataflow 2011-01-26
This is QA weekly testing cycle for weekly images released by distribution team. Our testing focus is the meego core basic functionality.
QA verdict definition:
- Pass: When feature is implemented and QA can verify feature works as expected.
- Fail: When feature is implemented and QA can verify feature does not work as expected
- N/A: Feature is implemented but QA can't give pass/fail verdict or when feature is not implemented.
meego-handset-armv7l-n900-devel-1.1.90.0.20110125.3
http://repo.meego.com/MeeGo/builds/trunk/1.1.90.0.20110125.3/
- Hardware: N900
- Micro SD : Kingmax SDC6/8GB; Transcend SDC6/8GB; Kingston SDC4/4GB
- Testset: MCTS - 0.1.1 (except Gstreamer tested with MCTS-0.1.0, fail to build test package for Gstreamer; under investigation,will file a bug)
- Linux PC: ubuntu 10.10
Run rate is 90% (+4%), pass rate of total is 40%(+3%).
Improvement
11977 - doesn't observe
12648 - doesn't observe
Key Issues
125591236311702117961075312704Not implemented feature
76239174Case Issues
12668Result Summary
| Total test cases | 66 | | |
| Passed | 27 | +2 |
| Failed | 33 | +1 |
| N/A | 6 | -3 |
| Run rate | 91% | +5% |
| Pass rate of total | 41% | +3% |
| Pass rate of executed | 45% | +1% |
Test Results by Feature
32,25,27
18,32,33
16,9,6
2011-01-12,2011-01-20,Current
Loading history data, please wait…
| See only failedSee allSee history | Result | Notes |
|---|
| Sensors |
| Get values from Ambient Light Sensor | Pass | |
| Get values from Orientation | Pass | |
| Get values from Proximity | Pass | |
| Get values from Tap | Fail | |
| Data Management (Tracker) |
| Check tracker can add multiple tags to multiple files | Pass | |
| Check tracker can search all image files | Pass | |
| Check tracker can live update music file | Fail | |
| FM |
| Test scaning frequency | N/A | |
| Test turning on active frequency | N/A | |
| Graphics (X11) |
| X11-Create simple window | Pass | |
| X11-XInput enumerate devices | Pass | |
| X11-XRender draw rectangle | Pass | |
| Graphics (OpenGLES2) |
| Draws simple three vertex rotating triangle | Pass | |
| Draw large textured planes. Multiple layers with blend. Draw 'widgets' on the topmost plane. Each widget has a shadow. Add particles to each widget. Rotate and zoom the entire scene. Add blur | Pass | |
| Draw large textured planes. Multiple layers with blend. Draw animated 'widgets' on the topmost plane. Each widget has a shadow | Pass | |
| Image/Video capture |
| FUTE-Take_picture | N/A | |
| FUTE-Take_picture_zoom | N/A | |
| FUTE-Take_picture_with_flash | N/A | |
| FUTE-Take_video | N/A | |
| Audio Capture |
| Record_audio_stereo_2channel_48KHZ_256kbs_vorbis | Pass | |
| Record_audio_stereo_2channel48KHz_320kbs_PCM | Pass | |
| Location |
| GeocluePosition::geoclue_position_get_position | Fail | 11796Test case report passed but geoclue and location API does not work.Refer to case error 12668 |
| Coldfix of position from Qt API | Fail | 11796Test case report passed but geoclue and location API does not work.Refer to case error 12668 |
| Video Playback |
| Play and stop local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | Fail | |
| Play and pause local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | Fail | |
| Play and seek backward local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | Fail | |
| Audio Playback |
| Play and stop local AAC media file (16bit; 44.1KHz; 264Kbps) | Pass | |
| Play and pause local AAC media file (16bit; 44.1KHz; 264Kbps) | Pass | |
| Play and seek forward local AAC media file (16bit; 44.1KHz; 264Kbps) | Pass | |
| Local Connectivity (USB) |
| Transfer 10MB file from PC->Device using USB networking (SSH) | Pass | |
| Transfer 10MB file from Device->PC using USB networking (SSH) | Pass | |
| Local Connectivity (BT) |
| Scan nearby bluetooth devices | Fail | |
| Pair stereo head set | Fail | |
| Transfer 10MB file from PC->Device using Bluetooth | Fail | |
| Transfer 10MB file from Device->PC using Bluetooth | Fail | |
| Check to use FTP profile to get file | Fail | |
| Check to use FTP profile to put file to Server | Fail | |
| test AVRCP profile | Fail | |
| test A2DP profile | Fail | |
| Browsing (Data Connectivity) |
| Create data connection in UMTS network | Fail | |
| Download 10MB file using HSDPA connection | Fail | |
| Upload 10MB file using HSUPA connection | Fail | |
| Browsing (WLAN) |
| Scan nearby accesspoints | Pass | |
| Connect unsecured accesspoint | Pass | |
| Download 10MB file using unsecured accesspoint | Pass | |
| Upload 10MB file using unsecured accesspoint | Pass | |
| Check if service is empty in offline mode | Pass | |
| Check if connman works with ifconfig up | Pass | |
| Check wifi cnnection with WPA hidden | Pass | |
| Test WiFi for WEP128 | Pass | |
| Test WiFi for WPA TKIP mode | Pass | |
| Short Message Service |
| Send and recieve text message; length 0; any network mode | Fail | |
| Send and recieve text message; length 140; any network mode | Fail | |
| Send and recieve text message; length 380; any network mode | Fail | |
| Send text message; length 0; 140; 380 any network mode | Fail | |
| Receive text message; length 0; 140; 380; any network mode | Fail | |
| Voice Calls |
| Mobile Originated Voice call; any network mode | Fail | |
| Mobile Terminated Voice call; any network mode | Fail | |
| Mobile Originated Voice call; hold call; any network mode | Fail | |
| Mobile Terminated Voice call; reject call; any network mode | Fail | |
| Mobile Originated Voice call; any network mode | Fail | |
| Mobile Terminated Voice call; any network mode | Fail | |
| Mobile Originated Voice call; hold call; any network mode | Fail | |
| Mobile Terminated Voice call; reject call; any network mode | Fail | |
| SIM |
| Verify SIM PIN code | Fail | |
| Change SIM PIN code | Fail | |
| See only failedSee allSee history | 24/11 |
08/12 |
06/01 |
12/01 |
20/01 | Current | Latest notes |
|---|
| Sensors |
| Get values from Ambient Light Sensor | - | - | Fail | Pass | Pass | Pass | |
| Get values from Orientation | - | - | Fail | Fail | Pass | Pass | |
| Get values from Proximity | - | - | Fail | Pass | Pass | Pass | |
| Get values from Tap | - | - | Fail | Fail | Fail | Fail | |
| Data Management (Tracker) |
| Check tracker can add multiple tags to multiple files | - | - | Pass | Pass | Pass | Pass | |
| Check tracker can search all image files | - | - | Pass | Pass | Pass | Pass | |
| Check tracker can live update music file | - | - | Pass | Pass | Pass | Fail | |
| FM |
| Test scaning frequency | - | - | N/A | N/A | N/A | N/A | |
| Test turning on active frequency | - | - | N/A | N/A | N/A | N/A | |
| Graphics (X11) |
| X11-Create simple window | - | - | Pass | Pass | Pass | Pass | |
| X11-XInput enumerate devices | - | - | Pass | Pass | Pass | Pass | |
| X11-XRender draw rectangle | - | - | Pass | Pass | Pass | Pass | |
| Graphics (OpenGLES2) |
| Draws simple three vertex rotating triangle | - | - | Pass | Pass | Pass | Pass | |
| Draw large textured planes. Multiple layers with blend. Draw 'widgets' on the topmost plane. Each widget has a shadow. Add particles to each widget. Rotate and zoom the entire scene. Add blur | - | - | Pass | Pass | Pass | Pass | |
| Draw large textured planes. Multiple layers with blend. Draw animated 'widgets' on the topmost plane. Each widget has a shadow | - | - | Pass | Pass | Pass | Pass | |
| Image/Video capture |
| FUTE-Take_picture | - | - | Fail | N/A | N/A | N/A | |
| FUTE-Take_picture_zoom | - | - | Fail | N/A | N/A | N/A | |
| FUTE-Take_picture_with_flash | - | - | Fail | N/A | N/A | N/A | |
| FUTE-Take_video | - | - | Fail | N/A | N/A | N/A | |
| Audio Capture |
| Record_audio_stereo_2channel_48KHZ_256kbs_vorbis | - | - | Pass | Pass | Pass | Pass | |
| Record_audio_stereo_2channel48KHz_320kbs_PCM | - | - | Pass | Pass | Pass | Pass | |
| Location |
| GeocluePosition::geoclue_position_get_position | - | - | Pass | Fail | Fail | Fail | 11796Test case report passed but geoclue and location API does not work.Refer to case error 12668 |
| Coldfix of position from Qt API | - | - | Pass | Fail | Fail | Fail | 11796Test case report passed but geoclue and location API does not work.Refer to case error 12668 |
| Video Playback |
| Play and stop local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | - | - | - | N/A | N/A | Fail | |
| Play and pause local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | - | - | - | N/A | N/A | Fail | |
| Play and seek backward local MP4 media file (V: 30FPS; VGA; 2732Kbps A: AAC; 48KHz; 320Kbps) | - | - | - | N/A | N/A | Fail | |
| Audio Playback |
| Play and stop local AAC media file (16bit; 44.1KHz; 264Kbps) | - | - | Pass | Pass | Pass | Pass | |
| Play and pause local AAC media file (16bit; 44.1KHz; 264Kbps) | - | - | Pass | Pass | Pass | Pass | |
| Play and seek forward local AAC media file (16bit; 44.1KHz; 264Kbps) | - | - | Pass | Pass | Pass | Pass | |
| Local Connectivity (USB) |
| Transfer 10MB file from PC->Device using USB networking (SSH) | - | - | - | - | - | Pass | |
| Transfer 10MB file from Device->PC using USB networking (SSH) | - | - | - | - | - | Pass | |
| Local Connectivity (BT) |
| Scan nearby bluetooth devices | - | - | Pass | Fail | Fail | Fail | |
| Pair stereo head set | - | - | Pass | Fail | Fail | Fail | |
| Transfer 10MB file from PC->Device using Bluetooth | - | - | - | - | - | Fail | |
| Transfer 10MB file from Device->PC using Bluetooth | - | - | - | - | - | Fail | |
| Check to use FTP profile to get file | - | - | N/A | Fail | Fail | Fail | |
| Check to use FTP profile to put file to Server | - | - | N/A | Fail | Fail | Fail | |
| test AVRCP profile | - | - | N/A | Fail | Fail | Fail | |
| test A2DP profile | - | - | N/A | Fail | Fail | Fail | |
| Browsing (Data Connectivity) |
| Create data connection in UMTS network | - | - | Fail | Fail | Fail | Fail | |
| Download 10MB file using HSDPA connection | - | - | Fail | Fail | Fail | Fail | |
| Upload 10MB file using HSUPA connection | - | - | Fail | Fail | Fail | Fail | |
| Browsing (WLAN) |
| Scan nearby accesspoints | - | - | Pass | Pass | Pass | Pass | |
| Connect unsecured accesspoint | - | - | Pass | Pass | Pass | Pass | |
| Download 10MB file using unsecured accesspoint | - | - | Pass | Pass | Fail | Pass | |
| Upload 10MB file using unsecured accesspoint | - | - | Pass | Pass | Fail | Pass | |
| Check if service is empty in offline mode | - | - | Pass | Pass | Pass | Pass | |
| Check if connman works with ifconfig up | - | - | Pass | Fail | Pass | Pass | |
| Check wifi cnnection with WPA hidden | - | - | Pass | Pass | Pass | Pass | |
| Test WiFi for WEP128 | - | - | N/A | Pass | Pass | Pass | |
| Test WiFi for WPA TKIP mode | - | - | N/A | Pass | Pass | Pass | |
| Short Message Service |
| Send and recieve text message; length 0; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Send and recieve text message; length 140; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Send and recieve text message; length 380; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Send text message; length 0; 140; 380 any network mode | - | - | Pass | Pass | Fail | Fail | |
| Receive text message; length 0; 140; 380; any network mode | - | - | Pass | Pass | Fail | Fail | |
| Voice Calls |
| Mobile Originated Voice call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Terminated Voice call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Originated Voice call; hold call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Terminated Voice call; reject call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Originated Voice call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Terminated Voice call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Originated Voice call; hold call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| Mobile Terminated Voice call; reject call; any network mode | - | - | N/A | N/A | Fail | Fail | |
| SIM |
| Verify SIM PIN code | - | - | Fail | Fail | Fail | Fail | |
| Change SIM PIN code | - | - | Fail | Fail | Fail | Fail | |

Original Result Files
No result files available