The next generation automation testing for video streaming apps by Perfecto & Accenture S3
How many times have you heard this phrase while watching a game on your phone: “Touchdown!!” (or GOAL!!) but all you can see is the loading dial? How about this: you are sitting on an airplane, trying to watch a video on the flight WiFi and it just stops or pauses constantly. Maybe you’ve tried to watch some home improvement or recipe video that was impossible to watch because it just kept stalling?
The proliferation of video consumption on a variety of devices is unsurprising when one considers the media vertical: Sports, entertainment, drama, gaming etc. Nearly 60% of sports videos are on mobile devices in UK. What is interesting is the same phenomena outside this vertical: for example, 80% of all banks are planning to offer video-enabled banking services as an evolution of their digital personalized presence (Source).
The main drivers: User satisfaction, competitive edge and increased customer loyalty.
The same trend is happening in retail, travel and many more.
With high hopes and success stories, comes the reality: Content quality on its own is insufficient to drive user adoption, satisfaction and drive business metrics. It’s all about the end user experience: the sum of content quality, delivery and rendering on the mobile device. All vendors in this ecosystem need to align on quality expectations and embed agile quality practices.[/vc_column_text][/vc_column][/vc_row][vc_row][vc_column][vc_column_text]This is easier said than done when considering the pace at which mobile applications are refreshed, as well as the time pressure introduced with new video content and services. Teams need automated, stable and scalable methods to continuously test and monitor video services on every phone, tablet and browser and in any environment; at home, on the road, inside a plane, etc.
A collaboration between Accenture-S3, and Perfecto provides a solution for just that. Perfecto offers access to a variety of devices, following in interactive mode or automated. Tests can be carried out pre-production or in production, following DevOps team collaboration methodologies Scripts can be written in any language: BDD/Cucumber, Java, JS, C# etc., in a stable and scalable form. Devices can be connected over Apple TV or Chromecast so that video quality can be analyzed by StormTest.
Using this system, brands can conduct both functional testing, as well as video quality testing, in an automated, continuous manner.
The resulting report can contain both the details for the functional analysis:
As well as the StormTest video quality report:
VQM_monitoring_frame_914 : MOS avg = 73.921368599: good, TFQ avg: 74.4697488455, FQ avg: 75.4665172481, nb of jerkiness: 12, max jerkiness time in ms: 66.6666666667, nb of frames with jerkiness: 12, nb blockiness: 0, nb blur: 389, nb contrast: 453, temporal min: 0.64802035108, temporal max: 50.9574469522, temporal avg: 8.64656667633, temporal stdv: 7.90411712151, Audio MOS avg = 70.6908369241: good, nb of silence: 36, nb of saturation: 0, nb of breaks: 0, nb of distortion: 0
Can brands get ready for the next revolution of digital engagements? Absolutely. Testing and monitoring of video engagements in an automated and scalable fashion, that fits tight release cycles and produces reliable data are here. It’s time to take advantage of it.
Looking for more about the importance of streaming video quality?