Blueprint for Continuous Testing Success

>Blueprint for Continuous Testing Success
Blueprint for Continuous Testing Success 2018-03-12T12:13:05+00:00
Avoid the pitfall of creating endless suites of tests that are always red and provide no real value

Too many organizations attack their automation goals by racing to create large amounts of test scripts without a methodology aligned to solving their actual pains and achieving the value they are aiming for. The result is often a large number of unstable, flaky, unreliable tests that, in the end, provide no real value. If the test results cannot be trusted, they cannot be used to provide actionable data to properly make effective go/no-go decisions.

7 Questions you need to answer as you scale your test automation

1

How do I build a maintainable, sustainable, future-proof large suite of automated tests?

What are all the needed attributes of stable scripts?

2
3

What are all the needed attributes to scale those scripts?

How do I create tests that drive effective reports and efficient analysis?

4
5

What is the path I need to take to achieve success?

How do I manage the maintenance process of scripts to stay aligned to app changes?

6
7

How do I build an automated mechanism and process to catch automation failures / flakiness:

How Perfecto Can Help Get You There

Through a combination of best practices and expert services, Perfecto can help you map out your ideal automation plan to achieve:

 

Fast feedback

Created automation that provides reliable / immediate feedback to your Dev teams allow for go/no-go decisions on a continuous basis.

High degree of automation

Scale robust testing to cover all relevant use cases, timed to daily executions across multiple teams.

Maximum digital coverage

Increase coverage to automate across required platforms, environment conditions and digital interfaces.

Devices in our Cloud-lab

  • Alcatel One Touch Fierce 7024W

    Release Date: October, 2013
    Display Resolution: 540 x 960 pixels
    Pixel Density (dot pitch): 245 PPI

  • Amazon Kindle Fire HDX 8.9

    Release Date: September, 2014
    Display Resolution: 2560 x 1600 pixels
    Pixel Density (dot pitch): 339 PPI

  • Apple iPad 2

    Release Date: March, 2011
    Display Resolution: 1024 x 768 pixels
    Pixel Density (dot pitch): 132 PPI

  • Apple iPad 3

    Release Date: March, 2012
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 264 PPI

  • Apple iPad 4

    Release Date: November, 2012
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 264 PPI

  • Apple iPad Air

    Release Date: November, 2013
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 264 PPI

  • Apple iPad Air 2

    Release Date: October, 2014
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 264 PPI

  • Apple iPad Mini

    Release Date: November, 2012
    Display Resolution: 1024 x 768 pixels
    Pixel Density (dot pitch): 162 PPI

  • Apple iPad Mini 2

    Release Date: November, 2013
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 324 PPI

  • Apple iPad Mini 3

    Release Date: October, 2014
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 324 PPI

  • Apple iPad Mini 4

    Release Date: September, 2015
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 324 PPI

  • Apple iPad Pro 9.7

    Release Date: March, 2016
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 264 PPI

  • Apple iPhone 4

    Release Date: June, 2010
    Display Resolution: 640 x 960 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 4S

    Release Date: October, 2011
    Display Resolution: 640 x 960 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 5

    Release Date: September, 2012
    Display Resolution: 640 x 1136 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 5C

    Release Date: September, 2012
    Display Resolution: 640 x 1136 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 5S

    Release Date: September, 2013
    Display Resolution: 640 x 1136 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 6

    Release Date: September, 2014
    Display Resolution: 750 x 1334 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 6 Plus

    Release Date: September, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 401 PPI

  • Apple iPhone 6S

    Release Date: September, 2015
    Display Resolution: 750 x 1334 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 6S Plus

    Release Date: September, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 401 PPI

  • Apple iPhone 7

    Release Date: September, 2016
    Display Resolution: 750 x 1334 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 7 Plus

    Release Date: September, 2016
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 401 PPI

  • Apple iPhone 8

    Release Date: September, 2017
    Display Resolution: 750 x 1334 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone 8 Plus

    Release Date: September, 2017
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 401 PPI

  • Apple iPhone SE

    Release Date: March, 2016
    Display Resolution: 640 x 1136 pixels
    Pixel Density (dot pitch): 326 PPI

  • Apple iPhone X

    Release Date: November, 2017
    Display Resolution: 1125 x 2436 pixels
    Pixel Density (dot pitch): 459 PPI

  • Apple iPod Touch 4

    Release Date: September, 2010
    Display Resolution: 640 x 960 pixels
    Pixel Density (dot pitch): 326 PPI

  • BlackBerry Bold 9900

    Release Date: August, 2011
    Display Resolution: 640 x 480 pixels
    Pixel Density (dot pitch): 286 PPI

  • Blackberry Passport

    Release Date: September, 2014
    Display Resolution: 1440 x 1440 pixels
    Pixel Density (dot pitch): 453 PPI

  • BlackBerry Z30

    Release Date: September, 2013
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 295 PPI

  • Google Asus Nexus 7

    Release Date: July, 2013
    Display Resolution: 1920 x 1200 pixels
    Pixel Density (dot pitch): 323 PPI

  • Google LG Nexus 5

    Release Date: October, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 445 PPI

  • Google Motorola Nexus 6

    Release Date: October, 2014
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 493 PPI

  • Google Nexus 5X

    Release Date: October, 2015
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 423 PPI

  • Google Nexus 6P

    Release Date: November, 2015
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 518 PPI

  • Google Nexus 9

    Release Date: November, 2014
    Display Resolution: 2048 x 1536 pixels
    Pixel Density (dot pitch): 288 PPI

  • Google Pixel

    Release Date: October, 2016
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • HTC Desire 816

    Release Date: February, 2014
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 267 PPI

  • HTC One

    Release Date: March, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 468 PPI

  • HTC One A9

    Release Date: November, 2015
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 440 PPI

  • HTC One M8

    Release Date: March, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • HTC One M9

    Release Date: March, 2015
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • HTC Windows Phone 8X

    Release Date: November, 2012
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 342 PPI

  • Huawei Ascend P1

    Release Date: May, 2012
    Display Resolution: 540 x 960 pixels
    Pixel Density (dot pitch): 256 PPI

  • Huawei Ascend P7

    Release Date: June, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • Huawei Ascend P8

    Release Date: April, 2015
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 424 PPI

  • iPhone XS

    Release Date: September, 2018
    Display Resolution: 1125 x 2436 pixels
    Pixel Density (dot pitch): 458 PPI

  • iPhone XS Max

    Release Date: September, 2018
    Display Resolution: 1242 x 2688 pixels
    Pixel Density (dot pitch): 458 PPI

  • LG G Flex

    Release Date: November, 2013
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 245 PPI

  • LG G2

    Release Date: September, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 424 PPI

  • LG G2 Mini

    Release Date: April, 2014
    Display Resolution: 540 x 960 pixels
    Pixel Density (dot pitch): 234 PPI

  • LG G3

    Release Date: June, 2014
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 538 PPI

  • LG G4

    Release Date: April, 2015
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 538 PPI

  • LG G5

    Release Date: April, 2016
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 554 PPI

  • Lumia 430

    Release Date: May, 2015
    Display Resolution: 480 x 800 pixels
    Pixel Density (dot pitch): 235 PPI

  • Lumia 435

    Release Date: March, 2015
    Display Resolution: 480 x 800 pixels
    Pixel Density (dot pitch): 233 PPI

  • Lumia 532

    Release Date: February, 2015
    Display Resolution: 480 x 800 pixels
    Pixel Density (dot pitch): 233 PPI

  • Lumia 535

    Release Date: December, 2014
    Display Resolution: 540 x 960 pixels
    Pixel Density (dot pitch): 220 PPI

  • Lumia 540

    Release Date: May, 2015
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 294 PPI

  • Lumia 550

    Release Date: December, 2015
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 315 PPI

  • Lumia 635

    Release Date: June, 2014
    Display Resolution: 480 x 854 pixels
    Pixel Density (dot pitch): 221 PPI

  • Lumia 636

    Release Date: June, 2014
    Display Resolution: 480 x 854 pixels
    Pixel Density (dot pitch): 221 PPI

  • Lumia 638

    Release Date: December, 2014
    Display Resolution: 480 x 854 pixels
    Pixel Density (dot pitch): 218 PPI

  • Lumia 640

    Release Date: March, 2015
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 294 PPI

  • Lumia 640XL

    Release Date: April, 2015
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 259 PPI

  • Lumia 650

    Release Date: February, 2016
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 297 PPI

  • Lumia 730

    Release Date: September, 2014
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 316 PPI

  • Lumia 735

    Release Date: September, 2014
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 312 PPI

  • Lumia 830

    Release Date: September, 2014
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 294 PPI

  • macOS High Sierra Browsers

    Safari 11
    Chrome 42-65, beta(66)
    Firefox 39-59
    May require longer initialization

  • Microsoft Surface Pro 3

    Release Date: June, 2014
    Display Resolution: 2160 x 1440 pixels
    Pixel Density (dot pitch): 216 PPI

  • Microsoft Surface Pro 4

    Release Date: October, 2015
    Display Resolution: 2736 x 1824 pixels
    Pixel Density (dot pitch): 267 PPI

  • Motorola Droid Mini

    Release Date: August, 2013
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 342 PPI

  • Motorola Droid Razr M

    Release Date: September, 2012
    Display Resolution: 540 x 960 pixels
    Pixel Density (dot pitch): 256 PPI

  • Motorola Moto E4

    Release Date: June, 2017
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 294 PPI

  • Motorola Moto G

    Release Date: November, 2013
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 326 PPI

  • Motorola Moto X

    Release Date: September, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 424 PPI

  • Nokia Lumia 620

    Release Date: January, 2013
    Display Resolution: 480 x 800 pixels
    Pixel Density (dot pitch): 246 PPI

  • Nokia Lumia 920

    Release Date: November, 2012
    Display Resolution: 768 x 1280 pixels
    Pixel Density (dot pitch): 332 PPI

  • Nokia Lumia 925

    Release Date: June, 2013
    Display Resolution: 768 x 1280 pixels
    Pixel Density (dot pitch): 332 PPI

  • Nokia Lumia 928

    Release Date: May, 2013
    Display Resolution: 768 x 1280 pixels
    Pixel Density (dot pitch): 332 PPI

  • OS X El Capitan Browsers

    Safari 10-11
    Chrome 42-65, beta(66)
    Firefox 39-59
    May require longer initialization

  • Samsung Ace 3

    Release Date: July, 2013
    Display Resolution: 480 x 800 pixels
    Pixel Density (dot pitch): 233 PPI

  • Samsung Galaxy Note 2

    Release Date: September, 2012
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 267 PPI

  • Samsung Galaxy Note 3

    Release Date: September, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 386 PPI

  • Samsung Galaxy Note 4

    Release Date: October, 2014
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 518 PPI

  • Samsung Galaxy Note 5

    Release Date: August, 2015
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 518 PPI

  • Samsung Galaxy Note 8

    Release Date: September, 2017
    Display Resolution: 1440 x 2960 pixels
    Pixel Density (dot pitch): 521 PPI

  • Samsung Galaxy Note Pro 12.2

    Release Date: March, 2014
    Display Resolution: 2560 x 1600 pixels
    Pixel Density (dot pitch): 247 PPI

  • Samsung Galaxy S3

    Release Date: May, 2012
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 306 PPI

  • Samsung Galaxy S4

    Release Date: April, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • Samsung Galaxy S5

    Release Date: April, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 432 PPI

  • Samsung Galaxy S6

    Release Date: April, 2015
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 577 PPI

  • Samsung Galaxy S6 Edge

    Release Date: March, 2015
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 577 PPI

  • Samsung Galaxy S7

    Release Date: March, 2016
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 577 PPI

  • Samsung Galaxy S7 Edge

    Release Date: March, 2016
    Display Resolution: 1440 x 2560 pixels
    Pixel Density (dot pitch): 534 PPI

  • Samsung Galaxy S8

    Release Date: April, 2017
    Display Resolution: 1440 x 2960 pixels
    Pixel Density (dot pitch): 570 PPI

  • Samsung Galaxy S8+

    Release Date: April, 2017
    Display Resolution: 1440 x 2960 pixels
    Pixel Density (dot pitch): 529 PPI

  • Samsung Galaxy S9

    Release Date: March, 2018
    Display Resolution: 1440 x 2960 pixels
    Pixel Density (dot pitch): 568 PPI

  • Samsung Galaxy S9+

    Release Date: March, 2018
    Display Resolution: 1440 x 2960 pixels
    Pixel Density (dot pitch): 531 PPI

  • Samsung Galaxy Tab 3 7.0

    Release Date: July, 2013
    Display Resolution: 600 x 1024 pixels
    Pixel Density (dot pitch): 170 PPI

  • Samsung Galaxy Tab 3 Lite

    Release Date: January, 2014
    Display Resolution: 600 x 1024 pixels
    Pixel Density (dot pitch): 170 PPI

  • Samsung Galaxy Tab A

    Release Date: March, 2015
    Display Resolution: 768 x 1024 pixels
    Pixel Density (dot pitch): 160 PPI

  • Samsung Galaxy Tab S2

    Release Date: September, 2015
    Display Resolution: 1536 x 2048 pixels
    Pixel Density (dot pitch): 264 PPI

  • Sony Xperia M4 Aqua

    Release Date: June, 2015
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 294 PPI

  • Sony Xperia Z

    Release Date: January, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • Sony Xperia Z1

    Release Date: September, 2013
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 441 PPI

  • Sony Xperia Z3

    Release Date: September, 2014
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 424 PPI

  • Sony Xperia Z3 Compact

    Release Date: September, 2014
    Display Resolution: 720 x 1280 pixels
    Pixel Density (dot pitch): 319 PPI

  • Sony Xperia Z5

    Release Date: October, 2015
    Display Resolution: 1080 x 1920 pixels
    Pixel Density (dot pitch): 428 PPI

  • Windows 10 Browsers

    Chrome 54-65, beta(66)
    Firefox 49-59
    IE 11
    Edge 14, 15, 16
    Win 10 Embedded Server

  • Windows 7 Browsers

    Chrome 54-65, beta(66)
    Firefox 49-59
    IE 11

  • Windows 7 Legacy Browsers

    Chrome 40-53
    Firefox 39-48
    IE 8-10
    MS Server 2008 R2
    May require longer initialization

  • Windows 8 Legacy Browsers

    Chrome 40-53
    Firefox 39-48
    MS Server 2012 R2
    May require longer initialization

  • Windows 8.1 Browsers

    Chrome 54-65, beta(66)
    Firefox 49-59
    IE 11

See all available devices

Continuous testing across the DevOps pipeline

Optimize the velocity of the DevOps pipeline by embedding continuous testing from Dev, through QA, all the way to production.