{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Mobile Product Performance Testing |Digital.gov",
    "description": "Mobile Product Performance Testing",
    "home_page_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/","feed_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2013/08/05/mobile-product-performance-testing-resources/index.json","item" : [
    {"title" :"Mobile Product Performance Testing","summary" : "Performance testing is used to verify that an app or web page will display quickly to the user and will continue to function as the number of users increases to peak loads. Performance is an important consideration for mobile applications because the connection speed of users is often slower and more variable for mobile users than desktop users. Surveys","date" : "2013-08-05T14:21:06-04:00","date_modified" : "2025-01-27T19:42:55-05:00","authors" : {"jparcell" : "Jacob Parcell"},"topics" : {
        
            "mobile" : "Mobile",
            "research" : "Research",
            "software-engineering" : "Software engineering"
            },"branch" : "bc-archive-content-3",
      "filename" :"2013-08-05-mobile-product-performance-testing-resources.md",
      
      "filepath" :"news/2013/08/2013-08-05-mobile-product-performance-testing-resources.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/bc-archive-content-3/content/news/2013/08/2013-08-05-mobile-product-performance-testing-resources.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/bc-archive-content-3/content/news/2013/08/2013-08-05-mobile-product-performance-testing-resources.md","slug" : "mobile-product-performance-testing-resources","url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2013/08/05/mobile-product-performance-testing-resources/","content" :"\u003cp\u003ePerformance testing is used to verify that an app or web page will display quickly to the user and will continue to function as the number of users increases to peak loads. Performance is an important consideration for mobile applications because the connection speed of users is often slower and more variable for mobile users than desktop users. Surveys have shown that users will often stop using applications or web sites that load slowly.\u003c/p\u003e\n\u003cp\u003eThis article was developed as part of the \u003ca href=\"https://digital.gov/resources/mobile-application-development-program/\" title=\"Mobile Application Development Program\"\u003eMobile Application Development Program\u003c/a\u003e. See our \u003ca href=\"https://digital.gov/2013/08/22/mobile-product-testing-guidelines/\" title=\"Mobile Product Testing Guidelines and Resources\"\u003egeneral guidelines to testing\u003c/a\u003e article for more resources on mobile product testing.\u003c/p\u003e\n\u003cp\u003ePerformance testing will typically consider the following items:\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003ePerformance when device has low battery\u003c/li\u003e\n\u003cli\u003ePerformance and download speeds on a variety of network speeds (e.g. 3G, 4G LTE)\u003c/li\u003e\n\u003cli\u003ePerformance and potential lagging on a variety of mobile devices and OS versions\u003c/li\u003e\n\u003cli\u003ePerformance when disconnected from network\u003c/li\u003e\n\u003cli\u003ePerformance under heavy load by a large number of users\u003c/li\u003e\n\u003cli\u003eBattery consumption\u003c/li\u003e\n\u003cli\u003eResponse time\u003c/li\u003e\n\u003cli\u003eResource utilization (memory and processor)\u003c/li\u003e\n\u003cli\u003eBinary size of native applications\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch2 id=\"toc0\"\u003e\u003ca name=\"x-Government Guidance\"\u003e\u003c/a\u003eGovernment Guidance\u003c/h2\u003e\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://www.whitehouse.gov/sites/default/files/omb/memoranda/2011/m11-24.pdf\" rel=\"nofollow\"\u003eExecutive Order on Improving Customer Service in Government\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.whitehouse.gov/sites/default/files/omb/assets/inforeg/PRAPrimer_04072010.pdf\" rel=\"nofollow\"\u003eOMB Fast Track Process for Collecting Service Delivery Feedback\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.whitehouse.gov/sites/default/files/omb/memoranda/2011/m11-15.pdf\" rel=\"nofollow\"\u003eOMB Guidance on Plain Language Writing Act\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.whitehouse.gov/sites/default/files/omb/assets/inforeg/PRAPrimer_04072010.pdf\" rel=\"nofollow\"\u003eOMB Memo on Information Collection under the Paperwork Reduction Act\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch2 id=\"toc1\"\u003e\u003ca name=\"x-Resources Available\"\u003e\u003c/a\u003eResources Available\u003c/h2\u003e\n\u003cp\u003eListed below are resources available that further describe and conduct performance testing. These services/companies or websites are offered as a sample of what is currently available for performance testing and do not indicate an endorsement of them or their products and/or services.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eWeb Resources\u003c/strong\u003e\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://vts.inxpo.com/Launch/QReg.htm?ShowKey=13063\u0026AffiliateData=Neo3\" rel=\"nofollow\"\u003eMobile Performance Testing In The Wild\u003c/a\u003e (recorded vendor webinar, registration required) – Discusses strategies and tools for mobile performance testing. Makes the point that mobile performance testing is very similar to conventional web performance testing.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.agileload.com/agileload/blog/2013/01/14/mobile-performance-testing-overall-analysis---whitepaper\" rel=\"nofollow\"\u003eMobile Performance Testing Overall Analysis Whitepaper\u003c/a\u003e – Comprehensive discussion of mobile performance testing techniques.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://mobile.smashingmagazine.com/2013/04/03/build-fast-loading-mobile-website/\" rel=\"nofollow\"\u003eSmashing Magazine: How To Make Your Websites Faster On Mobile Devices\u003c/a\u003e – Provides valuable statistics regarding the importance of performance on mobile, in addition the development techniques to improve performance.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://uxdesign.smashingmagazine.com/2011/07/18/seven-guidelines-for-designing-high-performance-mobile-user-experiences/\" rel=\"nofollow\"\u003eSmashing Magazine: Seven Guidelines For Designing High-Performance Mobile User Experiences\u003c/a\u003e – Explains performance in the overall context of mobile application success.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.methodsandtools.com/archive/mobileloadtesting.php\" rel=\"nofollow\"\u003eTesting Performance of Mobile Apps\u003c/a\u003e – Provides detailed approach to mobile app performance testing.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.gomez.com/resources/whitepapers/survey-report-what-users-want-from-mobile/\" rel=\"nofollow\"\u003eWhat Users Want From Mobile\u003c/a\u003e (requires registration) – Survey results that describe user expectations. For example, 71% of users expected mobile web sites to load as quickly as desktop web sites.\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch3 id=\"toc2\"\u003e\u003ca name=\"x-Resources Available-Testing Services\"\u003e\u003c/a\u003eTesting Services\u003c/h3\u003e\n\u003cp\u003eThese services/companies or web sites are offered as a sample of what is currently available and do not indicate an endorsement of them or their products and/or services.\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://mobitest.akamai.com/m/index.cgi\" rel=\"nofollow\"\u003eAkamai Mobitest\u003c/a\u003e – A free mobile web performance tool from Akamai.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.infostretch.com/\" rel=\"nofollow\"\u003eInfostretch\u003c/a\u003e – Provide performance testing of mobile applications.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.mob4hire.com/\" rel=\"nofollow\"\u003emob4hire\u003c/a\u003e – Similar to uTest, provides “crowdsourcing” testing through third-party testers.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.utest.com/load-testing\" rel=\"nofollow\"\u003euTest\u003c/a\u003e – Paid “crowdsourcing” test service that manages load testing for web and mobile applications via third-party testers.\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003e\u003cstrong\u003eTesting Tools\u003c/strong\u003e\u003c/p\u003e\n\u003cp\u003eThese tools are installed locally for mobile performance testing.\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://jmeter.apache.org/\" rel=\"nofollow\"\u003eApache JMeter\u003c/a\u003e – Open source tool for performance testing web applications, including Mobile Web.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://play.google.com/store/apps/details?id=com.aurorasoftworks.quadrant.ui.standard\" rel=\"nofollow\"\u003eAurora Software Quadrant Standard Edition\u003c/a\u003e – Free Android app to benchmark the performance of Android mobile devices. This may be useful when testing a mobile app on a limited number of real devices, in order to determine how the app will perform on other devices with similar resources.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://developers.google.com/chrome-developer-tools/\" rel=\"nofollow\"\u003eChrome Developer Tools\u003c/a\u003e – These tools are bundled in the Chrome Browser. The \u003ca href=\"https://developers.google.com/chrome-developer-tools/docs/network\" rel=\"nofollow\"\u003eNetwork Panel\u003c/a\u003e page explains how to use Chrome Developer Tools to gather performance data about your mobile web page.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.neotys.com/\" rel=\"nofollow\"\u003eNeoLoad by Neotys\u003c/a\u003e – Load and stress testing solution for mobile web and native mobile apps.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.soasta.com/products/cloudtest-lite/\" rel=\"nofollow\"\u003eSOASTA CloudTest Lite\u003c/a\u003e – Free downloadable tool for automated performance testing.\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://unicorn.bogomips.org/\" rel=\"nofollow\"\u003eUnicorn\u003c/a\u003e– Unicorn is an HTTP server for Rack applications\u003c/li\u003e\n\u003cli\u003eWeb Analytics – Services such as \u003ca href=\"http://analytics.blogspot.com/2012/03/measure-your-websites-performance-with.html\" rel=\"nofollow\"\u003eGoogle Analytics\u003c/a\u003e and \u003ca href=\"http://web.analytics.yahoo.com/\" rel=\"nofollow\"\u003eYahoo Web Analytics\u003c/a\u003e can be used to track mobile web site performance.\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch2 id=\"toc4\"\u003e\u003ca name=\"x-Test Plans/Checklists available on GitHub\"\u003e\u003c/a\u003eTest Plans/Checklists available on GitHub\u003c/h2\u003e\n\u003cp\u003eThe \u003ca href=\"http://gsa.github.io/Mobile-Code-Catalog/index.html\"\u003eMobile Code Sharing Catalog\u003c/a\u003e has \u003ca href=\"http://gsa.github.io/Mobile-Code-Catalog/testing.html\"\u003etest plans or cases or checklists\u003c/a\u003e that have been uploaded to GitHub and are available as samples and/or for use.\u003c/p\u003e\n\u003cp\u003e\u003cem style=\"line-height: 1.5em;\"\u003eRyan Day, GSA, and Ben Weaver, USDA, contributed to this post.\u003c/em\u003e\u003c/p\u003e\n"}
  ]
}