{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Which Devices Should I Test With? |Digital.gov",
    "description": "Which Devices Should I Test With?",
    "home_page_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/","feed_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2013/10/29/which-devices-should-i-test-with/index.json","item" : [
    {"title" :"Which Devices Should I Test With?","summary" : "Developing a test device selection plan that is updated on a regular basis will help your organization whittle down the list of devices to a manageable number.","date" : "2013-10-29T11:14:52-04:00","date_modified" : "2025-01-27T19:42:55-05:00","authors" : {"mobilegov-team" : "MobileGov Team"},"topics" : {
        
            "mobile" : "Mobile",
            "research" : "Research"
            },"branch" : "bc-archive-content-3",
      "filename" :"2013-10-29-which-devices-should-i-test-with.md",
      
      "filepath" :"news/2013/10/2013-10-29-which-devices-should-i-test-with.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/bc-archive-content-3/content/news/2013/10/2013-10-29-which-devices-should-i-test-with.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/bc-archive-content-3/content/news/2013/10/2013-10-29-which-devices-should-i-test-with.md","slug" : "which-devices-should-i-test-with","url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2013/10/29/which-devices-should-i-test-with/","content" :"\u003ch2 id=\"like-a-kid-in-a-candy-store-\"\u003eLike a kid in a candy store \u0026hellip;\u003c/h2\u003e\n\u003cdiv class=\"image image-right image-right-legacy\"\u003e\n  \u003cimg\n    src=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/04/smartphones-250-x-167.jpg\"\n    alt=\"An illustration of a stack of smart cell phones\"/\u003e\u003c/div\u003e\n\n\u003cp\u003eEvery time we go to the mall, the kids pull us to the candy store with the floor-to-ceiling tubes of colored candy. The kids quickly grab their bags and scavenge from each of the bins until their bags fill up. They usually don’t even get to the second aisle of candy.\u003c/p\u003e\n\u003cp\u003eAs testers, we do the same thing with new technology, gadgets, and new devices as kids in a candy store. We say to ourselves, “We need some of each device for testing.”\u003c/p\u003e\n\u003ch2 id=\"device-differences\"\u003eDevice Differences\u003c/h2\u003e\n\u003cp\u003eSmart phones have flooded the market; worldwide, Android alone is manufactured by over 23 companies, producing over 250 different device makes and models of phones. The Unites States alone has over 15 manufacturers building over 100 different makes and models. However, that’s not the end; Androids come in over 10 different operating system versions with multiple screen sizes and densities.\u003c/p\u003e\n\u003cp\u003eWhile Android and Apple devices are about 92% of the US market, there are many different makes, models, and operating system versions such as Blackberry, Nokia, Sailfish, Microsoft, and Firefox, just to name a few.\u003c/p\u003e\n\u003cp\u003eDeveloping a test device selection plan that is updated on a regular basis will help your organization whittle down the list of devices to a manageable number.\u003c/p\u003e\n\u003cp\u003eDeveloping the test device selection plan requires you to:\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eKnow your customer\u003c/li\u003e\n\u003cli\u003eResearch and look for trends\u003c/li\u003e\n\u003cli\u003eDevelop a test priority list\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003eThe rest of this post gives details for each of the steps above.\u003c/p\u003e\n\u003ch2 id=\"know-your-customer\"\u003eKnow Your Customer\u003c/h2\u003e\n\u003cp\u003eWhen you develop your application, keep the customer in mind. Different demographics have different characteristics and devices, and they use these devices quite differently. For example, my kids grew up using the tablet and now do everything on their smart phone. My mom on the other hand just started using a smart phone and mostly uses it to make calls.\u003c/p\u003e\n\u003cp\u003eOne way to help determine your customers is through web analytics tools that create reports of Web site traffic and traffic sources–federal agencies should check out the \u003ca class=\"wiki_link_ext\" href=\"http://www.howto.gov/web-content/digital-metrics/digital-analytics-program\" rel=\"nofollow\"\u003eDigital Analytics Program\u003c/a\u003e if they are looking for web analytics programs. From these reports, we are able to see exactly what make, model, and version of mobile device each person is using to access your application. Keeping this in mind, we have a better idea where to focus our testing when we make changes.\u003c/p\u003e\n\u003cp\u003eWhat are the demographics, wants, and needs of the users of your mobile application?\u003c/p\u003e\n\u003ch2 id=\"research-and-look-for-trends\"\u003eResearch and Look for Trends\u003c/h2\u003e\n\u003cp\u003eNew phone makes, models, and operating systems are continually being released. How can you spot the trends and keep up with the ever-changing combinations of devices so you can plan and acquire the proper devices to use for testing?\u003c/p\u003e\n\u003cp\u003eTools such as \u003ca class=\"wiki_link_ext\" href=\"http://gs.statcounter.com/\" rel=\"nofollow\"\u003eStatCounter\u003c/a\u003e, a free online tool can help to spot trends in data, such as changes in mobile OS, mobile browser, and screen resolution. StatCounter can show you that user trends from the United States and from other areas of the world are very different. This is yet further proof that you need to know your customers and where they are coming from.\u003c/p\u003e\n\u003ch2 id=\"develop-a-test-priority-list\"\u003eDevelop a Test Priority List\u003c/h2\u003e\n\u003cp\u003eSince we don’t have time and resources to test every combination of make, model, and operating system, we need to develop a priority list.\u003c/p\u003e\n\u003cp\u003eDeveloping a mobile device priority list is like deciding what candy to purchase. Developing the proper list in the correct order can take a bit of time, but it is the best way to most efficiently test on the “most important” devices.\u003c/p\u003e\n\u003cp\u003eEach organization should conduct a monthly meeting with analysts, developers, testers, and any other stakeholders to agree on what devices their application will need to function properly on and be tested on.\u003c/p\u003e\n\u003cp\u003eThe list should be developed using inputs from:\u003c/p\u003e\n\u003col\u003e\n\u003cli\u003eCustomer information – Your customers’ demographics, special needs, and considerations\u003c/li\u003e\n\u003cli\u003eMobile trends – Using tools such as StatCounter look at the world and US statistics and trends that reflect your needs\u003c/li\u003e\n\u003cli\u003eTrends on your site – Using web analytics tools to see what your customers are using to access your application\u003c/li\u003e\n\u003c/ol\u003e\n\u003cp\u003eNext, you should develop your list. Create a chart with the devices you will test with based on the research. Be sure to include make, model, and operating system.\u003c/p\u003e\n\u003cp\u003eFinally, now that you have your list, make sure the devices are available to the testers.\u003c/p\u003e\n\u003cp\u003eWith the Internet, anyone can use a Web application anywhere in the world, but organizations do not have the time or resources to test every possible device. By developing a mobile device priority list, your organization can develop a standard list of supported devices.\u003c/p\u003e\n\u003cp\u003eDon’t be like kids in a candy store and think you need to test every make, model, and version of phone on the market. Develop a device selection plan.\u003c/p\u003e\n\u003cp\u003eWhat is your strategy for selecting devices to test? Give us your comments on the discussion tab.\u003c/p\u003e\n\u003ch2 id=\"references\"\u003eReferences\u003c/h2\u003e\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"http://www.perfectomobile.com/portal/cms/resources/right_devices.pdf\"\u003eHow to Set the Right Strategy for Selecting Devices for your Enterprise’s mobile testing\u003c/a\u003e – Perfecto Mobile \u003cem\u003e(PDF – 6 pages, 693 KB)\u003c/em\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://go.utest.com/rs/utest1/images/uTest_8_Tips_for_Android_App_Success.pdf\"\u003e8 Tips for Android App testing\u003c/a\u003e – uTest \u003cem\u003e(PDF – 11 pages – 717 KB)\u003c/em\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://stephanierieger.com/strategies-for-choosing-test-devices/\"\u003eStrategies for Choosing Test Devices\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://mobile-application-testing.blogspot.com/2013/06/strategies-for-selecting-mobile-devices.html#%21/2013/06/strategies-for-selecting-mobile-devices.html\"\u003eStrategies for selecting mobile devices for testing\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://bradfrostweb.com/blog/mobile/test-on-real-mobile-devices-without-breaking-the-bank/\"\u003eTest on Real Mobile Devices without Breaking the Bank\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://opensignal.com/reports/fragmentation-2013/\"\u003eAndroid Fragmentation Visualized\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://regulargeek.com/2010/05/29/25-free-google-analytics-alternatives/\"\u003e25 Free Google Analytics Alternatives\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.perfectomobile.com/sites/default/files/downloads/getting_the_most.pdf\"\u003eGetting the Most Out of Your Mobile Functional Testing\u003c/a\u003e \u003cem\u003e(PDF – 7 pages, 944 KB)\u003c/em\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.logigear.com/magazine/mobile-testing/2645/?mkt_tok=3RkMMJWWfF9wsRolu6vIZKXonjHpfsX54%2BUlX7Hr08Yy0EZ5VunJEUWy2YQDTtQ%2FcOedCQkZHblFnVkLTK2iX68Nq6IE\"\u003eLeverage Automation to Make Mobile Testing Manageable\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.mobilejoomla.com/mobile-joomla-blog/159-8-ways-to-test-a-mobile-site-on-different-mobile-devices.html\"\u003e8 Ways To Test A Mobile Site on Different Mobile Devices\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.cmswire.com/cms/customer-experience/testing-mobile-devices-is-about-more-than-vendors-its-about-device-versions-021705.php\"\u003eTesting Mobile Devices is About More than Vendors, It’s About Device Versions\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.nextgov.com/emerging-tech/2013/08/crowd-may-have-answers-agencies-must-define-problem/69017/?oref=nextgov_today_nl\"\u003eThe Crowd May Have Answers, but Agencies Must Define The Problem\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://www.businessofgovernment.org/report/using-crowdsourcing-government\"\u003eUsing Crowdsourcing in Government\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\u003chr\u003e\n\u003cp\u003eThe Mobile Tester Newsletter is sent bi-monthly to the volunteer testers in our Federal Crowdsource Mobile Testing Program. Each newsletter contains a feature article, and interesting trends and statistics from the world of mobile testing. To receive our next edition, sign up to become a tester.\u003c/p\u003e\n"}
  ]
}