{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Measure Performance to Make Continuous Improvements |Digital.gov",
    "description": "Measure Performance to Make Continuous Improvements",
    "home_page_url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/","feed_url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/2020/08/04/measure-performance-to-make-continuous-improvements/index.json","item" : [
    {"kicker" : "This Week's IDEA","title" :"Measure Performance to Make Continuous Improvements","deck" : "Listening to customers is the best way to improve websites and digital services.","summary" : "This week, we’re exploring what it means to measure performance, and we’re taking a look at how listening to customers is the best way to continuously improve websites and digital services.","date" : "2020-08-04T12:00:00-05:00","date_modified" : "2024-04-02T09:45:13-04:00","authors" : {"rflagg" : "Rachel Flagg","ammie-farraj-feijoo" : "Ammie Farraj Feijoo"},"topics" : {
        
            "analytics" : "Analytics",
            "customer-experience" : "Customer experience",
            "digital-service-delivery" : "Digital Service Delivery"
            },"primary_image" : { "uid" : "this-weeks-idea-card-wk3", "alt" :
  "the words, "This Week's IDEA" with a line drawing of a lightbulb in white, on dark blue background", "width" :
  "1073", "height" :
  "600", "credit" :
  "", "caption" :
  "", "format" :
  "png" },"branch" : "cm-topics-button-component",
      "filename" :"2020-08-04-measure-performance-to-make-continuous-improvements.md",
      
      "filepath" :"news/2020/08/2020-08-04-measure-performance-to-make-continuous-improvements.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/cm-topics-button-component/content/news/2020/08/2020-08-04-measure-performance-to-make-continuous-improvements.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/cm-topics-button-component/content/news/2020/08/2020-08-04-measure-performance-to-make-continuous-improvements.md","slug" : "measure-performance-to-make-continuous-improvements","url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/2020/08/04/measure-performance-to-make-continuous-improvements/","weight" : "1","content" :"\u003cdiv class=\"card-quote \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"q\"\u003e“\u003c/span\u003eWhen people talk, listen completely. Most people never listen.\u003cspan class=\"q\"\n        \u003e”\u003c/span\n      \u003e\u003ccite\u003e—Ernest Hemingway\u003c/cite\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\n\n\u003cdiv class=\"image image-right\"\u003e\n  \u003cimg\n    src=\"https://s3.amazonaws.com/digitalgov/this-weeks-idea-icon-wk3_w200.png\"  alt='A line drawing of a lightbulb in white, on dark blue background'\n    srcset=\"https://s3.amazonaws.com/digitalgov/this-weeks-idea-icon-wk3_bu.jpg 48w,https://s3.amazonaws.com/digitalgov/this-weeks-idea-icon-wk3_w600.png 600w,https://s3.amazonaws.com/digitalgov/this-weeks-idea-icon-wk3_w400.png 400w,https://s3.amazonaws.com/digitalgov/this-weeks-idea-icon-wk3_w200.png 200w\"\n    sizes=\"(max-width: 600px) 40vw, 400px\"\n  /\u003e\u003c/div\u003e\n\n\n\u003cp\u003eWelcome to \u003ca href=\"https://digital.gov/topics/this-weeks-idea/\"\u003eThis Week’s IDEA\u003c/a\u003e, where we talk about one essential topic around \u003ca href=\"https://digital.gov/resources/21st-century-integrated-digital-experience-act/\"\u003e21st Century IDEA\u003c/a\u003e and share resources and tools that you can use to start making small, incremental changes to your websites and digital services.\u003c/p\u003e\n\u003cp\u003eOne of the design principles of the \u003ca href=\"https://designsystem.digital.gov/\"\u003eU.S. Web Design System\u003c/a\u003e (USWDS) is to \u003ca href=\"https://designsystem.digital.gov/design-principles/#listen\"\u003elisten\u003c/a\u003e, or evaluate and improve your product by listening to your audience and learning from what you hear.\u003c/p\u003e\n\u003cp\u003eContinuous feedback drives continuous improvement. We should measure customer experience—determine how well what we’ve built is working for our audience—at every stage. And we should listen to what people say, and observe how they interact with our products or services, through direct observation and analytics data.\u003c/p\u003e\n\u003cp\u003eIf we’re not listening, we’re not learning.\u003c/p\u003e\n\u003cp\u003eBelow, we share a case study from the U.S. Department of Health and Human Services (HHS) on how they’re listening through their performance measurement program.\u003c/p\u003e\n\u003ch2 id=\"hhs-performance-measurement-program\"\u003eHHS Performance Measurement Program\u003c/h2\u003e\n\u003cp\u003eThe digital performance measurement program at HHS has changed the way the agency manages its sites and content, driving better understanding of customers and their needs. Performance measures guide how they allocate resources, and inform their vision for the future, including where they innovate. They are committed to listening to users, and gather both quantitative and qualitative data to empower teams across HHS to have deeper dialogues about service delivery. Listening to customer feedback has changed how HHS communicates with, and provides services to, the public.\u003c/p\u003e\n\u003cp\u003eTo determine key performance indicators (KPIs), HHS first identifies their goals, then they tailor their KPIs to reflect the value they aim to bring to users, and what they measure against. They’ve adopted a few universal KPIs, which they’ve dubbed “Satisfaction KPIs.” These are based on 21st Century IDEA and the \u003ca href=\"https://designsystem.digital.gov/design-principles/\"\u003eUSWDS design principles\u003c/a\u003e, and include page load time, readability, search satisfaction, and search engine optimization (SEO).\u003c/p\u003e\n\u003cp\u003eAt the same time, they recognize that every site is different, with different business goals. As an example, a metric such as bounce rate would not be a good common KPI when comparing sites such as time.gov and IRS.gov. \u003ca href=\"https://www.time.gov/\"\u003eTime.gov\u003c/a\u003e is expected to have a relatively high bounce rate (a visitor checks the time and leaves the site), whereas \u003ca href=\"https://www.irs.gov/\"\u003eIRS.gov\u003c/a\u003e is expected to have a much lower bounce rate (visitors browse across many pages, checking tax information, changes to tax laws, etc.). Because these two sites have very different goals, KPIs must be tailored to fit each site.\u003c/p\u003e\n\u003cp\u003eHowever, when sites have goals that align, some KPIs could apply across the board. Because many sites across the HHS network focus on information dissemination, many will use common KPIs such as pageviews and time on page to measure performance or success. They can customize these, based on targeted user actions such as downloading a form or clicking a link to an external site.\u003c/p\u003e\n\u003ch2 id=\"customer-satisfaction-surveys\"\u003eCustomer Satisfaction Surveys\u003c/h2\u003e\n\u003cp\u003eHHS uses a common survey platform, and runs surveys on all of their websites. Feedback is collected at both the site and page level, and they have developed a common baseline to allow comparison around similar topics such as, \u003ccode\u003eWas this page helpful?\u003c/code\u003e They also incorporate additional questions based on current customer experience strategies and specific experiences, and leverage different triggering mechanisms to reach users at different interaction points along the journey, based on agency goals and user paths. Surveys may appear as an on-page survey, a feedback slider, or a popover survey.\u003c/p\u003e\n\u003cp\u003eTo analyze and benchmark customer satisfaction data across sites, HHS uses the \u003ccode\u003eWas this page helpful?\u003c/code\u003e metric as the key benchmark for cross-page and cross-site satisfaction comparison.\u003c/p\u003e\n\u003cdiv class=\"card-quote \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"q\"\u003e“\u003c/span\u003eCustomer survey questions let us delve into the real issues with the site. Web analytics today are a fantastic tool, and can easily define areas of improvement, but to get the true feeling of customers, the surveys are paramount.\u003cspan class=\"q\"\n        \u003e”\u003c/span\n      \u003e\u003ccite\u003e—Stacey Palosky, Digital Communications Director at HHS\u003c/cite\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\u003cp\u003eCustomer feedback and satisfaction data are shared internally with both employees and managers, primarily through dashboards that consolidate data into easily digestible information. They also host regular meetings to brief staff on high-level trends, and dive deeper into specific inquiries. They don’t currently share customer satisfaction data publicly, but are considering doing so in the future.\u003c/p\u003e\n\u003ch2 id=\"actionable-data\"\u003eActionable Data\u003c/h2\u003e\n\u003cp\u003e“Actionable” is key for any analytics team. HHS has the capability to track data from a variety of sources, all tied to clearly defined actions. Their goal is to make \u003ca href=\"https://www.hhs.gov/\"\u003eHHS.gov\u003c/a\u003e a flagship government website. When they flag a spike or drop, they first look at the quantitative metrics that may be related to, or impacted by, the change. They also use qualitative survey data to complete the story, to understand the underlying issue. They analyze both qualitative and quantitative data to determine how to address any underlying issues that impact users, such as improving SEO language to ensure people are finding the right information, or improving information architecture to deliver a better customer experience.\u003c/p\u003e\n\u003ch2 id=\"insights\"\u003eInsights\u003c/h2\u003e\n\u003cp\u003eRecently, the most surprising finding for HHS has been the flip in user searches from \u003ccode\u003ecoronavirus\u003c/code\u003e to \u003ccode\u003ecovid\u003c/code\u003e. Since the pandemic hit the U.S. in February 2020, \u003ccode\u003ecoronavirus\u003c/code\u003e was the top search term across HHS.gov, as well as across the web. With this information, HHS made the decision to use \u003ccode\u003ecoronavirus\u003c/code\u003e in site copy (as opposed to \u003ccode\u003ecovid\u003c/code\u003e) to improve search engine rankings for the more popular term. This remained a constant through March, April, and even into May, but toward the end of May they began to notice a shift. By the beginning of June, \u003ccode\u003ecovid\u003c/code\u003e searches had surpassed \u003ccode\u003ecoronavirus\u003c/code\u003e searches, not only across HHS.gov search, but also on external search engines. By monitoring this data on a consistent basis, HHS was able to make easy adjustments to their content and SEO, to ensure they continued to deliver relevant information based on the most popular search terms.\u003c/p\u003e\n\u003cp\u003eData has also played a key role in improving and informing the coronavirus content strategy on HHS.gov. Over the past several months, HHS played a major role in the distribution of coronavirus-related information to citizens and healthcare providers. With news and guidance in the early days of the pandemic often changing several times a day, they used data to identify content gaps and areas of confusion, and worked to ensure visitors could easily find and understand important information.\u003c/p\u003e\n\u003ch2 id=\"governance\"\u003eGovernance\u003c/h2\u003e\n\u003cp\u003eThe HHS Digital Council consists of individuals from across the department who worked together to develop a digital strategy to define and coordinate their digital communications. The council works together to outline the way ahead for HHS as a whole, and develops the best practices to carry out their mission of reaching the American public. While everyone on the council works in different parts of HHS, each with their own mission and target audiences, they were able to find commonality and work towards shared goals.\u003c/p\u003e\n\u003cp\u003eTheir current challenge, along with many others in government right now, is adapting their roadmap to tackle their new role in responding to the pandemic. However, they acknowledge that COVID-19 has helped to highlight areas of improvement that they would not have anticipated prior to this experience, and so they continue to learn and respond proactively to new challenges as they arise.\u003c/p\u003e\n\u003ch2 id=\"up-next\"\u003eUp Next\u003c/h2\u003e\n\u003cp\u003eAttend any or all webinars in the Digital Analytics Program’s three-part analytics case study series:\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003e\n\u003cp\u003e\u003ca href=\"https://digital.gov/event/2020/08/26/dap-analytics-case-study-part-1/\"\u003ePart 1: Assessment\u003c/a\u003e—How to assess your analytics strategy to ensure you’re pulling impactful and relevant data (August 26)\u003c/p\u003e\n\u003c/li\u003e\n\u003cli\u003e\n\u003cp\u003e\u003ca href=\"https://digital.gov/event/2020/09/24/dap-analytics-case-study-part-2/\"\u003ePart 2: Analysis\u003c/a\u003e—How to pull reporting and conduct analysis through the lens of your analytics strategy (September 24)\u003c/p\u003e\n\u003c/li\u003e\n\u003cli\u003e\n\u003cp\u003e\u003ca href=\"https://digital.gov/event/2020/10/21/analytics-case-study-part-3-action/\"\u003ePart 3: Action\u003c/a\u003e—How to take actions using the analysis and insights you created using DAP and Google Analytics (October 21)\u003c/p\u003e\n\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003eListen to \u003ca href=\"https://digital.gov/event/2020/07/23/dap-learning-series-lessons-from-canadaca/\"\u003eAnalytics Lessons From Canada.ca\u003c/a\u003e and learn how our northern neighbors approach analytics.\u003c/p\u003e\n\u003ch2 id=\"from-the-field\"\u003eFrom the Field\u003c/h2\u003e\n\u003cp\u003e“In the past two years, the HHS.gov team has vastly improved page load speeds, working to make sure that our pages load quickly on phones. Now, you’re going to start to see more of the visible changes that will continue to make it easier for our users to find what they are looking for. Today, 80 percent of HHS.gov visitors consistently report they found or partially found what they were looking for. Just five years ago, it was less than 20 percent. With improved understanding of user goals, needs, and behavior driving our design and functional decisions, we expect to see customer satisfaction continue to rise.”—via \u003ca href=\"https://www.hhs.gov/blog/2020/03/17/website-modernization-continues.html\"\u003eHHS.gov\u003c/a\u003e\u003c/p\u003e\n\u003chr\u003e\n\u003cp\u003eDo you have a 21st Century IDEA-related comment or question? Or would you like to give a shout out to your colleagues? Send it to us at \u003ca href=\"mailto:digitalgov@gsa.gov\"\u003edigitalgov@gsa.gov\u003c/a\u003e, and we’ll work to incorporate it into the next newsletter.\u003c/p\u003e\n"}
  ]
}