{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Delivering on 21st Century IDEA: A case study from the GSA SmartPay team (Part 2) |Digital.gov",
    "description": "Delivering on 21st Century IDEA: A case study from the GSA SmartPay team (Part 2)",
    "home_page_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/","feed_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2023/11/29/part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team/index.json","item" : [
    {"title" :"Delivering on 21st Century IDEA: A case study from the GSA SmartPay team (Part 2)","summary" : "A GSA SmartPay product owner shares his experiences as a first-time product owner in a government agile development project.","date" : "2023-11-29T08:02:00-05:00","date_modified" : "2025-01-27T19:42:55-05:00","authors" : {"jessica-marine" : "Jessica Marine","andrew-lee" : "Andrew Lee"},"topics" : {
        
            "content-strategy" : "Content strategy",
            "digital-service-delivery" : "Digital service delivery",
            "governance" : "Governance",
            "product-and-project-management" : "Product and project management",
            "professional-development" : "Professional development"
            },"primary_image" : { "uid" : "three-gsa-smartpay-screens-part-2", "alt" :
  "Three screenshots of GSA SmartPay websites overlap each other against a yellow and blue gradient background. From rear to front, the sites are: 889 Representations Search, Complete Your GSA SmartPay Training, and the main GSA SmartPay homepage.", "width" :
  "1200", "height" :
  "628", "credit" :
  "", "caption" :
  "", "format" :
  "png" },"branch" : "bc-archive-content-3",
      "filename" :"2023-11-29-part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team.md",
      
      "filepath" :"news/2023/11/2023-11-29-part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/bc-archive-content-3/content/news/2023/11/2023-11-29-part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/bc-archive-content-3/content/news/2023/11/2023-11-29-part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team.md","slug" : "part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team","url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2023/11/29/part-2-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team/","weight" : "1","content" :"\u003cdiv class=\"box \"\u003e\n  \u003cp\u003e\u003cem\u003eThis is Part 2 in a three-part series with the U.S. General Services Administration (GSA) Center for Charge Card Management (CCCM) about building their new, open-source \u003ca href=\"http://smartpay.gsa.gov\"\u003eprogram\u003c/a\u003e and \u003ca href=\"http://training.smartpay.gsa.gov\"\u003etraining\u003c/a\u003e websites, and the new \u003ca href=\"https://889.smartpay.gsa.gov/\"\u003eSection 889\u003c/a\u003e web app.\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cem\u003eFor this post, Jessica Marine, a product manager on the GSA Service Delivery team, chatted with product owner, Andrew Lee. Andrew is a business management specialist with CCCM.\u003c/em\u003e\u003c/p\u003e\n\n\u003c/div\u003e\n\n\n\n\n\n\n\n\n\u003cdiv class=\"image\"\u003e\n  \u003cimg\n        src=\"https://s3.amazonaws.com/digitalgov/three-gsa-smartpay-screens-part-2.png\"alt=\"Three screenshots of GSA SmartPay websites overlap each other against a yellow and blue gradient background. From rear to front, the sites are: 889 Representations Search, Complete Your GSA SmartPay Training, and the main GSA SmartPay homepage.\"/\u003e\u003c/div\u003e\n\n\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eSo, thanks for taking the time to chat with us, Andrew. Let’s jump right in. How did you find yourself in the role of product owner at CCCM to lead the GSA SmartPay modernization effort?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: I’ve been a project manager for more than a decade. I worked on non-technology projects such as acquisitions and policy development. Since joining the GSA SmartPay team, I’ve had several different roles, including the project lead and contracting officer’s representative for the GSA SmartPay website. I had never led a technology project before, and it was like a new world.\u003c/p\u003e\n\u003cp\u003eIn early 2023, it was time to recompete the contract. The program assessed the existing solution and decided to explore different development and even contracting options, based on the needs of our customers and our program. We met with GSA IT’s \u003ca href=\"https://github.com/GSA/service-delivery\"\u003eService Delivery\u003c/a\u003e team and agreed to work together as an integrated team for a full custom rebuild of the GSA SmartPay program and training sites, as well as a procurement for agile software development support.\u003c/p\u003e\n\u003cp\u003eGiven my background and role on the website project, it seemed like a natural fit to take on a product owner role.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eLet’s zoom back to the start of the project. What were some of your initial reactions to building an open source product using user-centered design and agile development?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Pure terror. I was excited to learn, but I had heard about many challenging technology development projects in the course of my career. I’d seen many agile development projects suffer from pitfalls such as \u003ca href=\"https://bja.ojp.gov/program/it/help/glossary#:~:text=Scope%20creep%20is%20the%20slow,and%20loss%20of%20original%20goals.\"\u003escope creep\u003c/a\u003e, cost overruns, insufficient requirements definition, and excessive rework.\u003c/p\u003e\n\u003cp\u003eThese pitfalls aren’t unique to agile, but not having done it before, it seemed like, from the outside, that the flexibility of agile made it more risky. My instinct was to mitigate these risks through things like rigid scopes of work, constant project schedule tracking, and firm fixed price contracts. I learned later, that wasn’t true. I’ve come to believe that this may have been because developers did not engage with users enough throughout the development process. The very definition of agile project management is focusing on continuous releases and incorporating customer feedback with every iteration.\u003c/p\u003e\n\u003cp\u003eI was also nervous about learning a new skill set. Everything I knew about project management depended on project charters, schedules, and well-defined technical requirements. I definitely needed to change my mindset.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eHow did those changes work out for you?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Initially, I may have had some buyer’s remorse. It was work to retrain my brain and to learn a new process and vocabulary. Also, there’s a lot of what I used to call “magic” that happens in agile. There’s flexibility built into the process, but in the beginning – and especially for someone trained in classic project management – it felt like chaos. Typically, the product owner defines the goals of functionality and relies on the development team to come up with the solution. This was extremely uncomfortable, because I felt like I couldn’t control the solution.\u003c/p\u003e\n\u003cp\u003eBut, it worked. I was amazed at the end of development sprints that functionality worked. It didn’t always work the way I thought it should, but the team’s usability testing confirmed that it made sense to the users, our cardholders and agency program coordinators. It didn’t matter what I thought, as long as it met the users’ needs. I learned quickly that the “magic” in agile happens because of repetition, team discipline, trust, user engagement, constant feedback, and continuous process refinement.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eThis was your first time acting as a product owner. What was your experience like?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: It was like trying to keep 100 balloons that were dropped from the ceiling at different times from touching the floor. Several things happened at the same time and many tasks were either very urgent or extremely urgent. I consider myself an efficient task manager but this process was incredibly challenging, as I had to track and navigate multiple priorities and stakeholders and hold everything in my head. I was very fortunate to have such strong partners, team members, and supportive management to keep track of all moving pieces.\u003c/p\u003e\n\n\n\n\n\n\n\u003cdiv class=\"quote-block \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e“\u003c/span\u003e\n      It was like trying to keep 100 balloons that were dropped from the ceiling at different times from touching the floor.\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e”\u003c/span\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eBecause the sites had to launch by a certain date, you had to protect scope creep. How did you do that? How did you decide what was included in the minimally viable product (MVP) versus post-MVP?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: I thought I had an idea of what the system should look like in my head, at the very beginning. Very quickly, I had to throw that out as I began to understand the agile development process better and the focus on the voice of the user. This came through \u003ca href=\"https://digital.gov/topics/research/\"\u003eresearch\u003c/a\u003e, \u003ca href=\"https://digital.gov/topics/content-strategy/\"\u003econtent\u003c/a\u003e audit work, and \u003ca href=\"https://digital.gov/topics/analytics/\"\u003eanalytics\u003c/a\u003e. Once we started creating roadmaps based on user needs, the user-focused framework became even more clear.\u003c/p\u003e\n\u003cp\u003eThe team created roadmaps to represent user value and drive stories for system functionality, which helped us keep on track and review progress. We regularly discussed and made decisions about development priorities for the MVP. Hard decisions were made, and honestly, some of them seemed counterintuitive at the time. But keeping customers’ needs at the front of development, I think we made the right decisions. The closer we were to launch, the harder those decisions were because time is a finite resource.\u003c/p\u003e\n\u003cp\u003ePrioritization was so important, especially for preventing scope creep for the MVP. If I thought a function was “nice to have,” even if the level of effort was low, I had to learn to deprioritize it.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eYou really embraced the need for an accessible site. What are some of the most important things that you learned in this space?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: In the past, I thought \u003ca href=\"https://digital.gov/topics/accessibility/\"\u003eaccessibility\u003c/a\u003e started and stopped with conforming with Section 508 of the Rehabilitation Act. Working with subject matter experts on the team, I came to understand that true accessibility is not just about choosing colors and layouts, but understanding how design decisions, navigation decisions, and accessible content impacts users.\u003c/p\u003e\n\u003cp\u003eWe didn’t want to achieve 508 conformance just to say our website systems are accessible. We wanted a truly accessible site. It required a change in mindset. I have come to understand that Section 508 is a law, but accessibility is an experience, and our website delivers well beyond Section 508.\u003c/p\u003e\n\n\n\n\n\n\n\u003cdiv class=\"quote-block \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e“\u003c/span\u003e\n      Section 508 is a law, but accessibility is an experience, and our website delivers well beyond Section 508.\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e”\u003c/span\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhat has been your most rewarding experience on the project?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Working with talented team members and feeling we had full management support. Our partnership with the GSA Service Delivery team demonstrated we can work effectively and innovatively in a government setting with the right approach, process, and organizational buy-in. Even though the process felt hectic, I was energized working with the right integrated team to deliver value to our customers.\u003c/p\u003e\n\u003cp\u003eI also want to thank our management team. As much as the team had to pivot and reprioritize issues, our Directors were right there with us, being patient and giving us the resources to deliver. They communicated the value of this process to leadership and our customers. This showed me the importance of buy-in and empowered me to make the right decisions.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhat new skills have you developed as a result of being product owner on this project?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Obviously, I learned to manage an agile project and the importance of engaging customers early in the development process. But the most valuable skill I learned was prioritization. As a traditional project manager, I was used to identifying, mitigating, and reducing risk. In my career, the way I did that was to anticipate risk and act early, regardless of when the risk would be realized.\u003c/p\u003e\n\u003cp\u003eThis experience has taught me that it’s still important to identify and track risk early, but with an effective team and well-defined goals, acting early isn’t always the right move. Oftentimes, having patience pays off. I saw big problems become much smaller over time or disappear as we tackled priority items and when we received feedback from users. It wasn’t about procrastination or avoiding problems. It was about timely action based on managing multiple priorities. As a side note, this has been a good lesson for me outside of work, too, to reduce stress.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhat has been the reaction to the product?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: To paraphrase a colleague, this has been a boring launch, and we mean this in the best way possible! With any transition, the team had to manage change and fix some bugs, but reports of issues were unexpectedly manageable. We braced for an overwhelming flood of negative feedback or bug reports, and it hasn’t happened.\u003c/p\u003e\n\u003cp\u003eWe’ve received a lot of positive feedback from our customers indicating they like the streamlined website content and the innovative way they can access training quizzes and results without an account.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eCan you offer any advice to someone new in government who is stepping into the role of product owner perhaps for the first time?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: If you have an open mind, aren’t shy about asking questions, and are ready to put in the work, it might be uncomfortable but as long as the process is done right, it will pay off.\u003c/p\u003e\n\n\n\n\n\n\n\u003cdiv class=\"quote-block \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e“\u003c/span\u003e\n      It might be uncomfortable but as long as the process is done right, it will pay off.\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e”\u003c/span\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\u003cp\u003eYour priorities should be based on value to users. Each user story that is written for development should be like a mini-business case; the value proposition to the user should be clear. Remember that development should be driven by user need and value, and not only by what internal stakeholders find important.\u003c/p\u003e\n\u003cp\u003eAlso, no two days will look the same. For some, that might be interesting and exciting, but some might not like the unpredictability. As long as you are curious, willing to learn, open to feedback, and willing to communicate often, that’s a really good start.\u003c/p\u003e\n\u003cp\u003eLastly, don’t forget to eat lunch! I had lots of consecutive meetings, so I had to make a conscious effort to take breaks.\u003c/p\u003e\n\n\n\n\n\n\n\u003cdiv class=\"quote-block \"\u003e\n    \u003cblockquote\u003e\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e“\u003c/span\u003e\n      Don’t forget to eat lunch!\n      \u003cspan class=\"quote-block__quotation-mark\"\u003e”\u003c/span\u003e\u003c/blockquote\u003e\n  \u003c/div\u003e\n\u003ch2 id=\"lightning-round\"\u003eLightning round!\u003c/h2\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eSo, how did you get prepared for taking on this role?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003eAndrew Lee: Took several deep breaths before each meeting, tried to stay open-minded, and just sort of jumped in. I figured it out as we worked.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhat’s the No. 1 trait for a product owner to have?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: The ability to engage with and advocate for the user. The program might find a feature important, but it’s not important to the user. It can be uncomfortable for the product owner to disagree with the program when they know the user wants something else.\u003c/p\u003e\n\u003cp\u003eAlso, the ability to work through different needs and prioritize. When everything is a high priority, the product owner needs to manage priorities and communicate with stakeholders.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhen’s the last time you had to tell someone “No”?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: I don’t like saying no to people. But as a product owner, especially shortly before launch and now after launch, I’ve had to find creative ways to give “soft no’s.” I take requests but communicate that we will assess and prioritize all requests based on user feedback and need.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eHow did it feel completing the burndown chart (simple chart used in agile showing work completed and remaining) for MVP?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Like I forgot to do something or several somethings.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eHow did you feel the first time that you discovered a bug in production?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Totally fine. Bugs are pretty normal, and I had complete confidence in our team and the process to fix the issue.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eWhat have you gotten spectacularly wrong recently?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: The belief that agile only works in tech companies with seemingly unlimited budgets!\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eHow were you feeling when the system went live?\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Anxious before the proverbial switch was flipped, and extremely suspicious when we had a relatively quiet launch.\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eJessica Marine\u003c/strong\u003e: \u003cem\u003eBravo, Andrew, on all that you’ve accomplished. Thank you so much for sharing your experience.\u003c/em\u003e\u003c/p\u003e\n\u003cp\u003e\u003cstrong\u003eAndrew Lee\u003c/strong\u003e: Thank you for having me! I was fortunate to be part of an amazing, patient, and collaborative team with incredibly supportive management and leadership. It was a very busy but rewarding process, and I am happy to have shared my experiences as someone new to agile product ownership.\u003c/p\u003e\n\u003chr\u003e\n\u003cp\u003e\u003cem\u003eRead \u003ca href=\"https://digital.gov/2023/11/28/part-1-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team/\"\u003epart 1\u003c/a\u003e and \u003ca href=\"https://digital.gov/2023/11/29/part-3-delivering-on-21st-century-idea-a-case-study-from-the-gsa-smartpay-team/\"\u003epart 3\u003c/a\u003e for more information about the GSA SmartPay project.\u003c/em\u003e\u003c/p\u003e\n"}
  ]
}
