{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Data.gov’s Data Pipeline Explained |Digital.gov",
    "description": "Data.gov’s Data Pipeline Explained",
    "home_page_url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/","feed_url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/2014/12/04/data-govs-data-pipeline-explained/index.json","item" : [
    {"title" :"Data.gov’s Data Pipeline Explained","summary" : "In case you missed it: the Data.gov team recently hosted DigitalGov University webinars designed to help agencies and open data advocates better understand how to get data on Data.gov and how to implement the Open Data Policy’s metadata schema updates. These webinars were designed assist government data publishers in making more data discoverable to the","date" : "2014-12-04T12:40:21-04:00","date_modified" : "2024-04-02T09:45:13-04:00","authors" : {"rebecca-williams" : "Rebecca Williams"},"topics" : {
        
            "open-data" : "Open Data",
            "search-engine-optimization" : "Search Engine Optimization"
            },"branch" : "cm-topics-button-component",
      "filename" :"2014-12-04-data-govs-data-pipeline-explained.md",
      
      "filepath" :"news/2014/12/2014-12-04-data-govs-data-pipeline-explained.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/cm-topics-button-component/content/news/2014/12/2014-12-04-data-govs-data-pipeline-explained.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/cm-topics-button-component/content/news/2014/12/2014-12-04-data-govs-data-pipeline-explained.md","slug" : "data-govs-data-pipeline-explained","url" : "/preview/gsa/digitalgov.gov/cm-topics-button-component/2014/12/04/data-govs-data-pipeline-explained/","content" :"\u003cp\u003eIn case you missed it: the Data.gov team recently hosted DigitalGov University webinars designed to help agencies and open data advocates better understand how to get data on Data.gov and how to implement the Open Data Policy’s metadata schema updates. These webinars were designed assist government data publishers in making more data discoverable to the American people. You can watch these webinars and check out additional supplemental resources below.\u003c/p\u003e\n\u003ch2 id=\"project-open-data-metadata-schema-v11-updates\"\u003eProject Open Data Metadata Schema v1.1 Updates\u003c/h2\u003e\n\u003cp\u003eExecutive Order 13642 and OMB Memorandum M-13-13 require all executive departments and agencies to list all agency data that can be made public in a publicly available open data catalog with consistent metadata. In the year plus since the release of the Open Data Policy, agencies and the public have suggested several updates to the metadata schema. Each issue was rigorously discussed in its own issue thread and at the \u003ca href=\"https://github.com/project-open-data/project-open-data.github.io/issues/325\"\u003eJuly government-wide offsite session\u003c/a\u003e dedicated to this update. The result is version 1.1 of the metadata schema required under the Open Data Policy. Federal agencies will be required to present their datasets using version 1.1 starting in February 2015.\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/12/833-x-841-Project-Open-Data-Metadata-Schema-v1.1-Updates.jpg\"\u003e\u003cdiv class=\"image\"\u003e\n  \u003cimg\n    src=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/12/600-x-600-Project-Open-Data-Metadata-Schema-v1.jpg\"\n    alt=\"600-x-600-Project-Open-Data-Metadata-Schema-v1\"/\u003e\u003c/div\u003e\n\n\u003c/a\u003e\u003c/p\u003e\n\u003cp\u003eData.gov’s October 15th \u003ca href=\"https://www.youtube.com/watch?v=tuxS1iDwc_c\"\u003e“Project Open Data Metadata Updates” webinar\u003c/a\u003e reviews metadata schema v1.0 as required under the Open Data Policy, provides a comprehensive step-by-step overview of the updates to the metadata schema, and provides a roundup of tools and resources to assist data stewards, IT personnel, and all agency staff in their v 1.1 metadata updates.\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eWatch the webinar \u003ca href=\"http://www.youtube.com/watch?v=-kpEywSZPw8\u0026amp;feature=youtu.be\u0026amp;list=PLd9b-GuOJ3nFA8rIjFKllLSAJl61IBYKM\"\u003evideo\u003c/a\u003e and \u003ca href=\"https://gsa.github.io/datagov-presentations/metadata-v1.1/\"\u003e“Project Open Data Metadata Updates v 1.1” presentation slides\u003c/a\u003e.\u003c/li\u003e\n\u003c/ul\u003e\n\u003cp\u003eAs of December 3, 2014, the Data.gov catalog supports both version 1.0 and 1.1 of the metadata schema, to provide agencies adequate transition time to version 1.1 by the February 2015 deadline.\u003c/p\u003e\n\u003ch2 id=\"data-harvesting-101\"\u003eData Harvesting 101\u003c/h2\u003e\n\u003cp\u003e\u003ca href=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/12/1277-x-657-Data-Harvesting-101-Department-wide-Enterprise-Data-Inventory-chart.jpg\"\u003e\u003cdiv class=\"image\"\u003e\n  \u003cimg\n    src=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/12/600-x-309-Data-Harvesting-101-Department-wide-Enterprise-Data-Inventory-chart.jpg\"\n    alt=\"600-x-309-Data-Harvesting-101\\---Department-wide-Enterprise-Data-Inventory-chart\"/\u003e\u003c/div\u003e\n\n\u003c/a\u003e\u003c/p\u003e\n\u003cp\u003eThe Data.gov team also conducted a recent webinar with more basic information about Data.gov and how agencies’ data is added to the Data.gov catalog. Data.gov is the United States’ central clearinghouse to search and discover over 130,000 open government datasets. Data.gov does not host data directly, but rather aggregates metadata about open data resources in one centralized location.\u003c/p\u003e\n\u003cp\u003eOnce an open data source meets the necessary format and metadata requirements, the Data.gov team can pull directly from it as a Harvest Source, synchronizing that source’s metadata on Data.gov as often as every 24 hours.\u003c/p\u003e\n\u003cp\u003eThe November 5th \u003ca href=\"\n\"\u003e“How to Get Your Agency’s Data onto Data.gov” webinar\u003c/a\u003e reviews step-by-step how federal, geospatial, and non-federal data is funneled on to Data.gov,  the data requirements for getting your government data on to Data.gov, and tools and resources to assist data stewards, IT personnel, and all agency staff.\u003c/p\u003e\n\u003cul\u003e\n\u003cli\u003eWatch the webinar \u003ca href=\"http://www.youtube.com/watch?v=hbxA5-GDvvU\"\u003evideo\u003c/a\u003e and \u003ca href=\"http://gsa.github.io/datagov-presentations/dataharvesting101/\"\u003e“Data Harvesting 101” presentation slides\u003c/a\u003e.\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch2 id=\"additional-resources\"\u003eAdditional Resources\u003c/h2\u003e\n\u003cul\u003e\n\u003cli\u003eProject Open Data Metadata Schema v1.1 Updates\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/metadata-changelog/\"\u003eChangelog for the version 1.1 schema\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/v1.1/schema/\"\u003eMetadata schema v1.1 guidance\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/v1.1/metadata-resources/#field-mappings\"\u003eField mapping from v1.0 to v1.1 schema\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/v1.1/metadata-resources/#schema-object-model-diagram\"\u003eUpdated Metadata schema v1.1 diagram\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/v1.1/metadata-resources/#sample-data-files\"\u003eSample data.json files with the version 1.1 schema\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\u003c/li\u003e\n\u003cli\u003eData Harvesting 101\n\u003cul\u003e\n\u003cli\u003e\u003ca href=\"https://project-open-data.cio.gov/catalog/\"\u003eProject Open Data Public Data Listing requirements\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://labs.data.gov/dashboard/\"\u003eProject Open Data Dashboard\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://labs.data.gov/dashboard/validate\"\u003eProject Open Data data.json Validator\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://labs.data.gov/dashboard/export\"\u003eProject Open Data Convertors\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"http://labs.data.gov/dashboard/changeset\"\u003eProject Open Data Changeset Preview\u003c/a\u003e\u003c/li\u003e\n\u003cli\u003e\u003ca href=\"https://inventory.data.gov/\"\u003eInventory.data.gov\u003c/a\u003e\u003c/li\u003e\n\u003c/ul\u003e\n\u003c/li\u003e\n\u003c/ul\u003e\n\u003ch2 id=\"stay-tuned\"\u003eStay Tuned\u003c/h2\u003e\n\u003cp\u003eRegister for Data.gov’s upcoming webinar on how to use the Inventory.data.gov tool to host your metadata: \u003ca href=\"\n\"\u003e“How to use Inventory.Data.Gov” on Tuesday, December 16th from 1pm – 2 pm\u003c/a\u003e and stay tuned for additional Data Harvesting documentation. As always you can reach the Data.gov team at \u003ca href=\"http://www.data.gov/contact\"\u003eData.gov/contact\u003c/a\u003e.\u003c/p\u003e\n"}
  ]
}