{
    "version" : "https://jsonfeed.org/version/1",
    "content" : "news",
    "type" : "single",
    "title" : "Agency Dataset Publication in Data.gov |Digital.gov",
    "description": "Agency Dataset Publication in Data.gov",
    "home_page_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/","feed_url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2014/06/20/agency-dataset-publication-in-data-gov/index.json","item" : [
    {"title" :"Agency Dataset Publication in Data.gov","summary" : "Not sure how to get your datasets into Data.gov? We’ve put together an overview to show you how the process works. Agencies prepare their enterprise data inventories in data.json format and post them on their websites (agency.gov/data.json), pursuant to the Open Data Policy and following the guidance and using the tools available on Project Open","date" : "2014-06-20T10:00:51-04:00","date_modified" : "2025-01-27T19:42:55-05:00","authors" : {"hyon-kim" : "Hyon Kim"},"topics" : {
        
            "application-programming-interface" : "Application programming interface",
            "open-data" : "Open data",
            "search-engine-optimization" : "Search engine optimization"
            },"branch" : "bc-archive-content-3",
      "filename" :"2014-06-20-agency-dataset-publication-in-data-gov.md",
      
      "filepath" :"news/2014/06/2014-06-20-agency-dataset-publication-in-data-gov.md",
      "filepathURL" :"https://github.com/GSA/digitalgov.gov/blob/bc-archive-content-3/content/news/2014/06/2014-06-20-agency-dataset-publication-in-data-gov.md",
      "editpathURL" :"https://github.com/GSA/digitalgov.gov/edit/bc-archive-content-3/content/news/2014/06/2014-06-20-agency-dataset-publication-in-data-gov.md","slug" : "agency-dataset-publication-in-data-gov","url" : "/preview/gsa/digitalgov.gov/bc-archive-content-3/2014/06/20/agency-dataset-publication-in-data-gov/","content" :"\u003cp\u003eNot sure how to get your datasets into \u003ca href=\"http://www.data.gov/\"\u003eData.gov\u003c/a\u003e? We’ve put together an overview to show you how the process works.\u003c/p\u003e\n\u003cp\u003eAgencies prepare their enterprise data inventories in data.json format and post them on their websites (agency.gov/data.json), pursuant to the \u003ca href=\"http://www.whitehouse.gov/sites/default/files/omb/memoranda/2013/m-13-13.pdf\"\u003eOpen Data Policy\u003c/a\u003e and following the guidance and using the tools available on \u003ca href=\"http://project-open-data.github.io/\"\u003eProject Open Data\u003c/a\u003e. Data.gov also offers a tool called inventory.data.gov that can be used to assist agencies in creating their data inventories.\u003c/p\u003e\n\u003cp\u003e\u003ca href=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/06/1080-x-872-DataGov-Agency-JSON-consumption-chart.jpg\"\u003e\u003cdiv class=\"image\"\u003e\n  \u003cimg\n    src=\"https://s3.amazonaws.com/digitalgov/_legacy-img/2014/06/600-x-484-DataGov-Agency-JSON-consumption-chart.jpg\"\n    alt=\"600-x-484-DataGov-Agency-JSON-consumption-chart\"/\u003e\u003c/div\u003e\n\n\u003c/a\u003e\u003c/p\u003e\n\u003ch2 id=\"harvesting-datasets\"\u003eHarvesting Datasets\u003c/h2\u003e\n\u003cp\u003eThe Data.gov team at GSA works with agencies to validate their data.json and identifies any errors that the agency needs to fix. Once the agency data.json is revised and revalidated, the agency posts the corrected file and directs the Data.gov team to begin “harvesting” their data.json into the Data.gov catalog.\u003c/p\u003e\n\u003cp\u003eThe Data.gov team sets up the harvest of the agency data.json and sets the frequency (normally on a daily basis). Metadata records (datasets) that are invalid against the Project Open Data \u003ca href=\"http://project-open-data.github.io/schema/\"\u003eschema\u003c/a\u003e are rejected, but all valid datasets will be published in the Data.gov \u003ca href=\"http://catalog.data.gov/dataset\"\u003ecatalog\u003c/a\u003e. The valid datasets that are published replace the existing dataset records for that agency. The Data.gov team and the agency continue to collaborate to fix errors.\u003c/p\u003e\n\u003cp\u003eThe harvesting process continues on a daily basis and the agency’s catalog listings on Data.gov are continually updated.\u003c/p\u003e\n\u003ch2 id=\"datagov-topics\"\u003eData.gov Topics\u003c/h2\u003e\n\u003cp\u003eData.gov currently has 21 Topics on issues such as \u003ca href=\"https://www.data.gov/food/\"\u003eAgriculture\u003c/a\u003e, \u003ca href=\"https://www.data.gov/climate/\"\u003eClimate\u003c/a\u003e, \u003ca href=\"https://www.data.gov/education/\"\u003eEducation\u003c/a\u003e and \u003ca href=\"https://www.data.gov/safety/\"\u003ePublic Safety\u003c/a\u003e. The Topics have their own curated collections of datasets. Currently, the addition of datasets to Topics collections is not automated. The community leaders of the Topics areas indicate datasets to be tagged for the Topic and the Data.gov team updates the datasets with the relevant tags to include them in the desired Topic. There is work ongoing to streamline this process.\u003c/p\u003e\n\u003ch2 id=\"accessing-datasets\"\u003eAccessing Datasets\u003c/h2\u003e\n\u003cp\u003eFor end users, once agency datasets are published in the Data.gov \u003ca href=\"http://catalog.data.gov/dataset\"\u003ecatalog\u003c/a\u003e, they can access the catalog through the user interface (based on the open source platform for data catalogs called \u003ca href=\"http://ckan.org/\"\u003eCKAN\u003c/a\u003e). The Data.gov catalog is also available through the Data.gov CKAN \u003ca href=\"http://catalog.data.gov/api/3/\"\u003eAPI\u003c/a\u003e.\u003c/p\u003e\n\u003cp\u003e\u003cem\u003e\u003cstrong\u003eHyon Kim\u003c/strong\u003e is the Deputy Program Director for Data.gov at the U.S. General Services Administration (GSA).\u003c/em\u003e\u003c/p\u003e\n"}
  ]
}