USAID’s “Frequently Asked Questions” and the Management of Open Data Programs
I wrote about The U.S. Agency for International Development’s open data program last December in “USAID’s Evolving Open Data Culture” (/usaid.html). USAID recently published a FAQ document that describes the workings of its open data program regarding data generated by funded programs; see the USAID’s “Frequently Asked Questions” (http://www.usaid.gov/data/frequently-asked-questions ). Among the topics covered by the FAQ are:
- The kinds of data that must be submitted
- Requirements for machine readable datasets in documented nonproprietary formats
- Partner relationships
- Which development contracts are affected
- Treatment of sensitive data
- The role of “data stewards”
- Description of the data submission process
- Conditions under which submitted data might not be released
- How data will be made available
Not a lot of detail is provided but several links are included to additional and more detailed information including formal statements of contract requirements.
One of the most interesting related documents is “ADS Chapter 579 USAID Development Data” (http://www.usaid.gov/sites/default/files/documents/1868/579.pdf) which provides more detail about several of the USAID open data program’s most interesting components including:
- “Dataset access Levels” are described as Public, Restricted Public, and Non-Public (518.104.22.168 )
- Roles and responsibilities in the Data Publication Process (522.214.171.124 )
- A fairly straightforward definition of “machine readable” (5126.96.36.199 b)
- A description of applicable “embargoes” if the Dataset “… is the subject of a pending publication or pending patent application.” (5188.8.131.52)
This being a government document there are many references to rules and regulations having to do with legalities and acquisition regulations.
What I found most useful from a program management perspective were descriptions of roles and responsibilities as submitted datasets make their way through the overall journey from submission to being made public. These make you realize that an open data program has to interact with a variety of different operating entities both internal and external to the sponsoring agency.
How this overall process is managed throughout the entire “open data program management lifecycle” will determine how effective the program is, how much it costs to operate, and how long it takes.
Something I am currently researching is how to best govern an open data program where a complex mix of technical, business, and legal resources, drawn from a variety of organizations, need to be coordinated.
By itself, just documenting a process is never enough. Also needed is a sufficiently-resourced governance structure that supports program management in how systems and processes are changed and in how they operate.
- The Continuing Evolution of Data.gov
- Justifying Collaboration in Complex Programs such as Federal Acquisitions
- Observations and Questions about Open Data Program Governance
- OMB Releases Federal Data Inventories – So What?
- Open Data Management at the U.S. Environmental Protection Agency (EPA)
- Planning for Big Data: Lessons Learned from Large Energy Utility Projects
- A Project Manager’s Perspective on the GAO’s Federal Data Transparency Report
- Recommendations for Collaborative Management of Government Data Standardization Projects
- Recouping “Big Data” Investment in One Year Mandates Serious Project Management
- USAID’s Evolving Open Data Culture
- Who Will Pay for Open Data?
- Will NOAA’s “Big Data Partnership” be a Model for Other Government Agencies?
Copyright © 2015 by Dennis D. McDonald