Huge resource of public data, including the 1000 Genome Project, an attempt to build the most comprehensive database of human genetic information and NASA’s database of satellite imagery of Earth.

An updated list of topic-centric public data sources collected from blogs, answers, and user responses. Most of the datasets listed are free.

Offers a number of cancer-related datasets.

Here you can find data on law enforcement agencies, jails, parole and probation agencies and courts.

A social data sharing service that allows you to upload your own data and connect with others who are uploading their data.

A pilot project with many government and geospatial datasets.

Access the survey data and documentation for any BRFSS survey year. The documentation provides technical and statistical information regarding the BRFSS, such as comparability, sample information, and more.

More than one petabyte of data from particle physics experiments carried out by CERN.

Over one billion public comments posted to Reddit between 2007 and 2015, for training language algorithms

The Consumer Expenditure Survey (CES) series provides information on the buying habits of American consumers and data to support periodic revisions of the Consumer Price Index.

Explore vast amounts of raw and interactive data. For example, download a data set that combines Medicare and Medicaid information meaningful use within the EHR Incentive Programs.

Data from the UK Government, including the British National Bibliography – metadata on all UK books and publications since 1950.

Data in the Data Commons Graph comes from a variety of sources, each of which often includes multiple surveys.The sources have been grouped by category and are listed alphabetically within each category.

DataPortals.org is the most comprehensive list of open data portals in the world.

Wikipedia is comprised of millions of pieces of data, structured and unstructured on every subject under the sun. DBPedia is an ambitious project to catalogue and create a public, freely distributable database allowing anyone to analyze this data.

Publicly available testing data for advanced technology vehicles

Dryad is especially good for STEM topics.

Data by Terapeak on millions of online sales and auctions from eBay

Based on data from European Union institutions.

Although much of the information on users’ Facebook profile is private, a lot isn’t. Facebook provide the Graph API as a way of querying the huge amount of information that its users are happy to share with the world (or can’t hide because they haven’t worked out how the privacy settings work).

The FBI is responsible for compiling and publishing national crime statistics, with free data available at national, state and county level.

Up to date information on financial markets from around the world, including stock price indexes, commodities and foreign exchange.

A large number of polls providing data on public opinion of political and sporting issues.

A community-compiled database of structured data about people, places and things, with over 45 million entries.

Compilation of data from sources including the World Health Organization and World Bank covering economic, medical and social statistics from around the world.

General Social Survey (GSS) is a long running survey of social, cultural and political indicators. In addition to the GSS, topic modules include computer and Internet, racial and ethnic prejudice, and child mental-health stigma. The GSS has participated since 1985 in the International Social Survey Program.

Information about job vacancies, candidates, salaries and employee satisfaction is available through their developer API.

Part of World Health Organization (WHO)

Search and analyze the full text of any of the millions of books digitised as part of the Google Books project.

40 years’ worth of stock market data, updated in real time.

Includes data from world development indicators, OECD, and human development indicators, mostly related to economics data and the world.

See what is trending on Google in the US and around the world.

125 years of US healthcare data including claim-level Medicare data, epidemiology and population statistics.

"The world’s largest archive of downloadable and reusable digitized social and behavioral health research data, relating to education, aging, criminal justice, substance abuse, terrorism, and more" - University of Michigan

Datasets in a number of formats drawn from the web’s largest resource on movies, television and people working in those industries.

The International Monetary Fund publishes data on international finances, debt rates, foreign exchange reserves, commodity prices and investments.

As with Twitter, Instagram posts and conversations are public by default. Their APIs allow likes, mentions and business details to be analyzed.

Public use microdata from the U.S. census and American Community Survey; the U.S. Current Population Survey; and international censuses. Data can be downloaded or analyzed online.

Collates data from the body which oversees the network of EV charge points across the Republic of Ireland and Northern Ireland.

13,000 collated and labeled images of human faces, for use in developing applications involving facial recognition.

Pollution and air quality data from across London

How to download: Select a data source, which will bring you to the datasets from that source. To download, select desired format underneath the description of the dataset. To download HTML, a new page will open, scroll down to "Download Data", then select file format. To download CSV, click on the CSV button to download an Excel file. To download XML, a new page will open, select "Bulk Data Download (CSV)" under "Data Access" on left hand side. To download JSON, a new page will open, copy and paste text into Notepad.

Microsoft’s open machine learning datasets for training systems in reading comprehension and question answering.

Metadata on over a million songs and pieces of music. Part of Amazon Web Services.

Public datasets covering planets and stars gathered by NASA’s space exploration missions.

A huge collection of environmental, meteorological and climate data sets from the US National Climatic Data Center. The world’s largest archive of weather data.

A sample of eighth-graders surveyed in 1988 on a range of topics. A sample were resurveyed through four follow-ups in 1990, 1992, 1994, and 2000. The study has four types of data files - student, teacher, parent, and school - although note each type is available for each survey year.

Information on nearly 4 million historical specimens in the London museum’s collection, as well as scientific sound recordings of the natural world.

Searchable, indexed archive of news articles going back to 1851.

Health data sets from the UK National Health Service.

Dataset hosted at archive.org covering music released around the world, for use in image processing research

Covers a wide variety of topics. For best results, choose "Work Type" in the "Filters" section and then choose "dataset."

The world’s largest open database of companies.

Datasets on books including catalogs from libraries around the world

The Panel Study of Income Dynamics (PSID) series was begun in 1968 to fill the need for a better understanding of the determinants of family income and its changes. Longitudinal survey of US individuals and the families in which they reside.

Conducts public opinion polling, demographic research, media content analysis and other empirical social science research.

Easy-to-use online mapping with data on demographics, real estate, health, jobs, and more in communities across the US.

Offers a free package with access to datasets covering world population, currencies, development indicators and weather data.

ResearchDataGov.org is a product of the federal statistical agencies and units, created in response to the Foundations of Evidence-based Policymaking Act of 2018. The site is the single portal for discovery of restricted data in the federal statistical system.

Another interesting place to explore government-related data, with some visualisation tools built-in.

Conducted every three years, this survey collects information on the assets, liabilities and other financial characteristics of households. It is the only U.S. survey that contains an over sample of wealthy households. Sample Size is about 4,500 families.

A longitudinal U. S. government survey of the financial status of American households conducted since 1984. Covers government transfer and service programs, pension coverage, housing affordability, financial assistance for education, among other topics.

The advantage Twitter has over the others are that most conversations are public. This means that huge amounts of data is available through their API on who is talking about what, where, when and why.

The Census Bureau's mission is to serve as the leading source of quality data about the nation's people and economy.

A dataset specifically pre-processed for machine learning.

Makes some of the data from its courses public.

The UK’s largest collection of social, economic and population data.

Statistics compiled and published by the United Nations on international trade. Includes Comtrade Lab which is a showcase of how cutting edge analytics and tools are used to extract value from the data.

Offers statistics on the situation of women and children worldwide.

Data on educational institutions and education demographics from the US and around the world.

Datasets covering population demographics and a huge number of economic and development indicators from across the world.

The series is designed to enable a crossnational comparison of values and norms on a wide variety of topics and to monitor changes in values and attitudes across the globe. A variety of questions on religion and morality were included. Data is currently available at ICPSR for 1981-1984, 1990-1993, 1995-1997, and 1999-2004.

--Hongkiat (April 1, 2019)