Data sets released by Google

aidanf · on Sept 27, 2013

If you want to play around with data, here's another good list of open/free datasets: http://bitly.com/bundles/hmason/1

supo · on Sept 27, 2013

Nice, thanks! I wish there was a cleaned up repository of datasets like these, in a unified format, directly accessible to a public MapReduce engine like Elastic at AWS.

gtani · on Sept 27, 2013

here's some other data hubs/search engines, endless lists:

http://datahub.io/

http://blog.bigml.com/2013/02/28/data-data-data-thousands-of...

http://tm.durusau.net/?p=39312

http://dvn.iq.harvard.edu/dvn/

_____________

this subreddit seems like a decent place to ask questions

http://www.reddit.com/r/datasets

imurray · on Sept 27, 2013

Another one from Google, 1000 scanned books for OCR and other scanned document processing research: http://commondatastorage.googleapis.com/books/icdar2007/READ...

thangalin · on Sept 27, 2013

http://bitly.com/bundles/hmason/1

http://commondatastorage.googleapis.com/books/icdar2007/READ...

http://datahub.io/

http://blog.bigml.com/2013/02/28/data-data-data-thousands-of...

http://iatiregistry.org/

http://open.undp.org/

http://data.worldbank.org/

https://explore.data.gov/catalog/raw/

http://www.data.gov/opendatasites

http://data.gov.be/datasets

http://opencorporates.com/

http://glasspockets.org/work/reportingcommitment/api.html

http://thedata.harvard.edu/dvn/

http://www.reddit.com/r/datasets

http://archive.ics.uci.edu/ml/

http://cleandatahub.org/

http://datacatalogs.org/

http://archive.org/details/oxford-2005-facebook-matrix

X4 · on Sept 27, 2013

BitTorrent Please! Why does it cost so much? They grabbed our data for free and they have enough free Bandwidth. Let's assume they are greedy, then they could at least offer it through BitTorrent. DVD's for that amount of data is ridiculous. I don't even have a DVD-Reader…

Can't afford buying all that + shipping to Europe, but would like to play with the Data for my NLP Project.

skun · on Sept 28, 2013

I agree ! I too can't afford it but would really love to play around with that data because i'm just beginning to learn about NLP and stuff. I too feel that shouldn't have been priced and not in a DVD!

agibsonccc · on Sept 27, 2013

Here's another good one.

http://archive.ics.uci.edu/ml/

avidas · on Sept 27, 2013

Here is a good one, http://cleandatahub.org/ They are trying to aggregate cleaned data sets across the web.

PaulHoule · on Sept 27, 2013

no links...

Remember the days when people used to make links on the web because they weren't greedy with their pagerank?

At least Google left us some machine learning data sets after they took all the links. You just can't find them because nobody links to them.

supo · on Sept 27, 2013

I'm sorry for not making it more obvious, but each bullet point in the list ends with a link.

ChikkaChiChi · on Sept 27, 2013

Fantastic links throughout this thread.

When playing with new programming languages instead of a 'todo' list I always end up building an XKCD password generator. Interestingly enough, I've never found a frequency/comprehension list worth using to populate it for public consumption.

option_greek · on Sept 27, 2013

Is there any data set that embodies human relationships with every day objects ?

ma2rten · on Sept 27, 2013

Also:

https://code.google.com/p/word2vec/#Pre-trained_entity_vecto...

kineticfocus · on Sept 28, 2013

The ML competition site Kaggle should also get a mention here. http://www.kaggle.com/competitions

chatman · on Sept 27, 2013

Where is the Web1T dataset? Would you not consider it useful for Machine Learning?

cardine · on Oct 1, 2013

I think this list only includes free datasets.