Reddit place data 2022 by /u/Lornedon
All files can be downloaded from https://u298794-sub1.your-storagebox.de/ with username u298794-sub1
and password aWddBJ8Baq1YbW8g
. You can also use other methods like sftp
or rsync
as described here. Have fun and tell me about cool results!
Edit: The data from Reddit seems to be incomplete. There are many pixels that should still have a color after the whiteout according to the official dataset, for example (41, 1341). See this comment.
All this data comes from the official Reddit post.
place_reduced.csv
(4.8G, 1.7G compressed)- Warning: In the first reddit datadump there was a mistake, the mod rectangles were in the wrong place. I fixed that only in the SQLite databases, not in the csv files.
- The time is in milliseconds since the first placed pixel, which was placed at 2022-04-01 12:44:10.315 UTC (1648817050315 milliseconds after the unix epoch).
- The user hashes and colors were replaced by numbers, they can be found in
colors_numbered.csv
(388B) andusers_numbered.csv
(1G, 0.7G compressed) - The pixel coordinates were separated into x and y. There are also tx and ty, which can be the lower right edge of a rectangle placed by the moderators.
place_reduced.db
(5.1G, 3G compressed)- The same as
place_reduced.csv
, but as SQLite database. The users and colors are in there too. - The pixels table has a virtual column called
utc_time
where the datetime is restored from the millisecond timestamp. Do not use this to filter queries, it's super slow!
- The same as
place_indexed.db
(17G, 6.8G compressed)- This is the most fun to work with
- The same as
place_reduced.db
, but there are many indexes that make the database very fast to work with. - Additional tables in this database:
final_canvas
: All pixels that survived until before the whiteout. (I didn't take the moderator rectangles into account here, so it may not be completely accurate)stayed_white
: The pixels where nobody ever placed anything.