Reddit place data 2022 by /u/Lornedon

All files can be downloaded from https://u298794-sub1.your-storagebox.de/ with username u298794-sub1 and password aWddBJ8Baq1YbW8g. You can also use other methods like sftp or rsync as described here. Have fun and tell me about cool results!


Edit: The data from Reddit seems to be incomplete. There are many pixels that should still have a color after the whiteout according to the official dataset, for example (41, 1341). See this comment.


All this data comes from the official Reddit post.

  • place_reduced.csv (4.8G, 1.7G compressed)
    • Warning: In the first reddit datadump there was a mistake, the mod rectangles were in the wrong place. I fixed that only in the SQLite databases, not in the csv files.
    • The time is in milliseconds since the first placed pixel, which was placed at 2022-04-01 12:44:10.315 UTC (1648817050315 milliseconds after the unix epoch).
    • The user hashes and colors were replaced by numbers, they can be found in colors_numbered.csv (388B) and users_numbered.csv (1G, 0.7G compressed)
    • The pixel coordinates were separated into x and y. There are also tx and ty, which can be the lower right edge of a rectangle placed by the moderators.
  • place_reduced.db (5.1G, 3G compressed)
    • The same as place_reduced.csv, but as SQLite database. The users and colors are in there too.
    • The pixels table has a virtual column called utc_time where the datetime is restored from the millisecond timestamp. Do not use this to filter queries, it's super slow!
  • place_indexed.db (17G, 6.8G compressed)
    • This is the most fun to work with
    • The same as place_reduced.db, but there are many indexes that make the database very fast to work with.
    • Additional tables in this database:
      • final_canvas: All pixels that survived until before the whiteout. (I didn't take the moderator rectangles into account here, so it may not be completely accurate)
      • stayed_white: The pixels where nobody ever placed anything.
Edit
Pub: 09 Apr 2022 11:00 UTC
Edit: 12 Apr 2022 09:23 UTC
Views: 328