Cosplay Photo Library V3
Related links
Cosplaybot: A bot that will post a random image from the library every hour as well as the latest news (check the pinned messages)
Cosplay general board: most discussions happen there
Overview
the cosplay photo library is an archive of cosplay images and it's primary way of dissemination is through torrent, its main purpose is to preserve them on as high quality as possible since sets tend to dissappear after a few years
Differences with V2
Most of the processes and scripts i use kept improving during the development of V2 so the newer parts were a lot more polished than the older ones, in addition to that a lot of sets had two or even three versions in different image quality, V3 should be a lot more consistant with its polish and at this point i think i have the best quality images i'll be able to get so hopefully there won't be as many duplicate sets
General structure
- The gallery is divided in 500GB parts and contains images from cosplayers that have at least 10 sets
- Every image path follows the following naming convention: ./{cosplayer}/{cosplayer} - {character}/{cosplayer}{character}{number}.{extension}
- Each part contains torrent files for previously released parts on the "./0.info and torrents to other parts" directory
Part structure
The first 10 parts or so will be organized alphabetically (i.e. the first part contains cosplayers that start with A or B, the second one cosplayers that start with C - G, etc), future updates will be pushed as soon as there are 500gb on new sets, regardless of the initials of the cosplayers
Rough description of the current pipeline
1 - Torrents containing names of known cosplayers are scraped from the DHT network
2 - Compressed files are extracted and any non-image file gets deleted
3 - Sets are organized automatically via scripts by using text matching
4 - Duplicate images are deleted
5 - The remaining sets get manually checked to make sure they are correctly organized
6 - The sets/images get automatically formatted via scripts
Downloads
Important
The magnet links and hashes are mostly for validation purposes, due to the amount of metadata i'd recommend using the torrent files (the catbox option)
Part 1
info hash:
d8f6eb3564fc139aea0ecd563b9ca178e5244d27
magnet link
torrent file (catbox)
sukebei (thanks to the anon who posted it there)
Part 2
info hash:
d8a0b4508bbd499ee6cf605f06ffdb0cafba4a9f
magnet link
torrent file (catbox)
sukebei (thanks to the anon who posted it there)
Part 3
info hash:
8fd3b80ddf0ee11f7f295f111af771f46ad6b69a
magnet link
torrent file (catbox)
sukebei (thanks to the anon who posted it there)
Part 4
info hash:
4fdc324b4c857c2662b16a5d938199698f0154d7
magnet link
torrent file (catbox)
:wq
List of sets (As of last update)
FAQ and points of clarification
There are a few things that did or will probably come up based on my experience with V2
- Is there a Discord/matrix/IRC...?
Maybe at some point but not at the moment, i don't really have the time to host and manage something like that so i'd have to talk to some site owners to find a suitable place (something like Discord is out of the question) - Why not compressing the galleries?, that way you can do larger parts
There are several reasons for this:
- it's easier to work on it since i only need the main copy and a backup, if i was to zip the galleries i would need a third copy exclusively to seed
- it's more likely for people to seed; if the galleries were compressed people would just decompress them and delete the originals, this way there is a chance they will just leave it alone since it's very easy to browse as is
- there is some people that do megapacks and zip galleries with passwords so people could assume this is one of those and avoid downloading it (and more importantly seeding it) - Can you get X set/character?
Maybe?, bear in mind the library is not a zero-day kind of thing, i'm just scraping the stuff that is already floating around the internet and compiling it, feel fre to ask though, maybe my setup didn't zero in that particular cosplayer and soma manual intervention fixes it - Are there plans to include videos?
No, as it is managing the library takes over 20TB of space due to backups, ongoing scraping... etc and working with videos is harder from an automation standpoint so it's not really viable given my skills, time and setup - Can i migrate files from V2 to V3?
To a certain extent yes but the overlap is probably only about 20%-30% so it might not be worth trying
-----BEGIN PGP PUBLIC KEY BLOCK-----
mDMEaGk3fxYJKwYBBAHaRw8BAQdAgQOAuRMD25TmLnXe+rNB9/Y/fEbiRTJRk9/Z
r8KGH3+0C2VsZHIgPGVsZHI+iJAEExYKADgWIQRrJg7uQBfRT7sheXLYLTEv34V2
4AUCaGk3fwIbAwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRDYLTEv34V24Nlr
AP9VMYzUv0b60KaIeqxpq7Nnfzn2HXcfOpTGq3ii02K+1QD/Z9YUFckZUcJY36TA
3C7eeOWcLMvMJSCqkPQVHN0bhAy4OARoaTd/EgorBgEEAZdVAQUBAQdAMjoUQlOH
YZhdLgg2GfFGBtlnCs07mXkwb6j7JMDurzkDAQgHiHgEGBYKACAWIQRrJg7uQBfR
T7sheXLYLTEv34V24AUCaGk3fwIbDAAKCRDYLTEv34V24O9iAP9K2URobUHbu7i/
QM+tHuZck8cLkrHn+Aytm8STxfi8JwD8CZl8BuC31WmjvRhCqjeLmmp6J/4Rf/eT
LF9e00T3yw0=
=CTnW
-----END PGP PUBLIC KEY BLOCK-----