#announce
- a
aloof-angle-91616
03/19/2018, 9:59 PMyeah, i feel that too. - w
witty-crayon-22786
03/19/2018, 9:59 PMif our s3 bucket were to go away entirely, what would recovery look like...? how much would even be recoverable? - w
witty-crayon-22786
03/19/2018, 10:00 PMi'm not sure if that means... two buckets? one bucket with glacier backups...? - w
witty-crayon-22786
03/19/2018, 10:03 PMfrom googling a bit, it sounds like S3 versioning might be some protection there. but the catastrophic case is still bad. - a
aloof-angle-91616
03/19/2018, 10:03 PMi'm not very familiar yet with aws or tools like it so i'll get more familiar with the options. i was thinking of glacier backups as well -- not sure how the cost of that would end up with the size of our binaries currently. - a
aloof-angle-91616
03/19/2018, 10:03 PMyeah. - w
witty-crayon-22786
03/19/2018, 10:03 PM@happy-kitchen-89482: what are your thoughts on S3 versioning being sufficient here? - w
witty-crayon-22786
03/19/2018, 10:04 PM - a
aloof-angle-91616
03/19/2018, 10:08 PMin the year 2100 we can just make them pants products and store them in a CAS buildcache - w
witty-crayon-22786
03/19/2018, 10:11 PMwe could also defer the deleting of things from git and attempt to go the git-lfs route: https://help.github.com/articles/about-storage-and-bandwidth-usage/ - w
witty-crayon-22786
03/19/2018, 10:12 PMnot really sure how we're not already paying github something. - a
aloof-angle-91616
03/19/2018, 10:15 PM$5/mo for 50GB of storage and 50GB of bandwidth which i can't see us exceeding unless bots try to clone the binaries repo a hundred times - w
witty-crayon-22786
03/19/2018, 10:26 PM@aloof-angle-91616: so, the new binaries are blocking your PR, yea? - h
happy-kitchen-89482
03/19/2018, 10:29 PMWe’re more likely to lose the github repo (if, say, github decide, not unreasonably, that hosting large binaries is against their TOS) than the S3 bucket - h
happy-kitchen-89482
03/19/2018, 10:30 PMWe can always back it up to glacier, and mirror it. - a
aloof-angle-91616
03/19/2018, 10:30 PMnot yet, but when i push the commits i have right now up they will be. i can without too much difficulty put something in to check whether the system has a compiler installed and use that if that's an issue. - h
happy-kitchen-89482
03/19/2018, 10:30 PMWe want to move away from hosting the world’s binaries anyway, no? - w
witty-crayon-22786
03/19/2018, 10:35 PMglacier could be a good answer... i just didn't see anything particularly convincing as to how to turn that on - h
happy-kitchen-89482
03/19/2018, 10:38 PMWe should be encouraging orgs to mirror it anyway, no? - w
witty-crayon-22786
03/19/2018, 10:39 PMyes. but we would ourselves be screwed if it disappeared - w
witty-crayon-22786
03/19/2018, 10:39 PMso i think the "reducing bandwidth by asking other orgs to mirror it" is relevant, but not a solution to having backups - w
witty-crayon-22786
03/19/2018, 10:40 PMi wonder if a not-crazy option would be to snapshot the s3 bucket periodically - w
witty-crayon-22786
03/19/2018, 10:41 PMinto... Dropbox, or something =P - r
rough-minister-58256
03/19/2018, 10:44 PMbittorrent? - w
witty-crayon-22786
03/19/2018, 10:45 PMheh - h
happy-kitchen-89482
03/19/2018, 10:53 PMIf s3 could ever disappear, the world would have bigger problems than our binary hosting woes, but we can always back up to glacier, dropbox or whatever. - w
witty-crayon-22786
03/19/2018, 10:54 PMversioning + a snapshot every now and then seems like it would likely be sufficient. - w
witty-crayon-22786
03/19/2018, 10:55 PMglacier does not look easy to recover from or backup to, which is annoying. but versioning should be very low cost and protect against deletes. - l
limited-country-20626
03/19/2018, 11:13 PMI have a mirror - l
limited-country-20626
03/19/2018, 11:14 PMand extend that mirror considerably