#general
- b
bored-art-40741
09/21/2015, 11:21 PMDidn't specify the level though - b
bored-art-40741
09/21/2015, 11:21 PMCopy code-rw------- 1 pl foursquare 1.1M Sep 21 18:04 264b84ee29b4cae159ccc47af8d4be9fdc94e93c-TaskIdentityFingerprintStrategy.a5c9726c9cf2_7c5a1b1af73b.tgz drwxr-xr-x 3 pl foursquare 4.0K Sep 21 18:05 compile -rw-r--r-- 1 pl foursquare 616K Sep 21 23:21 retarred2.tgz - h
happy-kitchen-89482
09/21/2015, 11:24 PMyou can tar cvf | gzip -5 - h
happy-kitchen-89482
09/21/2015, 11:24 PMto control the level - h
happy-kitchen-89482
09/21/2015, 11:25 PMbut anyway, you're seeing the same thing I am - however we're compressing these artifacts is screwing up. - h
happy-kitchen-89482
09/21/2015, 11:25 PMand that seems to have nothing to do with the extra jar - h
happy-kitchen-89482
09/21/2015, 11:25 PMunless it's somehow tickling some bad corner case of gzip - h
happy-kitchen-89482
09/21/2015, 11:28 PMwill try and re-tar using that code - h
happy-kitchen-89482
09/21/2015, 11:30 PMNope, that works fine. - h
happy-kitchen-89482
09/21/2015, 11:30 PMSo weird! - b
bored-art-40741
09/21/2015, 11:31 PMCI boxes are weird somehow? - h
happy-kitchen-89482
09/21/2015, 11:31 PMhmm - b
bored-art-40741
09/21/2015, 11:32 PMBut that wouldn't make a lot of sense - h
happy-kitchen-89482
09/21/2015, 11:32 PMgzip is gzip - h
happy-kitchen-89482
09/21/2015, 11:32 PMit's supposed to be deterministic - b
bored-art-40741
09/21/2015, 11:35 PMIs it deterministic? Like what about the order you stream the files in? - h
happy-kitchen-89482
09/21/2015, 11:38 PMProbably not deterministic to that - h
happy-kitchen-89482
09/21/2015, 11:38 PMbut I just added the files in the same order as the code does - h
happy-kitchen-89482
09/21/2015, 11:38 PMIt just adds the entire dir, in whatever its filesystem iteration order is. alphabetical presumably. - h
happy-kitchen-89482
09/21/2015, 11:38 PMWe don't iterate the files ourselves. - h
happy-kitchen-89482
09/21/2015, 11:39 PMSo why the hell is it creating these unnecessarily large tarfiles? - h
happy-kitchen-89482
09/21/2015, 11:40 PMlet me see if I can repro that part locally - h
happy-kitchen-89482
09/21/2015, 11:40 PMturn off cache reads and let it create its own artifacts - b
bored-art-40741
09/21/2015, 11:41 PMgood idea - h
happy-kitchen-89482
09/21/2015, 11:50 PMYep, I can repro this on a laptop. - h
happy-kitchen-89482
09/21/2015, 11:50 PMCopy code-rw------- 1 benjy staff 119875 Sep 18 23:35 151d28d0f0004f5c89b26a1ea925cab095b7c266-TaskIdentityFingerprintStrategy.b2daef34761e_da459a0b62f1.tgz -rw------- 1 benjy staff 120334 Sep 11 22:22 3f2e27a9f4a8e9b5d227e0ca84f8cdac95538d2e-TaskIdentityFingerprintStrategy.a362cb8d1271_90decaaf250b.tgz -rw------- 1 benjy staff 617208 Sep 21 23:48 4abe72734e18baa53709edcde1a143129c6e9524-TaskIdentityFingerprintStrategy.2fab9f8ec522_7c5a1b1af73b.tgz -rw------- 1 benjy staff 120108 Sep 10 01:46 6847761ae8fe43b54ab9e16d1e74ae105bd62c86-TaskIdentityFingerprintStrategy.d59fb033aa90_5621c1c205c9.tgz -rw------- 1 benjy staff 119947 Sep 16 19:03 76c77eb633c2f12c5d0a1756ed09639d3989d732-TaskIdentityFingerprintStrategy.892f9a3bda5a_1d25c3e353fa.tgz -rw------- 1 benjy staff 620348 Sep 21 18:35 d508d0f50cdcd8503d7e0074dee5ebbccc26101a-TaskIdentityFingerprintStrategy.2fab9f8ec522_7c5a1b1af73b.tgz - h
happy-kitchen-89482
09/21/2015, 11:51 PMNotice the dates vs. sizes correlation - h
happy-kitchen-89482
09/21/2015, 11:51 PMSame exact target - e
enough-analyst-54434
09/21/2015, 11:52 PMdoes gunzip --list reveal different compression levels? - e
enough-analyst-54434
09/21/2015, 11:52 PMie - is this just a level setting that changed?