#general
- b
bored-art-40741
09/21/2015, 7:37 PMHowever
happens in the main threadpost_process_cached_vts - b
bored-art-40741
09/21/2015, 7:37 PMBut that's not where we're slow according to the profiling - b
bored-art-40741
09/21/2015, 7:37 PMWe're slow somewhere in the workers - b
bored-art-40741
09/21/2015, 7:41 PMI see no reason why this would differ between strategies - b
bored-art-40741
09/21/2015, 7:42 PMThough perhaps it's something that came with the upgrade and not the strategy switch - b
bored-art-40741
09/21/2015, 7:45 PMCopy codesubproc_map result still not ready................................................................................................................. subproc_map result still not ready................................................................................................................................................................................................................................................................................... subproc_map result still not ready.. - b
bored-art-40741
09/21/2015, 7:46 PMCopy coderes = SubprocPool.foreground().map_async(f, items) while not res.ready(): res.wait(60) # Repeatedly wait for up to a minute. if not res.ready(): self.log.debug('subproc_map result still not ready...') - b
bored-art-40741
09/21/2015, 7:49 PMI wonder if the worker is crashing or something and then dying without the poller noticing - b
bored-art-40741
09/21/2015, 7:51 PMehh probably not the issue - b
bored-art-40741
09/21/2015, 7:51 PMBut the worker is doing something slow, and for no good reason that I can tell - b
bored-art-40741
09/21/2015, 8:01 PM - b
bored-art-40741
09/21/2015, 8:02 PMMildly suspicious - b
bored-art-40741
09/21/2015, 8:02 PMMaybe the workers are wasting time pruning - w
witty-crayon-22786
09/21/2015, 8:04 PM@bored-art-40741: not on by default, iirc - b
bored-art-40741
09/21/2015, 8:04 PMYeah, and we don't set it - b
bored-art-40741
09/21/2015, 8:04 PMSo maybe not - w
witty-crayon-22786
09/21/2015, 8:05 PMwe do - w
witty-crayon-22786
09/21/2015, 8:05 PMbut haven't seen issues - b
bored-art-40741
09/21/2015, 8:05 PMKind of stretching at this point - b
bored-art-40741
09/21/2015, 8:05 PMI do not want to roll back this upgrade - b
bored-art-40741
09/21/2015, 8:05 PMBut I'm not going to burden devs with significant cache compile slowdowns - b
bored-art-40741
09/21/2015, 8:06 PMTrying to figure out how to dig into the subprocess perf - w
witty-crayon-22786
09/21/2015, 8:06 PMi want to help, but i need a repro, or something to fix - w
witty-crayon-22786
09/21/2015, 8:06 PMbecause we don't repro - b
bored-art-40741
09/21/2015, 8:06 PMhmmmm - b
bored-art-40741
09/21/2015, 8:06 PMThat itself is interesting - w
witty-crayon-22786
09/21/2015, 8:07 PMthose io numbers above were real. - w
witty-crayon-22786
09/21/2015, 8:07 PMCopy code12:09:10 01:58 [cache]....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... Using cached artifacts for 1431 targets. 12:11:41 04:29 [apt-finalize] - b
bored-art-40741
09/21/2015, 8:08 PMScala, right? - w
witty-crayon-22786
09/21/2015, 8:08 PMCopy code$ du -h -d 1 1.3G ./isolated-analysis 1.3G ./isolated-classes 444M ./isolated-logs 944M ./jars 3.9G .