I have a simple python script which trains an agent with (stochastic) Policy Gradients on Pong. It is not specifically made to be parallelized (multiprocessing library is not imported) but it uses numpy
and gym
, which actually permit multicore processing.
When I run it on my laptop (Intel i7-4600M @ 2.90GHz with an integrated GPU) it does use the 100% of all the four processors. However, the same script executed on a more powerful desktop PC (Intel i7-4790 CPU @ 3.60GHz with a GPU that supports CUDA) with 8 cores and a dedicated GPU runs slower, using just one CPU.
Both PCs have the same version of Python (2.7.6). Anyone has an idea of why this happens?