Popen error: [Errno 2] No such file or directory

Question

I have some custom commands.

# works 
subprocess.Popen(['python'], stdout=subprocess.PIPE)

But if I have my own system commands like deactivate, I get that error

Traceback (most recent call last):
  File "runner2.py", line 21, in <module>
    main() 
  File "runner2.py", line 18, in main
    subprocess.Popen(['deactivate',], stdout=subprocess.PIPE)
  File "/usr/lib/python2.6/subprocess.py", line 633, in __init__
    errread, errwrite)
  File "/usr/lib/python2.6/subprocess.py", line 1139, in _execute_child
    raise child_exception
OSError: [Errno 2] No such file or directory

Let alone I need to execute this under my sandbox virtualenv.

Maybe `python` is not on the `PATH` environment variable when your script runs. Try setting the full path to python, i.e. `/usr/bin/python`. — El Barto, Mar 29 '12 at 23:44
Can you explain what you're trying to accomplish? I suspect that the child shell you're launching with `subprocess` hasn't "sourced" the virtualenv activation script, and it's not inherited from the parent Python process (assuming that's where you're running it from). — Brendan Wood, Mar 29 '12 at 23:45

score 115 · Answer 1 · edited Feb 08 '21 at 15:22

115

Try add an extra parameter shell=True to the Popen call.

edited Feb 08 '21 at 15:22

Neuron

3,776
3
24
44

answered Mar 30 '12 at 00:29

Anthony Kong

29,857
33
139
244

48

Worked for me, but why? – YMomb Mar 11 '15 at 17:44
8

@YMomb: `deactivate` is a shell function. To run it, you need a shell. Though it is pointless to try to run it in a new shell (the new shell probably won't have it defined until `venv/bin/activate` is called and the child normally can't modify its parent environment anyway if OP hopes to deactivate the current virtualenv set in the parent shell. It is the same reason why `subprocess.call('cd')` raises "No such file or directory" and it can be fixed using `shell=True` and it would be equally pointless.See [Why is cd not a program?](http://unix.stackexchange.com/q/38808/1321) – jfs May 20 '16 at 09:32

score 44 · Answer 2 · edited Jul 19 '17 at 09:28

44

Just a note. shell=True was likely the correct solution to the o.p., since they did not make the following mistake, but you can also get the "No such file or directory" error if you do not split up your executable from its arguments.

import subprocess as sp, shlex
sp.Popen(['echo 1']) # FAILS with "No such file or directory"
sp.Popen(['echo', '1']) # SUCCEEDS
sp.Popen(['echo 1'], shell=True) # SUCCEEDS, but extra overhead
sp.Popen(shlex.split('echo 1')) # SUCCEEDS, equivalent to #2

Without shell=True, Popen expects the executable to be the first element of args, which is why it fails, there is no "echo 1" executable. Adding shell=True invokes your system shell and passes the first element of args to the shell. i.e. for linux, Popen(['echo 1'], shell=True) is equivalent to Popen('/bin/sh', '-c', 'echo 1') which is more overhead than you may need. See Popen() documentation for cases when shell=True is actually useful.

edited Jul 19 '17 at 09:28

Chicken Suop

1,047
3
12
32

answered May 19 '16 at 20:22

Mark Woodward

768
7
9

This version of the error can occur if you forget to put commas between the string literals, as Python will concatenate them: `sp.Popen(['echo' '1']) # FAILS` – Carl G Jun 19 '17 at 17:08
it should be `import shlex` as shlex is its own [python standard package](https://docs.python.org/3/library/shlex.html). – hard Aug 26 '19 at 15:48
You will even get this error if the command (first arg) has a space in it. For example, this will fail: `sp.Popen(['echo ', '1'])` Notice the space right after "echo"... very easy to miss. – JDune May 16 '20 at 01:27

score 4 · Answer 3 · answered Mar 30 '12 at 04:53

4

You have to give the full path to your program deactivate and then it the subprocess module should be able to find it.

answered Mar 30 '12 at 04:53

Senthil Kumaran

47,625
13
83
117

score 0 · Answer 4 · answered Mar 30 '12 at 09:17

I'm spawning subprocesses like that:

SHUTDOWN_CMD = os.path.sep.join(["c:", "windows", "system32", "shutdown.exe"])

def abortShutdown():
    os.spawnv(os.P_NOWAIT, SHUTDOWN_CMD,
        [SHUTDOWN_CMD, '/A'])
    time.sleep(3)

I'm not using subprocess since Python 2.5 does not support it. I had to use use the FULL path to have it working and I guess you also have to use the full path to your custom commands.

Popen error: [Errno 2] No such file or directory

4 Answers4

Linked