I had a similar problem with zsh:
zsh:1: command not found: scp
The reason for the problem in my case what that $PATH wasn't set in non-interactive sessions (which is the case for scp).
My solution was:
```
ln -s zprofile /etc/zsh/zshenv
```
Presumably the solution with `bash` will be very similar.