Script Requires Absolute Paths for Proper Functionality

[manishnagaraj]

Description
The script does not handle relative paths reliably, leading to unexpected behavior. To ensure proper execution, all paths must be provided as absolute paths.

Example
The following command works as expected because it uses absolute paths:

bash /home/mnagara/Efficient_LLM_finetuning/Scripts/Gautschi_scripts/joblauncher.bash -t bash \
 -f /home/mnagara/Efficient_LLM_finetuning/Scripts/Gautschi_scripts/run_baseline_llama318_3216_commonsense.sh \
 -e llama -g 2 -c 28 -p cocosys -T 2-12:00:00 -s 97 -q cocosys

However, using relative paths in place of absolute ones results in errors or incorrect behavior.

Documenting this to avoid confusion for future users

[amoghj98]

Description
The script does not handle relative paths reliably, leading to unexpected behavior. To ensure proper execution, all paths must be provided as absolute paths.

Minimum Reproducible Example Provided
No

Minimum Example Provided
Yes

Is Issue Reproducible
Yes

Possible Solution
What happens when you run

bash $SOME_SCRIPT_FROM_THIS_REPO.bash -h

without specifying the absolute path? If you get a "No such file or directory" error, then your issue is most likely an artefact of the default shell on the cluster not being bash. Run

echo $PATH

in your terminal. If the $PATH variable does not contain the path /home/$USER/rcac-utils, then run

source ~/.bashrc

and print out the $PATH variable again. It should now contain the path /home/$USER/rcac-utils. To verify, run

bash $SOME_SCRIPT_FROM_THIS_REPO.bash -h

If the help message is correctly printed, the path issue should be resolved!

---

Comments for User
Please mark this comment as the answer if it solves your problem!