Two questions about yaml configuration

[Cyber-Oscar]

pull:

• prefect.deployments.steps.run_shell_script:
  script: "pip install prefect-aws"

• prefect_aws.deployments.steps.pull_from_s3:
  requires: prefect-aws>=0.3.0
  bucket: prefect
  folder: my_dep
  credentials: "{{ prefect.blocks.minio-credentials.minio-secret }}"

• prefect.deployments.steps.set_working_directory:
  directory: .

• prefect.deployments.steps.pip_install_requirements:
  directory: project
  requirements_file: 'requirements.txt'
  stream_output: true

• prefect.deployments.steps.run_shell_script:
  script: "pwd"
  stream_output: true

deployments:

• name: my_dep
  version: null
  tags: [ ]
  concurrency_limit: null
  description: "Dep"
  entrypoint: main.py:initialize
  parameters: {}
  work_pool:
  name: default
  work_queue_name: null

  Good morning! I can't find out how to fix two issues:
  when I run the "run_shell_script" I can't see any information even with stream_output = true
  when the job is in the deployment step of the yaml configuration file it said that the project is in a temporary folder pulled with s3 , preventing me to find the correct path for the script

[zzstoatzz]

hi @Cyber-Oscar - can you share any logs you do get? i suspect there has to be some output from the steps somewhere - what version of prefect are you using?

[Cyber-Oscar]

Good morning @zzstoatzz,
This is my log

`Unexpected exception encountered when trying to load flow
Traceback (most recent call last):
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/engine.py", line 112, in
flow: "Flow[..., Any]" = load_flow(flow_run)
^^^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/flow_engine.py", line 140, in load_flow
flow = run_coro_as_sync(
^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/utilities/asyncutils.py", line 207, in run_coro_as_sync
return call.result()
^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/_internal/concurrency/calls.py", line 365, in result
return self. future.result(timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/_internal/concurrency/calls.py", line 192, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/_internal/concurrency/calls.py", line 441, in _run_async
result = await coro
^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/utilities/asyncutils.py", line 188, in coroutine_wrapper
return await task
^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/client/utilities.py", line 69, in wrapper
return await func(client, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/flows.py", line 2648, in load_flow_from_flow_run
os.chdir(output["directory"])
FileNotFoundError: [Errno 2] No such file or directory: 'project'
05:05:36 PM
Perfect.flow_runs
Process for flow run 'sage-moth' exited with status code: 1
05:05:36 PM
prefect.flow_runs.runner
Reported flow run '30befd3e-033e-42b1-ac85-373874e6fb1c' as crashed: Flow run process exited with non-zero status code 1.
05:05:36 PM
prefect.flow_runs.runner
Loading flow to check for on_crashed hooks
05:05:37 PM
prefect.flow_runs.runner

Running run_shell_script step...
05:05:37 PM
Perfect.flow_runs
Running pull_from_s3 step...
05:05:39 PM
perfect.flow_runs
Running set_working_directory step...
05:05:39 PM
perfect.flow_runs
Running pip_install_requirements step...
05:05:39 PM
perfect.flow_runs
Running run_shell_script step...
05:05:42 PM
perfect.flow_runs
Runner failed to retrieve flow to execute on_crashed hooks for flow run UUID('30befd3e-033e-42b1-ac85-373874e6fb1c').
Traceback (most recent call last):
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/runner/runner.py", line 1476, in _run_on_crashed_hooks
flow = await load_flow_from_flow_run(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/client/utilities.py", line 69, in wrapper
return await func(client, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/prefect/.local/lib/python3.11/site-packages/prefect/flows.py", line 2820, in load_flow_from_flow_run
exec(code, namespace)
FileNotFoundError: [Errno 2] No such file or directory: 'project'
`

There is an evident issue with folder navigation.
A better explanation can help a lot for sure

Actually, my project tree is

src/
├── project/
│ ├── init.py
│ ├── main.py
│ ├── prefect.yaml
│ └── prefectTest.bkp
└── requirements.txt

I executed the command "prefect deploy" inside src/ folder

inside the bucket s3 this structure is inside the bucket prefect inside /PROJECTA/structure

[Cyber-Oscar]

Changing the working directory to src did the job