Skip to content

benchpark info experiment fails in odd ways #1168

@nhanford

Description

@nhanford
(venv)$ benchpark info experiment commbench
Traceback (most recent call last):
  File "/p/vast1/nhanford/github/benchpark/lib/main.py", line 359, in <module>
    exit_code = main()
                ^^^^^^
  File "/p/vast1/nhanford/github/benchpark/lib/main.py", line 121, in main
    exit_code = action(args)
                ^^^^^^^^^^^^
  File "/p/vast1/nhanford/github/benchpark/lib/benchpark/cmd/info.py", line 229, in command
    actions[args.info_subcommand](args)
  File "/p/vast1/nhanford/github/benchpark/lib/benchpark/cmd/info.py", line 142, in info_experiment
    experiment_class = conc.experiment
                       ^^^^^^^^^^^^^^^
  File "/p/vast1/nhanford/github/benchpark/lib/benchpark/spec.py", line 380, in experiment
    return self.experiment_class(self)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/p/vast1/nhanford/github/benchpark/lib/benchpark/experiment.py", line 281, in __init__
    raise NotImplementedError(
NotImplementedError: "commbench" cannot run with MPI only without inheriting from MpiOnlyExperiment. Choose from ['rocm', 'cuda']
Traceback (most recent call last):
  File "/p/vast1/nhanford/github/benchpark/bin/benchpark", line 48, in <module>
    main()
  File "/p/vast1/nhanford/github/benchpark/bin/benchpark", line 44, in main
    subprocess.run([sys.executable, main_py] + sys.argv[1:], check=True)
  File "/usr/apps/python-3.12.2/lib/python3.12/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/p/vast1/nhanford/benchout/venv/bin/python3', PosixPath('/p/vast1/nhanford/github/benchpark/lib/main.py'), 'info', 'experiment', 'commbench']' returned non-zero exit status 1.

One would expect the above command to simply print the information about the benchmark. Furthermore, benchpark info commbench +rocm fails because it interprets +rocm as an argument to info.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions