Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Writing training output to HDFS fails with 'Pathname [path] is not a valid DFS filename.' #71

Open
MarkPundurs opened this issue Mar 29, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@MarkPundurs
Copy link

MarkPundurs commented Mar 29, 2022

Describe the bug
Writing training output to HDFS fails with 'Pathname [path] is not a valid DFS filename.'

To Reproduce
Steps to reproduce the behavior:

  1. Select a dataset.
  2. Click the forecast plugin.
  3. Select the training option (number 1).
  4. Select an HDFS connection for the metrics dataset.

Expected behavior
Plugin writes output to specified locations.

Root cause
HDFS doesn't allow colons in paths: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/filesystem/model.html#Paths_and_Path_Elements

Suggested fix
In dss-plugin-timeseries-forecast/custom-recipes/timeseries-forecast-1-train-evaluate/recipe.py, change line 29 from
session_name = datetime.utcnow().isoformat() + "Z"
to
session_name = datetime.utcnow().isoformat().replace(':', '.') + "Z"

@MarkPundurs MarkPundurs added the bug Something isn't working label Mar 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant