Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel Letter Frequency times out in the web interface #1642

Open
ryanplusplus opened this issue Mar 9, 2024 · 3 comments
Open

Parallel Letter Frequency times out in the web interface #1642

ryanplusplus opened this issue Mar 9, 2024 · 3 comments

Comments

@ryanplusplus
Copy link
Member

ryanplusplus commented Mar 9, 2024

In my local environment, my solution passes all tests in 1.4 seconds. Of this time, about 70% is spent running the serial solution in test_faster_than_serialized_answer. When this is run on the Exercism infrastructure, my solution times out. For giggles, I tried the example solution from this repo and this also times out. If I make my solution do nothing so that all of the time spent in the Exercism infrastructure is due to the serial solution, it doesn't time out, but obviously it doesn't pass the tests.

It seems that Exercism runners aren't fast enough or don't have enough parallelism to allow a parallel solution to run in the small amount of time left over after accounting for the fixed cost of the serial benchmark solution. Is it actually possible to have a solution succeed when running on the Exercism infrastructure? If not, can we reduce the size of the benchmark input to allow a solution to succeed?

Note that after submitting my failing solution, I saw that no community solutions are listed. Presumably this means that no one has a solution that can run in the time allotted.

@ryanplusplus
Copy link
Member Author

With no change to my solution I'm now able to get it to run without timing out, but my solution fails test_faster_than_serialized_answer despite it succeeding locally. The example solution also fails test_faster_than_serialized_answer despite succeeding locally. Maybe the Exercism runner has only one core?

@kotp
Copy link
Member

kotp commented Mar 9, 2024

I have not submitted my solution or at least have not published it. 13 tests pass, one fails, and it is the one concerning benchmark in which we are working on.

@iHiD
Copy link
Member

iHiD commented Mar 9, 2024

Maybe the Exercism runner has only one core?

I suspect the docker container is only running on one core, yeah.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants