Skip to content

Build a Benchmark Testing app #1378

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
vitorpamplona opened this issue May 10, 2022 · 5 comments · Fixed by #2817
Closed

Build a Benchmark Testing app #1378

vitorpamplona opened this issue May 10, 2022 · 5 comments · Fixed by #2817
Assignees
Labels
effort:xlarge Extra large effort - >10 days P2 Medium priority issue

Comments

@vitorpamplona
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
Benchmarking certain FHIR Features in instrumented tests and/or benchmark modules is quite difficult. The team could use an app to constantly measure the performance of several elements and help identify appropriate phone configurations to run certain types of applications.

Describe the solution you'd like
Build and ship a FHIR Benchmarking app to allow easy evaluation of certain FHIR features for different phones. The basic structure is a simple collection of runners that measure time, battery consumption, networking needs, and memory usage for registered tasks. The app should display the list of runners with their individual time/memory results as well as an aggregate result at the bottom. A single button restarts all tests.

A few immediate runners could already be extremely helpful.

  1. FhirContext loading times.
  2. Parsing FHIR results from REST API/JSON (and other representations)
  3. Saving and retrieving FHIR objects from the database
  4. Saving and retrieving CQL libraries from the database.
  5. Running CQL-to-ELM compilation
  6. Evaluating small and large CQL expressions

Describe alternatives you've considered
I have tried building a Benchmark Module, but the results are too inconsistent and lack added information about the use of Network/Memory/Processing power/Battery per element of the test.

Additional context
Add any other context or screenshots about the feature request here.

Would you like to work on the issue?
Please state if this issue should be assigned to you or who you think could help to solve this issue.

@Tarun-Bhardwaj
Copy link

@vitorpamplona , is there an ETA by when PR can be created for review?

@vitorpamplona
Copy link
Collaborator Author

Hum.. we have not prioritized this one yet. I suggested this idea at the same time other team members suggested a Benchmark module connected to a Google Cloud service to test on real devices inside the project. I am not sure where the discussion landed, but I believe other team members were testing the Benchmark idea out to see if we really need a new app.

@jingtang10 @ktarasenko what do you think? I am happy to start putting something together for this app.

@ktarasenko
Copy link
Contributor

sounds great, I'd love to see something like that.
@jingtang10 were there already any other efforts for benchmarking the SDK?

@Tarun-Bhardwaj
Copy link

sounds great, I'd love to see something like that. @jingtang10 were there already any other efforts for benchmarking the SDK?

@ktarasenko you may visit this PR
#1414

@jingtang10
Copy link
Collaborator

@LZRS is working on this and will be creating a new app using jetpack compose.

@fredhersch fredhersch moved this from Icebox to In Progress in Android FHIR SDK May 7, 2025
@github-project-automation github-project-automation bot moved this from In Progress to Complete in Android FHIR SDK May 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
effort:xlarge Extra large effort - >10 days P2 Medium priority issue
Projects
Status: Complete
Development

Successfully merging a pull request may close this issue.

5 participants