Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consolidate mocked app and simulator into one unified mock app for development #456

Closed
Jeffwan opened this issue Dec 2, 2024 · 0 comments · Fixed by #477
Closed

Consolidate mocked app and simulator into one unified mock app for development #456

Jeffwan opened this issue Dec 2, 2024 · 0 comments · Fixed by #477
Assignees
@zhangjyr @nwangfw
Labels
area/heterogeneous kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. kind/feature Categorizes issue or PR as related to a new feature. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.

Comments

@Jeffwan
Copy link
Collaborator

Jeffwan commented Dec 2, 2024

🚀 Feature Description and Motivation

We previously built a CPU-mocked app to facilitate fast prototyping and local development. This approach was convenient as it eliminated the need for GPU resources and simulated OpenAI-like interfaces and metrics effectively.

Recently, PR #430 introduced a separate app for simulation purposes. While it adds value, having separate apps for similar functionalities increases complexity and maintenance overhead.

Use Case

We need to build an unified app, merge all features together for fast prototyping.

  • Streamline the development process.
  • Reduce complexity for local development environments.
  • Ensure consistent feature sets and interfaces.

Proposed Solution

No response
@Jeffwan Jeffwan added kind/feature Categorizes issue or PR as related to a new feature. area/heterogeneous kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. labels Dec 2, 2024
@zhangjyr zhangjyr mentioned this issue Dec 2, 2024
Open
@zhangjyr zhangjyr self-assigned this Dec 2, 2024
@zhangjyr zhangjyr mentioned this issue Dec 4, 2024
Merged
@nwangfw nwangfw mentioned this issue Dec 5, 2024
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@zhangjyr zhangjyr

@nwangfw nwangfw

Labels
area/heterogeneous kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. kind/feature Categorizes issue or PR as related to a new feature. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[Misc] Consolidate app and simulator vllm-project/aibrix
3 participants
@zhangjyr @Jeffwan @nwangfw