Skip to content

Commit 7895196

Browse files
committed
feat: Implement LlamaEagleSpeculator with
serialization support - Add LlamaEagleSpeculator model class - Implement model serialization/deserialization - Add torch as a project dependency - Include unit and integration tests - Fixes for serialization handling This introduces the core LlamaEagleSpeculator functionality with full serialization support
1 parent 225bfe8 commit 7895196

File tree

5 files changed

+783
-0
lines changed

5 files changed

+783
-0
lines changed

pyproject.toml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -46,6 +46,7 @@ dependencies = [
4646
"pydantic-settings>=2.0.0",
4747
"pyyaml>=6.0.0",
4848
"transformers",
49+
"torch",
4950
]
5051

5152
[project.optional-dependencies]

src/speculators/models/__init__.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,12 @@
11
from .independent import IndependentSpeculatorConfig
2+
from .llama_eagle import LlamaEagleSpeculator, LlamaEagleSpeculatorConfig
23
from .mlp import MLPSpeculatorConfig
34
from .transformer import TransformerSpeculatorConfig
45

56
__all__ = [
67
"IndependentSpeculatorConfig",
8+
"LlamaEagleSpeculator",
9+
"LlamaEagleSpeculatorConfig",
710
"MLPSpeculatorConfig",
811
"TransformerSpeculatorConfig",
912
]

0 commit comments

Comments
 (0)