feat: add machine tag and inference timings#4577

Merged

mudler merged 3 commits intomudler:masterfrom

mintyleaf:feature/token_timings

Jan 17, 2025

Commits on Jan 17, 2025

Add machine tag option, add extraUsage option, grpc-server -> proto -> endpoint extraUsage data is broken for now
mintyleaf
committed
remove redurant timing fields, fix not working timings output
mintyleaf
committed
use middleware for Machine-Tag only if tag is specified
mintyleaf
committed