Implement cache manager

[fimanishi]

Is your feature request related to a problem? Please describe.
Cache limits used by shards have to have small limits due to high shard number and don't take into account imbalance of shard usage.

Proposed Solution
Implement a cache manager to manage the memory for all caches, improving cache hits and memory usage.

Additional context
Add any other context or screenshots about the feature request here.