BREAKING CHANGE: Restructured model.py into dedicated modules under inference/models/
Key Changes:
- Split monolithic model.py into focused, single-responsibility modules:
- config.py: Model configuration and hyperparameters
- attention.py: Multi-head Latent Attention (MLA) implementation
- moe.py: Mixture of Experts components (Gate, Expert, MoE)
- linear.py: Linear layer variants with parallel processing support
- __init__.py: Clean public API exports
Benefits:
- Improved code organization and maintainability
- Better separation of concerns
- Enhanced testability of individual components
- Clearer dependency management
- Simplified future modifications and extensions
Migration:
- Update imports to use new module structure
- No functional changes to existing implementations
- Backwards compatible with current model weights
