4 Commits

Author	SHA1	Message	Date
Cristian Cezar Moisés	af62bffeff	Update generate.py ... Error Handling: Improved error handling for file operations and JSON loading. Logging: Clearer logging messages for better debugging and monitoring. Code Comments: Added more descriptive comments to enhance code readability. Dynamic Sequence Management: Clarified the logic for managing prompt lengths and token generation. Performance: Minor optimizations in code structure and logic flow for better performance. Code Structure: Organized functions and constants for better readability and maintainability.	2025-01-27 23:26:23 -03:00
Cristian Cezar Moisés	ebbbf84d35	Update generate.py ... Distributed Training Enhancements: Proper NCCL/Gloo backend selection Distributed timeout handling Rank-aware input broadcasting Graceful process group cleanup Error Handling & Validation Comprehensive path validation Config schema validation Tokenization error handling Batch processing safeguards CUDA OOM fallback handling Generation Improvements: Top-k sampling support Repetition penalty Dynamic sequence length management Progress tracking with tqdm Sequence truncation warnings Performance Optimizations: Device-aware tensor placement Batch tokenization Memory-efficient generation loop Model parallelism support User Experience: Interactive mode enhancements: Command history Input validation Graceful exit handling Batch processing: Progress tracking Error resilience Clean output formatting Code Quality: Type hints throughout Configurable constants Modular architecture Docstrings with examples Logging integration Safety Features: Tokenizer trust_remote_code handling Config validation Input sanitization Resource cleanup guarantees	2025-01-27 23:16:21 -03:00
enoch kan	a1296f099e	Enhance documentation and update .gitignore for model conversion scripts	2025-01-05 18:18:18 +00:00
stack-heap-overflow	4c2fdb8f55	Release DeepSeek-V3	2024-12-26 19:01:57 +08:00