Releases: smallcloudai/refact
v1.3.0
New Models
Expanding the list of available models with:
- Mistral
- 7B
- Mixtral
- 8x7B
- Deepseek
- 6.7B
- 33B
- Magicoder
- 6.7B
Statistics
We are introducing a new cool feature - user stats.
Check out the new page with informative charts to see the impact of having Refact!
Better Docker Flow
We've simplified our Docker image usage! Now, it's just one command:
docker run --rm --gpus all -p 8008:8008 -v perm-storage:/perm_storage -v
refact-database:/var/lib/cassandra smallcloud/refact_self_hosting:latest
UI Enhancements
- Improved Modal Window: From now on, we will have a more structured and organized interface for the list of models.
- User Seats Information: For the Refact Enterprise, the access control page now includes information about user seats – a feature exclusive to the enterprise plan.
General Improvements and Chat Handlers
v1.2.0
Deepseek-Coder Models:
We added support for the deepseek-coder family models, and you can use these models for completion and fine-tuning.
Codellama/7b:
Starting today, the codellama/7b
model is available for fine-tuning.
Faster Fine-Tuning:
Fine-tuning is now faster for GPUs with CUDA capabilities 8.0
and higher.
UI & Performance:
General UI and performance improvements.
v1.1.0
Model Updates
Starcoder 1b, 3b, and 7b models are now available for completion and finetuning.
Features
Upload LoRA
- LoRA Upload: LoRA upload feature is now available. You can now upload LoRA either via a direct link or by uploading the file.
Download Run
- "Download Run" feature allows downloading the best checkpoint.
- The "Download Checkpoint" feature allows you to download only the selected checkpoint.
UI & UX Improvements
- Model Hosting Tab: The selected finetune checkpoint associated with the model is now visible.
- Finetune Tab: The selected model for completion is now visible on the Finetuning page. From now on, you can easily view the model for which you've selected the checkpoint.
- Checkpoint Selection: You can now set the best checkpoint for a run.
Bug Fixes & Performance Improvements
- We've crushed some bugs and optimized Refact for even better performance.