Skip to content

Commit a2322bb

Browse files
committed
feat: add LoRA training pipeline and intelligent model selection
- Complete LoRA training scripts for 3 classification tasks - Smart model selection with architecture priority (BERT > RoBERTa > ModernBERT) - Official Candle BERT integration for Python-Go consistency - Enhanced unified classifier with high-confidence LoRA models Signed-off-by: OneZero-Y <[email protected]>
1 parent 61be8cd commit a2322bb

29 files changed

+8144
-533
lines changed

Makefile

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -256,6 +256,13 @@ download-models:
256256
hf download LLM-Semantic-Router/pii_classifier_modernbert-base_presidio_token_model --local-dir models/pii_classifier_modernbert-base_presidio_token_model; \
257257
fi
258258

259+
# LoRA Enhanced Models (Note: These need to be trained locally)
260+
@echo "LoRA models need to be trained locally using the training scripts:"
261+
@echo " - Intent Classification: python src/training/training_lora/classifier_model_fine_tuning_lora/ft_linear_lora.py"
262+
@echo " - PII Detection: python src/training/training_lora/pii_model_fine_tuning_lora/pii_bert_finetuning_lora.py"
263+
@echo " - Security Detection: python src/training/training_lora/prompt_guard_fine_tuning_lora/jailbreak_bert_finetuning_lora.py"
264+
@echo "See website/docs/training/training-overview.md for detailed instructions."
265+
259266
# Milvus container management
260267
start-milvus:
261268
@echo "Starting Milvus container for testing with $(CONTAINER_RUNTIME)..."

0 commit comments

Comments
 (0)