| 2025-11-27 06:07:31,285 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:07:31,285 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:07:31,285 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:07:31,285 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:07:31,285 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:07:51,430 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:07:51,430 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:07:51,430 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:07:51,431 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:07:51,431 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:07:52,217 - INFO - Cargando datasets y aplicando formato... | |
| 2025-11-27 06:07:53,195 - INFO - Configurando quantizaci贸n 4-bit... | |
| 2025-11-27 06:12:48,086 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:12:48,086 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:12:48,086 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:12:48,086 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:12:48,086 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:12:48,375 - INFO - Cargando datasets y aplicando formato... | |
| 2025-11-27 06:12:48,645 - INFO - bitsandbytes NO disponible. Cargando modelo en bfloat16 sin cuantizaci贸n... | |
| 2025-11-27 06:13:41,018 - INFO - Configurando LoRA... | |
| 2025-11-27 06:13:41,019 - INFO - Configurando entrenamiento SFT... | |
| 2025-11-27 06:15:56,608 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:15:56,608 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:15:56,608 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:15:56,608 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:15:56,608 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:15:57,256 - INFO - Cargando datasets y aplicando formato... | |
| 2025-11-27 06:15:57,507 - INFO - bitsandbytes NO disponible. Cargando modelo en bfloat16 sin cuantizaci贸n... | |
| 2025-11-27 06:16:03,256 - INFO - Configurando LoRA... | |
| 2025-11-27 06:16:03,256 - INFO - Configurando entrenamiento SFT... | |
| 2025-11-27 06:18:28,869 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:18:28,869 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:18:28,869 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:18:28,869 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:18:28,869 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:18:29,159 - INFO - Cargando datasets y aplicando formato... | |
| 2025-11-27 06:18:29,374 - INFO - bitsandbytes NO disponible. Cargando modelo en bfloat16 sin cuantizaci贸n... | |
| 2025-11-27 06:18:33,501 - INFO - Configurando LoRA... | |
| 2025-11-27 06:18:33,502 - INFO - Configurando entrenamiento SFT... | |
| 2025-11-27 06:21:23,985 - INFO - === Entrenamiento LoRA para servicio EC2 === | |
| 2025-11-27 06:21:23,985 - INFO - Train dataset: /workspace/data/dataset_sft_EC2_train.jsonl | |
| 2025-11-27 06:21:23,985 - INFO - Val dataset : /workspace/data/dataset_sft_EC2_val.jsonl | |
| 2025-11-27 06:21:23,985 - INFO - Output dir : /workspace/out/starcoder2_7b_lora_ec2 | |
| 2025-11-27 06:21:23,985 - INFO - Cargando tokenizer... | |
| 2025-11-27 06:21:24,268 - INFO - Cargando datasets y aplicando formato... | |
| 2025-11-27 06:21:24,504 - INFO - bitsandbytes NO disponible. Cargando modelo en bfloat16 sin cuantizaci贸n... | |
| 2025-11-27 06:21:28,727 - INFO - Configurando LoRA... | |
| 2025-11-27 06:21:28,728 - INFO - Configurando entrenamiento SFT... | |
| 2025-11-27 06:21:41,012 - INFO - Iniciando entrenamiento... | |
| 2025-11-27 08:48:59,934 - INFO - Entrenamiento finalizado. | |
| 2025-11-27 08:48:59,935 - INFO - Duraci贸n total (s): 8838.92 | |
| 2025-11-27 08:48:59,935 - INFO - Epochs entrenadas : 3.0 | |
| 2025-11-27 08:48:59,935 - INFO - Global steps : 2025 | |
| 2025-11-27 08:48:59,935 - INFO - Evaluando en conjunto de validaci贸n... | |
| 2025-11-27 08:50:48,176 - INFO - M茅tricas de evaluaci贸n: {'eval_loss': 0.29000768065452576, 'eval_runtime': 108.2382, 'eval_samples_per_second': 5.543, 'eval_steps_per_second': 0.693, 'eval_entropy': 0.2899935628970464, 'eval_num_tokens': 13708374.0, 'eval_mean_token_accuracy': 0.9388597853978475, 'epoch': 3.0} | |
| 2025-11-27 08:50:48,177 - INFO - M茅tricas guardadas en: /workspace/out/starcoder2_7b_lora_ec2/training_summary_ec2.json | |
| 2025-11-27 08:50:48,177 - INFO - Guardando modelo y tokenizer LoRA... | |
| 2025-11-27 08:50:48,581 - INFO - Guardado completo. | |