anudaw commited on
Commit
0ff0c56
·
1 Parent(s): e723dcb

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -12
README.md CHANGED
@@ -2,11 +2,7 @@
2
  license: apache-2.0
3
  base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4
  tags:
5
- - trl
6
- - sft
7
  - generated_from_trainer
8
- datasets:
9
- - generator
10
  model-index:
11
  - name: full_finetuned-code-tinyllama
12
  results: []
@@ -17,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  # full_finetuned-code-tinyllama
19
 
20
- This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on the generator dataset.
21
 
22
  ## Model description
23
 
@@ -36,18 +32,14 @@ More information needed
36
  ### Training hyperparameters
37
 
38
  The following hyperparameters were used during training:
39
- - learning_rate: 0.0002
40
  - train_batch_size: 4
41
  - eval_batch_size: 8
42
  - seed: 42
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
- - lr_scheduler_type: cosine
45
  - lr_scheduler_warmup_ratio: 0.03
46
- - num_epochs: 1
47
-
48
- ### Training results
49
-
50
-
51
 
52
  ### Framework versions
53
 
 
2
  license: apache-2.0
3
  base_model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4
  tags:
 
 
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: full_finetuned-code-tinyllama
8
  results: []
 
13
 
14
  # full_finetuned-code-tinyllama
15
 
16
+ This model is a fine-tuned version of [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on an unknown dataset.
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 2e-05
36
  - train_batch_size: 4
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
+ - lr_scheduler_type: constant
41
  - lr_scheduler_warmup_ratio: 0.03
42
+ - num_epochs: 4
 
 
 
 
43
 
44
  ### Framework versions
45