Update README.md

README.md

@@ -6,7 +6,7 @@ metrics:
 - accuracy
 - f1
 ---
-Paper: `FonMTL: Toward Building a Multi-Task Learning Model for Fon Language`, accepted at WiNLP co-located at EMNLP 2023
+- Paper: [`FonMTL: Toward Building a Multi-Task Learning Model for Fon Language`](https://arxiv.org/abs/2308.14280), accepted at WiNLP co-located at EMNLP 2023
 
 - Official Github: https://github.com/bonaventuredossou/multitask_fon
 
@@ -62,6 +62,22 @@ Model | Task | Pretraining/Finetuning Dataset | Pretraining/Finetuning Language(
 `MTL Weighted (ours)` | Multi-Task | MasakhaNER 2.0 & MasakhaPOS | All | FON POS | Accuracy | 89.20 |
 `MTL Weighted (ours)` | Multi-Task | MasakhaNER 2.0 & MasakhaPOS | Fon Data | FON POS | Accuracy | 80.85 |
 
+# Importance of Merging Representation Type
+
+Merging Type | Models | Task | Metric | Metric's Value |
+| :---: | :---: | :---: | :---: | :---: |
+Multiplicative | MTL Weighted (multi-task; ours; *) | NER | F1-Score | **81.92** |
+Multiplicative | MTL Weighted (multi-task; ours; +) | NER | F1-Score | 64.43 |
+| :---: | :---: | :---: | :---: | :---:|
+Multiplicative | MTL Weighted (multi-task; ours; *) | POS | Accuracy | **89.20** |
+Multiplicative & MTL Weighted (multi-task; ours; +) | POS | Accuracy | 80.85 | 
+| :---: | :---: | :---: | :---: | :---: |
+Additive | MTL Weighted (multi-task; ours; *) | NER | F1-Score | 78.91 |
+Additive | MTL Weighted (multi-task; ours; +) | NER | F1-Score | 60.93 |
+| :---: | :---: | :---: | :---: | :---: |
+Additive | MTL Weighted (multi-task; ours; *) | POS | Accuracy | 86.99 |
+Additive | MTL Weighted (multi-task; ours; +) | POS | Accuracy | 78.25 |
+
 # Model End-Points
 
 - [`multitask_model_fon_False_multiplicative.bin`](https://huggingface.co/bonadossou/multitask_model_fon_False_multiplicative) is the MTL Fon Model which has been pre-trained on all MasakhaNER 2.0 and MasakhaPOS datasets, and merging representations in a multiplicative way.
@@ -69,4 +85,7 @@ Model | Task | Pretraining/Finetuning Dataset | Pretraining/Finetuning Language(
 - [`multitask_model_fon_True_multiplicative.bin`](https://huggingface.co/bonadossou/multitask-learning-fon-true-multiplicative) is the MTL Fon Model which has been pre-trained only on Fon data from the MasakhaNER 2.0 and MasakhaPOS datasets, and merging representations in a multiplicative way.
 
 # How to run inference when you have the model
- To run inference with the model(s), you can use the [testing block](https://github.com/bonaventuredossou/multitask_fon/blob/main/code/run_train.py#L209) defined in our MultitaskFON class.
+ To run inference with the model(s), you can use the [testing block](https://github.com/bonaventuredossou/multitask_fon/blob/main/code/run_train.py#L209) defined in our MultitaskFON class.
+
+ # TODO
+ - leverage the impact of `the dynamic weighted average loss`