This collection contains the models from the paper "MiniALBERT: Model Distillation via Parameter-Efficient Recursive Transformers"
NLPIE Research
non-profit
AI & ML interests
Natural Language Processing, Biomedical NLP, Clinical Machine Learning
Recent Activity
Organization Card
NLPIE Research
NLPIE Research is an unincorporated, non-profit collaborative project with contributions from various collaborators. The project develops lightweight machine-learning models for biomedical and clinical NLP, released openly so researchers everywhereâincluding those with limited computeâcan benefit.
Research domains
- Biomedical and clinical NLP
- AI for healthcare
- Efficient model design & distillation
Support our work
If our models help your research, consider a one-off or monthly contributionâevery pound goes into compute, hosting and upkeep:
https://github.com/sponsors/nlpie-research
Compliance notice
All software and data here are under OSI-approved licences; please ensure your own use complies with applicable regulations.
Connect
General enquiries: [email protected]
models
19
nlpie/ppace-v1.0
Text Generation
â˘
8B
â˘
Updated
â˘
37
nlpie/tiny-clinicalbert
Fill-Mask
â˘
Updated
â˘
349
â˘
1
nlpie/clinical-mobilebert
Fill-Mask
â˘
Updated
â˘
39
â˘
1
nlpie/distil-clinicalbert
Fill-Mask
â˘
Updated
â˘
1.51k
â˘
1
nlpie/clinical-distilbert-i2b2-2010
Token Classification
â˘
Updated
â˘
1.3k
â˘
2
nlpie/clinical-mobilebert-i2b2-2010
Token Classification
â˘
Updated
â˘
52
â˘
2
nlpie/Llama2-MedTuned-7b
Text Generation
â˘
Updated
â˘
71
â˘
11
nlpie/Llama2-MedTuned-13b
Text Generation
â˘
Updated
â˘
36
â˘
9
nlpie/bio-mobilebert
Fill-Mask
â˘
Updated
â˘
63
â˘
2
nlpie/bio-tinybert
Fill-Mask
â˘
Updated
â˘
109
â˘
4