Huang Fei

Guangdong Provincial People's Hospital

Author Statistics

Papers

Citation

H-Index

i-10 index

Research Field

PolyLM: An Open Source Polyglot Large Language Model

arXiv (Cornell University) (2023)

Xiangpeng Wei Haoran Wei Huan Lin Tianhao Li Pei Zhang

Large language models (LLMs) demonstrate remarkable ability to comprehend, reason, and generate following nature language instructions. However, the development of LLMs has been primarily focused on high-resource languages, such as English, thereby limiting their applicability and research in other languages. Consequently, we present PolyLM, a multilingual LLM trained on 640 billion (B) tokens, avaliable in two model sizes: 1.7B and 13B. To enhance its multilingual capabilities, we 1) integrate bilingual data into training data; and 2) adopt a curriculum learning strategy that increases the proportion of non-English data from 30% in the first stage to 60% in the final stage during pre-training. Further, we propose a multilingual self-instruct method which automatically generates 132.7K diverse multilingual instructions for model fine-tuning. To assess the model's performance, we collect several existing multilingual tasks, including multilingual understanding, question answering, generation, and translation. Extensive experiments show that PolyLM surpasses other open-source models such as LLaMA and BLOOM on multilingual tasks while maintaining comparable performance in English. Our models, alone with the instruction data and multilingual benchmark, are available at: \url{https://modelscope.cn/models/damo/nlp_polylm_13b_text_generation}.

Polyglot

Benchmark (surveying)

Limiting

10.48550/arxiv.2307.06018

Cite

Citations (7)

Relationship between paroxysmal atrial fibrillation and P-wave dispersion

Huang Fei

Obiective To explore the relationship between paroxysmal atrial fibrillation(PAF) and P wave dispersion(pd) Methods The P wave maximal interval(Pmax)and P wave dispersion were measured and compared in 62 essential hypertensive patients with history of PAF(group A),63 didopathic patients,and 62 healthy controls Rusults The pd and Pmax had significant difference in two groups of patients with paroxysmal atrial fibrillation comparing with that of contol;The pd and Pmax had no significant difference in patients of A group comparing with B group,Taking pd≥40ms,pmax≥110ms and combination of two indexes as diagnosis criteion in Aand B groups,sensitivity of them were 83 9%,85 5%,77 4%and 81 0%,87 3%,79 4%,spccificity were 79 0%,71 4%and 90 3%,positive predictive value were 80 1%,74 6%,88 9%and 79 7%,75 3%,89 3%respectively Conclusions Pd is new,noninvasive,stable predictable index in patients with paroxysmal atrial fibrillation

Paroxysmal atrial fibrillation

P wave

Cite

Citations (0)

A case report of gouty discitis with lumbar vertebral body retrolisthesis

Zhongguo Jizhu Jisui Zazhi (2016)

Yunlong Zou Ye Li Yongkun Wang Huang Fei Jing‐Chen Liu

Discitis

Source

Cite

Citations (0)