For symmetric semantic search

Sentence Bert

Sentence Transforemrs

Datasets

KorNLUDatasets
KLUE/STS,NLI

For asymmetric semantic search

dpr

https://github.com/deepset-ai/haystack/blob/master/haystack/modeling/training/dpr.py
https://github.com/ODQA-TEAM-TAJO/ODQA-TEAM-TAJO/tree/main/dpr

colbert

https://github.com/VumBleBot/odqa_baseline_code/blob/main/retrieval/dense/colbert.py

Pre-training

realm

https://github.com/google-research/language/tree/master/language/realm
https://github.com/qqaatw/transformers/tree/add_realm

Expansion + Term Re-weighting

splade

https://github.com/naver/splade

BERT sparse

https://www.koreascience.or.kr/article/CFKO202030060897870.pub?&lang=ko&orgId=sighlt

Datasets

KorQuad
KLUE/MRC

Benchmarking Tool

pyserini
Beir