profile
Deep Burst ๐Ÿ”ฅ๐Ÿ”ฅ๐Ÿ”ฅ
post-thumbnail

Take a Step Back: Evoking Reasoning via Abstraction in Large Language Models (2024)

ํŠน์ •ํ•œ ์„ธ๋ถ€ ์‚ฌํ•ญ์„ ํฌํ•จํ•œ ์‚ฌ๋ก€๋กœ๋ถ€ํ„ฐ ๊ณ ์ˆ˜์ค€ ๊ฐœ๋…๊ณผ ๊ธฐ๋ณธ ์›์น™์„ ๋„์ถœํ•˜๊ธฐ ์œ„ํ•ด ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์ด ์ถ”์ƒํ™”๋ฅผ ์ˆ˜ํ–‰ํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜๋Š” ๊ฐ„๋‹จํ•œ ํ”„๋กฌํ”„ํŠธ ๊ธฐ๋ฒ•์ธ Step-Back์„ ์•Œ์•„๋ด…์‹œ๋‹ค!

2024๋…„ 6์›” 23์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Essence of RAG

์˜ค๋Š˜์€ RAG๋ผ๋Š” ๊ธฐ์ˆ ์˜ ๋ณธ์งˆ๊ณผ ์Šคํƒ€ํŠธ์—…์˜ AI Researcher๋กœ์จ ๋ฐ”๋ผ๋ด์•ผํ•˜๋Š” ์‹œ๊ฐ์— ๋Œ€ํ•ด ์ด์•ผ๊ธฐํ•ด๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค ๐Ÿ˜†

2024๋…„ 6์›” 23์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Azure ML Studio์—์„œ huggingface library๋ฅผ ์‚ฌ์šฉํ•˜๋Š”๋ฐ mlflow ์˜ค๋ฅ˜๊ฐ€?!

Azure Cloud Platform์˜ ml-studio ํ™˜๊ฒฝ์—์„œhuggingface ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์‚ฌ์šฉ์ค‘ mlflow ์—๋Ÿฌ๊ฐ€ ๋ฐœ์ƒํ•œ๋‹ค๋ฉด?!

2024๋…„ 6์›” 23์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Interleaving Retrieval with Chain-of-Thought for Knowledge-Intensive Multi-Step Questions (2023)

์‚ฌ์šฉ์ž ์งˆ์˜๋ฅผ ๋ถ„์„ํ•ด์„œ ์ค‘๊ฐ„์ค‘๊ฐ„ ๊ฒ€์ƒ‰์„ ๋ง๋ถ™์ด๋Š” ํฅ๋ฏธ๋กœ์šด Prompt Retriever ๋ฐฉ๋ฒ•๋ก ์„ ๊ฐ€์ ธ์™”์Šต๋‹ˆ๋‹ค! ๋ฐ”๋กœ IRCoT๋ผ๊ณ  ํ•˜๋Š”๋ฐ์š”, ๊นŠ๊ฒŒ ์•Œ์•„๋ณด์‹œ์ฃ !

2024๋…„ 6์›” 23์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

RAG Survey : A Survey on Retrieval-Augmented Text Generation for Large Language Models (2024)

Retrieval-Augmented Generation (RAG)์€ ๋Œ€๊ทœ๋ชจ ์–ธ์–ด ๋ชจ๋ธ(LLM)์˜ ์ •์ ์ธ ํ•œ๊ณ„๋ฅผ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด ๊ฒ€์ƒ‰ ๋ฐฉ๋ฒ•๊ณผ ๋”ฅ๋Ÿฌ๋‹ ๋ฐœ์ „์„ ๊ฒฐํ•ฉํ•˜์—ฌ ๋“ฑ์žฅํ•œ ๊ฐ๊ด‘๋ฐ›๋Š” ๋ฐฉ๋ฒ•๋ก ์ž…๋‹ˆ๋‹ค. RAG์— ๋Œ€ํ•œ ์ตœ์‹  ๋™ํ–ฅ์„ ์‚ดํŽด๋ด…์‹œ๋‹ค.

2024๋…„ 6์›” 16์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

CoVe : Chain of Verification Reduces Hallucination in LLMs (2023)

์‚ฌ์‹ค์ ์œผ๋กœ ๊ทธ๋Ÿด๋“ฏํ•˜์ง€๋งŒ ์ž˜๋ชป๋œ ์ •๋ณด๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๊ฒƒ, ์ฆ‰ ํ™˜๊ฐํ˜„์ƒ(=Hallucinations)์€ LLMs์—์„œ ํ•ด๊ฒฐ๋˜์ง€ ์•Š์€ ๋ฌธ์ œ์ž…๋‹ˆ๋‹ค. ํ™˜๊ฐํ˜„์ƒ์„ Prompting์„ ํ™œ์šฉํ•˜์—ฌ ๊ฒ€์ฆํ•˜๋Š” ๋ฐฉ๋ฒ•๋ก ์ธ CoVe์— ๋Œ€ํ•ด ์•Œ์•„๋ด…์‹œ๋‹ค!

2024๋…„ 6์›” 16์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

LLM๊ณผ Grounding

LLM์ด ์ƒ์„ฑํ•˜๋Š” ๋‹ต๋ณ€๊ณผ ํ•ด๋‹น๋‹ต๋ณ€์˜ ์‹ ๋ขฐ๋„๋ฅผ ๋ฏฟ์„ ์ˆ˜ ์žˆ์œผ์‹ ๊ฐ€์š”? ๋ชจ๋“  LLM์€ ๊ทธ ์ž์ฒด์˜ ๋‹ต๋ณ€๋งŒ์œผ๋กœ๋Š” Hallucination์„ ์ œ์–ดํ•˜๊ธฐ์—” ์•„์ง๊นŒ์ง€ ๋ฌด๋ฆฌ๊ฐ€ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ํ™˜๊ฐํ˜„์ƒ์„ ์–ต์ œํ•˜๊ณ  ์‹ ๋ขฐ์„ฑ ์žˆ๋Š” ๋‹ต๋ณ€์ƒ์„ฑ์„ ์œ„ํ•œ ๋ฐฉ๋ฒ•์„ ์•Œ์•„๋ด…์‹œ๋‹ค.

2024๋…„ 6์›” 16์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Compounded AI System : The Shift from Models to Compound AI Systems

Matei Zahariaย ,ย Omar Khattabย ,ย Lingjiao Chenย ,ย Jared Quincy Davisย ,ย Heather Millerย ,ย Chris Pottsย ,ย James Zouย ,ย Michael Carbinย ,ย Jonathan Frankleย ,ย Nav

2024๋…„ 5์›” 18์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

RAG์— ๋Œ€ํ•œ ๊ณ ์ฐฐ

LLM ๊ธฐ์ˆ ์˜ ๋ฐœ์ „๊ณผ ํ˜„์‹ค์„ธ๊ณ„ ์‘์šฉ๊ธฐ๋ฒ•์ธ RAG์— ๋Œ€ํ•œ ์‹ ์ž… GenAI Researcher์˜ ์˜๊ฒฌ์ด ๊ถ๊ธˆํ•˜๋‹ค๋ฉด?!

2024๋…„ 5์›” 18์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Transformer : Attention is all you need (2017)

์˜ค๋Š˜ ๋ฆฌ๋ทฐํ•  ๋…ผ๋ฌธ์€ ํ˜„๋Œ€ LLM์ด ๋‚˜์˜ค๊ธฐ๊นŒ์ง€ ๊ฐ€์žฅ ํฐ ์ถœ๋ฐœ์ด๋ผ ๋ถˆ๋ฆฌ๋Š” Transformer๊ฐ€ ์†Œ๊ฐœ๋œ 2017๋…„ ๋…ผ๋ฌธ "Attention is all you need"์ž…๋‹ˆ๋‹ค.

2024๋…„ 5์›” 5์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[ํ›„๊ธฐ] AI EXPO KOREA 2024 (24.05.01. ~ 05.03.)

์ง€๋‚œ 5์›” 1์ผ ~ 3์ผ ์‚ผ์„ฑ๋™ ์ฝ”์—‘์Šค์—์„œ ์—ด๋ฆฐ AI EXPO KOREA 2024๋ฅผ ๋‹ค๋…€์™”์Šต๋‹ˆ๋‹ค ๐Ÿ˜Š ์ •๋ง ๋งŽ์€ ๊ธฐ์—…๋“ค์ด ๋ถ€์Šค๋ฅผ ์ฐจ๋ฆฌ๊ณ  ์„œ๋น„์Šค๋ฅผ ์†Œ๊ฐœํ•˜๋ฉฐ ํ™๋ณดํ•˜๊ณ  ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค. ์‚ฌ๋žŒ๋„ ์—„์ฒญ๋งŽ๊ณ  ๋ณต์ž‘๋ณต์ž‘ํ–ˆ๋˜ ํ–‰์‚ฌํ›„๊ธฐ๋ฅผ ์ ์–ด๋ณผ๊ฒŒ์š”!

2024๋…„ 5์›” 5์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

[Paper Review] : Trailer

ํšŒ์‚ฌ๋ฅผ ๋‹ค๋‹ˆ๋ฉด์„œ ๋™์‹œ์— Velog ์ด์ „์„ ์กฐ๊ธˆ์”ฉ ํ•˜๋‹ค๋ณด๋‹ˆ ํฌ์ŠคํŒ…์„ ํ•˜๋Š” ์†๋„๊ฐ€ ๋”๋””๋„ค์š”..ใ…Ž ์ด๋ฒˆ์ฃผ๋ถ€ํ„ด Paper Review๋ฅผ ์ •๋ฆฌํ•ด์„œ ์˜ฌ๋ ค๋ณด๋ ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค! ํ•ต์‹ฌ๋‚ด์šฉ์„ ์ •๋ฆฌํ•˜๊ณ ์ž ํ•˜๋‹ˆ ๋ณด์‹œ๋Š” ๋ถ„๋“คํ•œํ…Œ๋„ ๋„์›€์ด ๋˜๋ฉด ์ข‹๊ฒ ๋„ค์š”!

2024๋…„ 5์›” 4์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท
post-thumbnail

Fluent Python - Data Model

ํŒŒ์ด์ฌ์˜ ์ฐฝ์‹œ์ž ๊ท€๋„ ๋ฐ˜ ๋กœ์„ฌ์€ ์–ธ์–ด์„ค๊ณ„๋ฅผ ๊ต‰์žฅํžˆ ์ž˜ ํ•˜๋Š” ์†Œํ”„ํŠธ์›จ์–ด ์—”์ง€๋‹ˆ์–ด๋กœ ์•Œ๋ ค์ ธ์žˆ๋‹ค. ํ•„์ž๋„ GenAI๋ฅผ ๋‹ค๋ฃจ๋Š” Engineer์ง€๋งŒ ๊ทธ ๊ทผ๊ฐ„์€ Python์„ ์‚ฌ์šฉํ•˜๊ธฐ์— ๋ ˆ๋ฒจ์—…์„ ์œ„ํ•ด ๋‹ค์‹œํ•œ๋ฒˆ Python ๊ณต๋ถ€๋ฅผ ํ•ด๋ณด๋ ค๊ณ  ํ•œ๋‹ค.

2024๋…„ 5์›” 4์ผ
ยท
0๊ฐœ์˜ ๋Œ“๊ธ€
ยท