๐Ÿค– ์ธ๊ณต์ง€๋Šฅ

AIs understand any data in numeric form.And this truth answers the title's question, "It understands them as numeric form". Then, how are they changed into numbers?You must wonder about the rule. The method is 'embedding'.There are several embedding ways. I will deal with basic methods to recent methods including graphical ways. Traditional embedding wayThere are several methods for text embeddi..
LLMs are constructed with a number of parameters. And each of them has certain role for each part of output. Anthropic, who made Claude, published a research about control LLMs by manipulating its paramrters 1. How LLMs learn? 2. The link between parameters and the output. 3. What they developed, the Golden Bridge bot. 4. Applying for AI safety 5. Further research suggestion, similarity with hum..
ํƒ์‹œ ์šดํ–‰์— ์žˆ ๋„์ฐฉ ์˜ˆ์ • ์‹œ๊ฐ„(ETA)์€ ์ค‘์š”ํ•œ ์ •๋ณด์ด๋‹ค. ETA ์ •๋ณด๋Š” ํŠนํžˆ ์นด์นด์˜ค ํƒ์‹œ ๋ฐฐ์ฐจ ์•Œ๊ณ ๋ฆฌ์ฆ˜์—์„œ๋„ ์ฃผ์š” ์ •๋ณด๋กœ ์‚ฌ์šฉ๋˜๋ฉฐ, ETA score๊ฐ€ ๋‚ฎ์€(๊ณ ๊ฐ์—๊ฒŒ ๊ฐ€์žฅ ๋น ๋ฅด๊ฒŒ ๋„๋‹ฌํ•  ์ˆ˜ ์žˆ๋Š”) ๊ธฐ์‚ฌ์—๊ฒŒ ์šฐ์„  ๋ฐฐ์ฐจ๋œ๋‹ค. ํฌ๊ฒŒ ๊ฒฝ๋กœ ์„ค์ •, ๊ทธ๋ฆฌ๊ณ  ํ•ด๋‹น ๊ฒฝ๋กœ์— ํ•ด๋‹นํ•˜๋Š” ์†Œ์š” ์‹œ๊ฐ„์„ ๊ณ„์‚ฐํ•˜๋Š” ๊ณผ์ •์œผ๋กœ ๋ชจ๋ธ์ด ๊ตฌ์„ฑ๋˜๋ฉฐ, ETA๋Š” ์‹ค์‹œ๊ฐ„ ์˜ˆ์ธก์ด ํ•„์š”ํ•œ ํƒœ์Šคํฌ๋กœ, latency ์ตœ์ ํ™”๋„ ๋ชจ๋ธ ์„ค๊ณ„์— ์ค‘์š”ํ•˜๊ฒŒ ๊ณ ๋ ค๋˜์–ด์•ผ ํ•œ๋‹ค. ๊ฐ ๊ตฌ์—ญ ๋ณ„๋กœ, ์•„์นจ, ์ ์‹ฌ, ์ €๋…๊ณผ ๊ฐ™์€ ์‹œ๊ฐ„๋Œ€์— ๋”ฐ๋ฅธ ๊ฑฐ๋ฆฌ ๋‹น time duration ๊ฐ’์„ batch ํ•™์Šต์œผ๋กœ ์ฃผ๊ธฐ์ ์œผ๋กœ ์—…๋ฐ์ดํŠธ๋˜์–ด ์ €์žฅํ•˜๋Š” ๊ฒƒ์„ ์ œ์•ˆํ•œ๋‹ค. ๊ฐ ๊ตฌ์—ญ ๋ณ„๋กœ ๊ฑฐ๋ฆฌ ๋‹น ์ด๋™ ์‹œ๊ฐ„์ด ์ •์˜๋˜๋ฏ€๋กœ, ์‹ค์ œ ETA ์˜ˆ์ธก์—์„œ๋Š” ์ด๋™ ๊ฒฝ๋กœ ๋‚ด ์กด์žฌํ•˜๋Š” ์œก๊ฐํ˜• ๊ตฌ์—ญ N๊ฐœ์— ๋Œ€ํ•ด, O..
๋จธ์‹ ๋Ÿฌ๋‹ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜์—ฌ ์žฌ๋ฏธ์žˆ๋Š” ์–ดํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ์ œ์ž‘ํ•˜๋ ค๊ณ  ํ•œ๋‹ค. ๋ฌธ๋“ ๋– ์˜ค๋ฅธ ์•„์ด๋””์–ด์ธ๋ฐ, ํ”„๋กœ์ ํŠธ ์ˆ˜์—…์—์„œ ์ด ์•„์ด๋””์–ด๋ฅผ ์ฃผ์ œ๋กœ ํŒ€์„ ๋งŒ๋“ค๊ฒŒ ๋˜์—ˆ๋‹ค. ๊ธฐํšํ•œ ์–ดํ”Œ๋ฆฌ์ผ€์ด์…˜์€ ๋ชจ๋ธ์ด ์„ค๋“๋ ฅ ์žˆ๋Š” ๋‹ต๋ณ€์„ ๋‚ด๋Š” ๊ฒƒ์ด ์ค‘์š”ํ•˜์—ฌ, ML-intensive application๋ผ๊ณ  ํ•  ์ˆ˜ ์žˆ๋‹ค. ์•„๋ž˜ ๋งํฌ๋กœ ์ฒจ๋ถ€ํ•œ Andrew Ng์˜ ์˜์ƒ์ฒ˜๋Ÿผ, ML์—์„œ data์™€ model(code)์˜ ๋น„์ค‘์€ ๋™๋“ฑํ•ด์ง€๊ฑฐ๋‚˜ data๊ฐ€ ๋” ์ค‘์š”ํ•˜๊ฒŒ ๋‹ค๋ฃจ์–ด์ง€๊ธฐ ๋•Œ๋ฌธ์— ๋ฐ์ดํ„ฐ๋ฅผ ์ฒด๊ณ„์ ์œผ๋กœ ๊ด€๋ฆฌํ•˜๊ณ  ์‹ถ์—ˆ๋‹ค. https://www.youtube.com/watch?v=TU6u_T-s68Y ํŠนํžˆ, 1. ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด๋ง, ๋ชจ๋ธ๋ง์„ ๋งก์€ ํŒ€์›๋“ค์ด ๋™์ผํ•œ ๋ฐ์ดํ„ฐ๋ฅผ ๋‹ค๋ฃจ๋ฉด ์ข‹๊ฒ ๋‹ค. 2. git์œผ๋กœ code versioning์„ ํ•˜๋“ฏ, data๋„ ๋ณ€ํ™”..
๊ฒฐ์ธก์น˜: ์ธก์ •๋˜์ง€ ์•Š์€ ์ˆ˜์น˜, ๋ฌด์–ธ๊ฐ€์˜ ์ด์œ ๋กœ ์ธํ•ด ์ธก์ •/๊ธฐ๋ก๋˜์ง€ ์•Š์€ ์ˆ˜์น˜๋ฅผ ๋งํ•œ๋‹ค. ๋ณธ ํฌ์ŠคํŒ…์—์„œ๋Š” ์ธ๊ณต์ง€๋Šฅ ํ•™์Šต ๋ฐ์ดํ„ฐ์…‹์˜ ๊ฒฐ์ธก์น˜๋ฅผ ๋‹ค๋ฃจ๊ณ ์ž ํ•œ๋‹ค. ์ผ๋ฐ˜์ ์œผ๋กœ ๊ฒฐ์ธก์น˜๋Š” np.nan ์œผ๋กœ ํ‘œ๊ธฐ๋œ๋‹ค. np.nan์ด ์—ด๋งˆ๋‹ค ์–ผ๋งˆ๋‚˜ ํ™•์ธํ•˜๊ธฐ ์œ„ํ•ด์„œ df.info()๋ฅผ ์‚ฌ์šฉํ•˜๋ฉฐ, ๊ฒฐ๊ณผ ์˜ˆ์‹œ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™๋‹ค. ์ƒ๋‹จ์˜ ํ‘œ๋ฅผ ๋ณด๋ฉด, 18๋ฒˆ์งธ ์—ด์ธ "TotalCharges"์— 11๊ฐœ์˜ null ๊ฐ’์ด ์žˆ๋‹ค๋Š” ๊ฒƒ์„ ํ™•์ธํ•  ์ˆ˜ ์žˆ๋‹ค. ๊ทธ๋Ÿฐ๋ฐ, ์ด๊ฒŒ ๊ฒฐ์ธก์น˜์˜ ์ „๋ถ€์ผ๊นŒ? ๐Ÿ˜ˆ 1. number ๊ฒฐ์ธก์น˜ ์ฐพ์•„๋‚ด๊ธฐ ์ฒซ ๋ฒˆ์งธ๋กœ, df.describe()์„ ์‹คํ–‰ํ•œ๋‹ค. ์ด ํ•จ์ˆ˜๋Š” ์ˆซ์ž ๊ณ„์—ด์˜ ๋ฐ์ดํ„ฐ๋“ค์˜ ํ‰๊ท , ํŽธ์ฐจ, ์ค‘์œ„๊ฐ’ ๋“ฑ์„ ์•Œ๋ ค์ฃผ๋Š”๋ฐ EDA(Exploraatory Data Analysis)์ ์ธ ๊ด€์ ์ด ํ•„์š”ํ•˜๋‹ค. tenure๋Š” ํ†ต์‹ ์‚ฌ..
Key-note๋ฅผ ๋“ฃ๊ณ  ๋‹ค์Œ ํ–‰์„ ์ง€๋ฅผ ์ •ํ–ˆ๋‹ค. [์ด์ „ ์ด์•ผ๊ธฐ: ๋ฐœํ‘œ ์„ธ๋ฏธ๋‚˜-1] [2023 ๋ชจ๋‘์ฝ˜ ํ›„๊ธฐ] ์˜ฌํ•ด๋„ ์‹ค๋ง์‹œํ‚ค์ง€ ์•Š์•˜๋‹ค, ์ตœ๊ณ ์˜ ์ธ๊ณต์ง€๋Šฅ ์ปจํผ๋Ÿฐ์Šค๐Ÿ‘ (๋ฐœํ‘œ ์„ธ๋ฏธ๋‚˜-1) 2023๋…„ 12์›” 9์ผ ํ† ์š”์ผ, ๋ชจ๋‘์˜์—ฐ๊ตฌ์†Œ์—์„œ ์ฃผ์ตœํ•˜๋Š” ๋ชจ๋‘์ฝ˜์— ๋‹ค๋…€์™”๋‹ค. Share Value, Grow Together ๋ˆ„๊ตฌ๋‚˜ ํ•จ๊ป˜ ์ง€์‹์„ ๊ณต์œ ํ•˜๊ณ  ์„ฑ์žฅํ•˜๋Š” ์—ฐ๊ตฌ ๋ฌธํ™”๋ฅผ ์ „ํŒŒํ•ฉ๋‹ˆ๋‹ค. ๋ชจ๋‘์˜ ์—ฐ๊ตฌ์†Œ๋Š” ์œ„์™€ ๊ฐ™์€ ๋ชจํ† ๋ฅผ inseon.tistory.com [MODULABS] ์–ด๋Š๋‚  ์—ฐ๊ตฌ์‹ค์„ ์ฐจ๋ ค๋ฒ„๋ ธ๋‹ค. ์›๋ž˜ ์นด์นด์˜ค๋ธŒ๋ ˆ์ธ์˜ ์ด๋ฏธ์ง€ ์ƒ์„ฑ ๋ชจ๋ธ์ธ Karlo ๊ฐœ๋ฐœ๊ธฐ๋ฅผ ๋“ค์œผ๋ ค๋‹ค๊ฐ€, ์–ด๋Š๋‚  ์—ฐ๊ตฌ์‹ค์„ ์ฐจ๋ ค๋ฒ„๋ ธ๋‹ค๊ฐ€ ๋ฐœํ‘œ ์žฅ์†Œ๊ฐ€ ๊ฐ€๊น๊ธฐ๋„ ํ•˜๊ณ , ์นด์นด์˜ค๋ธŒ๋ ˆ์ธ ๋ฐœํ‘œ ๋ผ์ด๋ธŒ๊ฐ€ ํ›„์— ๊ณต๊ฐœ๋˜์ง€ ์•Š์„๊นŒ๋ผ๊ณ  ์ƒ๊ฐํ•˜๊ณ  ์ด ๋ฐœํ‘œ๋ฅผ ๋“ค์—ˆ๋‹ค. (์•„์ง Key-not..
2023๋…„ 12์›” 9์ผ ํ† ์š”์ผ, ๋ชจ๋‘์˜์—ฐ๊ตฌ์†Œ์—์„œ ์ฃผ์ตœํ•˜๋Š” ๋ชจ๋‘์ฝ˜์— ๋‹ค๋…€์™”๋‹ค. Share Value, Grow Together ๋ˆ„๊ตฌ๋‚˜ ํ•จ๊ป˜ ์ง€์‹์„ ๊ณต์œ ํ•˜๊ณ  ์„ฑ์žฅํ•˜๋Š” ์—ฐ๊ตฌ ๋ฌธํ™”๋ฅผ ์ „ํŒŒํ•ฉ๋‹ˆ๋‹ค. ๋ชจ๋‘์˜ ์—ฐ๊ตฌ์†Œ๋Š” ์œ„์™€ ๊ฐ™์€ ๋ชจํ† ๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ๋Š”๋ฐ, ์ด๋Ÿฐ ์ปจํผ๋Ÿฐ์Šค๊ฐ€ ์•„๋‹ˆ๋ฉด ์ธ๊ณต์ง€๋Šฅ ํ•™๊ณ„, ์‚ฐ์—…๊ณ„์— ์žˆ๋Š” ๋ถ„๋“ค๊ณผ ์ด์•ผ๊ธฐํ•  ์ˆ˜ ์žˆ๋Š” ๊ธฐํšŒ๊ฐ€ ๋งŽ์ง€๋Š” ์•Š์€ ๋น„์ˆ˜๋„๊ถŒ ๋Œ€ํ•™ ์žฌํ•™์ƒ์œผ๋กœ์„œ, ์ง€์—ฐ, ํ•™์—ฐ, ํ˜ˆ์—ฐ์ด ์•„๋‹ˆ๋ผ ๋ชจ๋‘์—ฐ์ด๋ผ๊ณ  ํ•  ๋งŒํผ, ๋ˆ„๊ตฌ๋‚˜์—๊ฒŒ ์ฐธ๊ฐ€ ๊ธฐํšŒ๋ฅผ ์ฃผ๋Š” LAB, ํ’€์žŽ์Šค์ฟจ, ๊ทธ๋ฆฌ๊ณ  ์ž‘๋…„๋ถ€ํ„ฐ ์ฐธ๊ฐ€ํ•œ ๋ชจ๋‘์ฝ˜์„ ํฌํ•จํ•œ ๋ชจ๋‘์—ฐ์˜ ํ”„๋กœ๊ทธ๋žจ๋“ค์€ ์ €์—๊ฒŒ ์ •๋ง ์†Œ์ค‘ํ•˜๋‹ค๊ณ  ํ•  ์ˆ˜ ์žˆ๋‹ค! ๋˜ํ•œ, ์ธ๊ณต์ง€๋Šฅ ์ค‘ ํ•˜๋‚˜์˜ ์ฃผ์ œ๋งŒ ๋‹ค๋ฃจ๋Š” ๊ฒƒ์ด ์•„๋‹ˆ๋ผ text, image, 3D, video, robotics ๋‚˜์•„๊ฐ€ AI+X, AI ์Šคํ„ฐ๋””, AI..
์ˆ˜๊ฐ• ๊ณ„๊ธฐ ๐Ÿ›ซ ์ตœ๊ทผ ์Šค์Šค๋กœ ๋˜๋Œ์•„๋ณด์•˜์„ ๋•Œ, ๋…ผ๋ฌธ ์ดํ•ดํ•˜๊ธฐ / ์ธ๊ณต์ง€๋Šฅ ์ˆ˜ํ•™์  ์›๋ฆฌ ์ดํ•ดํ•˜๊ธฐ / ์ฝ”๋“œ ๋น ๋ฅด๊ฒŒ ์ตํ˜€์„œ ์‚ฌ์šฉํ•˜๊ธฐ ์ด๋Ÿฐ ๋Šฅ๋ ฅ์„ ๊ธฐ๋ฅธ ๋ฐ˜๋ฉด, ์ธ๊ณต์ง€๋Šฅ์˜ ๊ธฐ์ดˆ๊ฐ€ ๋ถ€์กฑํ•˜๋‹ค๋Š” ์ƒ๊ฐ์ด ๋งŽ์ด ๋“ค์—ˆ๋‹ค. ํ•ญ์•„๋ฆฌ๋ฅผ ํฌ๊ณ  ๋ฉ‹์ง€๊ฒŒ ๋งŒ๋“ค๋”๋ผ๋„, ์•„๋ž˜์— ์ž‘์€ ๊ตฌ๋ฉ ํ•˜๋‚˜๊ฐ€ ์žˆ์œผ๋ฉด ๋ฌผ์ด ์ƒˆ๋“ฏ์ด ๊ธฐ์ดˆ์— ๋Œ€ํ•œ ๋ถ€์กฑํ•จ์„ ๋งŽ์ด ๋Š๊ผˆ๋‹ค. ์ด๋ฅผ ๋ณด์™„ํ•˜๊ธฐ ์œ„ํ•ด Kaggle์˜ competition, learning์„ ํ†ตํ•ด ์ง€์†์ ์œผ๋กœ ๊ณต๋ถ€ํ•˜๊ธฐ๋กœ ๋งˆ์Œ ๋จน์—ˆ๋‹ค. Kaggle ๊ฐ•์˜ ํ›„๊ธฐ ๐Ÿ ์œ„์™€ ๊ฐ™์ด ํ•™์Šต ์ฝ”์Šค๋Š” ์„ค๋ช… ๋ถ€๋ถ„์ธ Tutorial๊ณผ ์‹ค์Šต ๋ถ€๋ถ„์ธ Exercise๋กœ ๊ตฌ์„ฑ๋˜์–ด ์žˆ๋Š”๋ฐ, ํ•™์Šต ์ฝ”์Šค์˜ ์ฃผ์ œ๋ฅผ ์„ค๋ช…ํ•˜๊ธฐ ์œ„ํ•œ ์Šคํ† ๋ฆฌํ…”๋ง์ด ์ž˜ ๊ฐ–์ถ”์–ด์ ธ ์žˆ์–ด ์ดํ•ดํ•˜๊ธฐ์— ์ข‹์•˜๊ณ  ๋‹ค๋ฅธ ์‚ฌ๋žŒ์—๊ฒŒ ๋ฐฐ์šด ๊ฒƒ์„ ์„ค๋ช…ํ•  ๋•Œ์—๋„ ๋งค์šฐ ์œ ์šฉํ•œ ์•„์ด๋””์–ด๋ฅผ ๋งŽ์ด ๋ฐฐ..
inthree3
'๐Ÿค– ์ธ๊ณต์ง€๋Šฅ' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๊ธ€ ๋ชฉ๋ก