๋ณธ๋ฌธ์œผ๋กœ ๊ฑด๋„ˆ๋›ฐ๊ธฐ

ยฉ 2026 Molayo

Deep Tech์š”์•ฝ2026. 05. 25. 07:56

๐Ÿšจ Qwen3.6 ์‹œ๋ฆฌ์ฆˆ๋ฅผ ์œ„ํ•œ ๋งค์šฐ ๊ฐ•๋ ฅํ•œ ํฌ๋ž™์ด ์ถœ์‹œ๋˜์—ˆ์Šต๋‹ˆ๋‹ค!

์š”์•ฝ

dealignai๊ฐ€ Qwen3.6-27B ๋ฐ 35B ๋ชจ๋ธ์„ MXFP4 ๋ฐ MXFP8 ํ˜•์‹์œผ๋กœ ์ตœ์ ํ™”ํ•˜์—ฌ Hugging Face์— ๊ณต๊ฐœํ–ˆ์Šต๋‹ˆ๋‹ค. MTP(Multi-Token Prediction) ๊ธฐ์ˆ ์„ ์ ์šฉํ•˜์—ฌ ์†๋„ ํ–ฅ์ƒ๊ณผ ํšจ์œจ์ ์ธ ์–‘์žํ™”๋ฅผ ๊ตฌํ˜„ํ–ˆ์Šต๋‹ˆ๋‹ค.

ํ•ต์‹ฌ ํฌ์ธํŠธ

  • MXFP4 ๋ฐ MXFP8 ์–‘์žํ™”๋ฅผ ํ†ตํ•œ ์„ฑ๋Šฅ ์ตœ์ ํ™”
  • MTP ๊ธฐ์ˆ  ์ ์šฉ์œผ๋กœ ์‹คํ–‰ ์†๋„ ๋Œ€ํญ ํ–ฅ์ƒ
  • ๋‚ฎ์€ VRAM ํ™˜๊ฒฝ์—์„œ๋„ ํšจ์œจ์ ์ธ ๋ชจ๋ธ ๊ตฌ๋™ ๊ฐ€๋Šฅ
  • ๊ฒ€์—ด์ด ์™„ํ™”๋œ(uncensored) ๋™์ž‘ ํŠน์„ฑ ์ œ๊ณต

๐Ÿšจ Qwen3.6 ์‹œ๋ฆฌ์ฆˆ๋ฅผ ์œ„ํ•œ ๋งค์šฐ ๊ฐ•๋ ฅํ•œ ํฌ๋ž™์ด ์ถœ์‹œ๋˜์—ˆ์Šต๋‹ˆ๋‹ค!

@dealignai๊ฐ€ Qwen3.6-27B ๋ฐ 35B ๋ชจ๋ธ์˜ MXFP4 & MXFP8 ๋ฒ„์ „์„ MTP (Multi-Token Prediction)๋ฅผ ํ†ตํ•ด ์ตœ์ ํ™”ํ•˜์—ฌ Hugging Face์— ์—…๋กœ๋“œํ–ˆ์Šต๋‹ˆ๋‹ค.

ํŠนํžˆ ์ฃผ๋ชฉํ•  ๋งŒํ•œ ์ :

  • ์ƒ๋‹นํ•œ ์ˆ˜์ค€์˜ ์†๋„ ํ–ฅ์ƒ
  • ๋” ๋œ ์ œํ•œ์ ์ธ (uncensored) ๋™์ž‘
  • ๋” ํšจ์œจ์ ์ธ ์–‘์žํ™” (Quantization) ๋•๋ถ„์— ๋‚ฎ์€ VRAM์—์„œ๋„ ๋†’์€ ์„ฑ๋Šฅ ๋ฐœํœ˜

๋กœ์ปฌ ํ™˜๊ฒฝ์—์„œ ๊ณ ์†์œผ๋กœ Qwen3.6์„ ์‹คํ–‰ํ•˜๊ณ ์ž ํ•˜๋Š” ๋ถ„๋“ค์—๊ฒŒ ๋งค์šฐ ๋งค๋ ฅ์ ์ธ ๋ฐœ์ „์ž…๋‹ˆ๋‹ค.

๐Ÿ”— ๋ชจ๋ธ:
โ€ข 35B MXFP4 โ†’ https://t.co/FanwVfwK2P
โ€ข 35B MXFP8 โ†’ https://t.co/j6PWkhzING
โ€ข 27B ๋ฒ„์ „ https://t.co/oMNrVceOEb
์ด๊ฒƒ์€ ๋ณ„๋„์˜ 27B ๋ฒ„์ „์ž…๋‹ˆ๋‹ค.

AI ์ž๋™ ์ƒ์„ฑ ์ฝ˜ํ…์ธ 

๋ณธ ์ฝ˜ํ…์ธ ๋Š” X @DeepTechTR (AI/์˜คํ”ˆ์†Œ์Šค)์˜ ์›๋ฌธ์„ AI๊ฐ€ ์ž๋™์œผ๋กœ ์š”์•ฝยท๋ฒˆ์—ญยท๋ถ„์„ํ•œ ๊ฒƒ์ž…๋‹ˆ๋‹ค. ์› ์ €์ž‘๊ถŒ์€ ์›์ €์ž‘์ž์—๊ฒŒ ์žˆ์œผ๋ฉฐ, ์ •ํ™•ํ•œ ๋‚ด์šฉ์€ ๋ฐ˜๋“œ์‹œ ์›๋ฌธ์„ ํ™•์ธํ•ด ์ฃผ์„ธ์š”.

์›๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
0

๋Œ“๊ธ€

0