PyoSignal Logo
PyoSignal
Back to Research

AlayaWorld: Long-Horizon and Playable Video World Generation

Paper ID: 2607.06291 โ€ข 69 Upvotes
Generative Video Game Engine Embodied AI Open Source Video Evaluation Inference
AlayaWorld: Long-Horizon and Playable Video World Generation

๐Ÿ“ ํ•ต์‹ฌ ์š”์•ฝ

๋ฐ์ดํ„ฐ ์ค€๋น„๋ถ€ํ„ฐ ๋ฐฐํฌ๊นŒ์ง€ ์•„์šฐ๋ฅด๋Š” ์˜คํ”ˆ์†Œ์Šค ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ํ†ตํ•ด ์‹ค์‹œ๊ฐ„ ์ƒํ˜ธ์ž‘์šฉ์ด ๊ฐ€๋Šฅํ•œ ์ƒ์„ฑํ˜• ๋น„๋””์˜ค ์›”๋“œ ๋ชจ๋ธ์„ ๊ตฌํ˜„ํ•จ

๐Ÿ“– ์ƒ์„ธ ๋‚ด์šฉ

๊ธฐ์กด ๊ฒŒ์ž„ ์›”๋“œ ์ œ์ž‘ ๋ฐฉ์‹์€ ๋ง‰๋Œ€ํ•œ ๋น„์šฉ๊ณผ ์ˆ˜๋™ ์ž‘์—…์ด ํ•„์š”ํ•˜์—ฌ ์œ ์—ฐํ•œ ์ˆ˜์ •๊ณผ ์ปค์Šคํ…€์ด ์–ด๋ ต๋‹ค๋Š” ๋ฌธ์ œ๊ฐ€ ์žˆ์—ˆ์Šต๋‹ˆ๋‹ค. ์ตœ๊ทผ ๋น„๋””์˜ค ์›”๋“œ ๋ชจ๋ธ์€ ์ƒํƒœ์™€ ์ƒํ˜ธ์ž‘์šฉ์„ ์กฐ๊ฑด์œผ๋กœ ๋ฏธ๋ž˜ ๊ด€์ธก์น˜๋ฅผ ์ƒ์„ฑํ•˜์—ฌ ํ”Œ๋ ˆ์ด ๊ฐ€๋Šฅํ•œ ํ™˜๊ฒฝ์„ ๋งŒ๋“œ๋Š” ์ƒˆ๋กœ์šด ํŒจ๋Ÿฌ๋‹ค์ž„์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค. ๋ณธ ๋…ผ๋ฌธ์—์„œ๋Š” ๋ฐ์ดํ„ฐ ์ค€๋น„, ๋ชจ๋ธ ์•„ํ‚คํ…์ฒ˜, ์ถ”๋ก  ๊ฐ€์†ํ™”, ๋ฐฐํฌ๋ฅผ ํ†ตํ•ฉํ•œ ํ’€์Šคํƒ ์˜คํ”ˆ์†Œ์Šค ํ”„๋ ˆ์ž„์›Œํฌ์ธ AlayaWorld๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. AlayaWorld๋Š” ์‹ค์‹œ๊ฐ„ ์ƒํ˜ธ์ž‘์šฉ์„ ์ง€์›ํ•˜์—ฌ ์ „ํˆฌ, ๋งˆ๋ฒ•, ์†Œํ™˜ ๋“ฑ ๋‹ค์–‘ํ•œ ์•ก์…˜์„ ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค. ์—ฐ๊ตฌ์ง„์€ ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ํŒŒ์ดํ”„๋ผ์ธ๊ณผ ํ‰๊ฐ€ ๋„๊ตฌ๋ฅผ ํ•จ๊ป˜ ๊ณต๊ฐœํ•˜์—ฌ ์ƒ์„ฑํ˜• ์›”๋“œ ๋ชจ๋ธ ์—ฐ๊ตฌ์˜ ์‹ค์งˆ์ ์ธ ํ† ๋Œ€๋ฅผ ๋งˆ๋ จํ–ˆ์Šต๋‹ˆ๋‹ค.

๐Ÿ”‘ ์ฃผ์š” ๋‚ด์šฉ (Key Points)

  • ๋ฐ์ดํ„ฐ ์ค€๋น„๋ถ€ํ„ฐ ๋ฐฐํฌ๊นŒ์ง€ ํฌํ•จํ•˜๋Š” ๋ชจ๋“ˆํ˜• ํ’€์Šคํƒ ํ”„๋ ˆ์ž„์›Œํฌ ์„ค๊ณ„
  • ์‹ค์‹œ๊ฐ„ ์ƒํ˜ธ์ž‘์šฉ(์ „ํˆฌ, ๋งˆ๋ฒ• ๋“ฑ)์ด ๊ฐ€๋Šฅํ•œ ์˜คํ”ˆ์—”๋“œ ๋น„๋””์˜ค ์ƒ์„ฑ ๊ธฐ์ˆ 
  • ์žฌํ˜„ ๊ฐ€๋Šฅํ•œ ํŒŒ์ดํ”„๋ผ์ธ, ์ฐธ์กฐ ๊ตฌํ˜„์ฒด ๋ฐ ํ‰๊ฐ€ ๋„๊ตฌ์˜ ์˜คํ”ˆ์†Œ์Šค ๊ณต๊ฐœ

๐Ÿ’ก ์‹ค๋ฌด์  ๊ฐ€์น˜ (Relevance)

์ˆ˜๋™ ์—์…‹ ์ œ์ž‘ ์—†์ด๋„ ์ƒํ˜ธ์ž‘์šฉ ๊ฐ€๋Šฅํ•œ ๊ฐ€์ƒ ํ™˜๊ฒฝ์„ ๊ตฌ์ถ•ํ•  ์ˆ˜ ์žˆ์–ด, ๊ฒŒ์ž„ ๊ฐœ๋ฐœ ๋ฐ Embodied AI ํ•™์Šต์„ ์œ„ํ•œ ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ํ™˜๊ฒฝ ๊ตฌ์ถ•์— ํ˜์‹ ์ ์ธ ๋ณ€ํ™”๋ฅผ ๊ฐ€์ ธ์˜ฌ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

โœ… ์ถ”์ฒœ ์•ก์…˜ (Actionable Items)

  • ์ œ๊ณต๋œ ์˜คํ”ˆ์†Œ์Šค ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ๋กœ์ปฌ ํ™˜๊ฒฝ์— ๊ตฌ์ถ•ํ•˜์—ฌ ์ถ”๋ก  ์†๋„ ํ…Œ์ŠคํŠธ
  • ๋‹ค์–‘ํ•œ ์‚ฌ์šฉ์ž ์•ก์…˜(Combat, Summoning ๋“ฑ)์— ๋”ฐ๋ฅธ ๋ฌผ๋ฆฌ์  ์ผ๊ด€์„ฑ ๊ฒ€์ฆ
  • ๊ธฐ์กด ๊ฒŒ์ž„ ์—”์ง„(Unity/Unreal)๊ณผ์˜ ์—ฐ๋™ ๊ฐ€๋Šฅ์„ฑ ํƒ์ƒ‰