PyoSignal Logo
PyoSignal
Back to Research

RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation

Paper ID: 2607.06558 โ€ข 67 Upvotes
Robot Learning World Model Diffusion Model Sim2Real Data Engine Agent Vision Video Inference Distillation
RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation

๐Ÿ“ ํ•ต์‹ฌ ์š”์•ฝ

๋ฌผ๋ฆฌ์  ์ œ์•ฝ ์—†์ด ๊ฐ€์ƒ ์„ธ๊ณ„ ๋ชจ๋ธ์„ ํ†ตํ•ด ๊ณ ํ’ˆ์งˆ ๋กœ๋ด‡ ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•˜๋Š” '๋””์ง€ํ„ธ ํ…”๋ ˆ์˜คํผ๋ ˆ์ด์…˜' ํ”„๋ ˆ์ž„์›Œํฌ ์ œ์•ˆ

๐Ÿ”‘ ์ฃผ์š” ๋‚ด์šฉ (Key Points)

  • ๋ฌผ๋ฆฌ์  ์ œ์•ฝ์„ ํƒˆํ”ผํ•œ '๋””์ง€ํ„ธ ํ…”๋ ˆ์˜คํผ๋ ˆ์ด์…˜' ํŒจ๋Ÿฌ๋‹ค์ž„ ์ œ์‹œ
  • ํ•ธ๋“œ ํฌ์ฆˆ ๊ธฐ๋ฐ˜์˜ ๊ณ ์ •๋ฐ€ 1์ธ์นญ ๋น„๋””์˜ค ์ƒ์„ฑ ๋ฐ ํ•˜๋“œ์›จ์–ด ๋…๋ฆฝ์  ๋ฐ์ดํ„ฐ ์ƒ์„ฑ
  • Diffusion Transformer์™€ ์ฆ๋ฅ˜(Distillation) ๊ธฐ์ˆ ์„ ํ†ตํ•œ ์‹ค์‹œ๊ฐ„(40+ FPS) ์ƒ์„ฑ ์—”์ง„ ๊ตฌํ˜„

๐Ÿ’ก ์‹ค๋ฌด์  ๊ฐ€์น˜ (Relevance)

๋ฌผ๋ฆฌ์  ๋กœ๋ด‡ ์—†์ด๋„ ๊ฐ€์ƒ ํ™˜๊ฒฝ์—์„œ ๋Œ€๊ทœ๋ชจ ๊ณ ํ’ˆ์งˆ ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ์ƒ์„ฑํ•  ์ˆ˜ ์žˆ์–ด, ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋น„์šฉ์„ ํš๊ธฐ์ ์œผ๋กœ ๋‚ฎ์ถ”๊ณ  ๋‹ค์–‘ํ•œ ๋กœ๋ด‡ ํ•˜๋“œ์›จ์–ด๋กœ์˜ ํ™•์žฅ์ด ์šฉ์ดํ•ฉ๋‹ˆ๋‹ค.

โœ… ์ถ”์ฒœ ์•ก์…˜ (Actionable Items)

  • ์ œ๊ณต๋œ ํ•ธ๋“œ ํฌ์ฆˆ ๋ฐ์ดํ„ฐ์™€ ์ƒ์„ฑ๋œ ๋น„๋””์˜ค ๊ฐ„์˜ ์ •๋ ฌ(Alignment) ํ’ˆ์งˆ ๊ฒ€์ฆ
  • ์ƒ์„ฑ๋œ ๋ฐ์ดํ„ฐ๋กœ ํ•™์Šต๋œ ์ •์ฑ…์˜ ๋‹ค์–‘ํ•œ ๋กœ๋ด‡ ํ•˜๋“œ์›จ์–ด(Retargeting) ์ ์šฉ ํ…Œ์ŠคํŠธ
  • ์‹ค์ œ ๋กœ๋ด‡ ๋ฐ์ดํ„ฐ์™€ ์ƒ์„ฑ ๋ฐ์ดํ„ฐ์˜ ํ˜ผํ•ฉ ๋น„์œจ์— ๋”ฐ๋ฅธ ์„ฑ๋Šฅ ๋ณ€ํ™” ์‹คํ—˜