LeMario: Training a JEPA World Model on Super Mario Bros

LeMario：在《超级马里奥兄弟》上训练JEPA世界模型

HN Points: 86 / 11 comments | Author: kevinjosethomas | HN Discussion: item?id=48913763 | Source: www.benjamin-bai.com

Original Article

I wanted to reproduce LeWorldModel , a small Joint-Embedding Predictive Architecture (JEPA) that learns world dynamics from pixels and actions. The original paper used it for reward-free planning in Push-T. But, since I loved video games, and at the same time wanted to learn more deeply about LeCun's JEPA architecture, I decided to write the whole architecture from scratch and train it on Super Mario Bros.

⋯ 继续阅读请登录会员 ⋯