pull/this/repo
Repo3D, CAD and animation#motion-capture#blender#windows#python

RGB MoCap: free motion capture from ordinary video on a Windows PC

By Pull This RepoPosted 5 min read

Short answer

RGB MoCap is a free Windows app that turns an ordinary video of a person into editable 3D animation. You load a clip, click Reconstruct 3D, and it rebuilds the body, then moves your own Mixamo, VRM or PMX character, exports FBX or BVH, or streams bones into Blender. It needs an NVIDIA card, about 41 GiB of models, and the main models are non-commercial.

RGB MoCap is a native Windows app that pulls 3D body motion out of a normal video of a person. No suit, no markers, no studio: you open a clip, click one button, and get a skeleton you can put on your own character or send into Blender. The AI runs on your own graphics card, which is both the appeal and the catch.

What is RGB MoCap?

RGB MoCap is a free desktop app by toyxyz that, in the README's words, "turns video into editable human animation". It wraps several research models for human pose and shape, then adds the parts a working animator needs: trimming, picking which people to track, foot and hand contact correction, retargeting and export.

The repo was created on 26 October 2026. It had 1,631 stars when we checked on 18 November 2026, up from 1,355 when our video went out.

What it does, from the README:

  • Rebuilds one or several people from a single video, with a body mesh and animation bones you can check against the footage.
  • Cuts foot sliding with editable foot and palm contacts.
  • Retargets the motion onto Mixamo FBX, VRM and PMX humanoid characters.
  • Exports FBX or BVH, characters as FBX with or without meshes, and PMX motion as VMD for MMD.
  • Streams bones into Blender live while you play or scrub, then bakes them into Blender Actions.
  • Tracks faces too: a newer Track Face option exports ARKit-style coefficients as TXT or Unreal Live Link Face CSV.

Will your PC run RGB MoCap?

Only if it is a Windows PC with an NVIDIA card. The README says it "Requires 64-bit Windows, a compatible NVIDIA GPU/driver and OpenGL 4.3." The one setup the author lists as tested is an RTX 5090 with 96 GB of RAM, which is a verified setup, not a minimum.

ModelPeak VRAM in the project's testsHow the project describes it
GVHMRabout 5.1 GiBlowest overall quality, sometimes better on odd poses
ExMRabout 11.3 GiB (3.9 GiB in Low Memory on a short test)fast, good quality, the default
FlowHMR10.7 to 14.9 GiB (2.8 GiB in Low Memory on a short test)slow, best quality in their tests

Disk space matters more than most apps. ExMR, FlowHMR and GVHMR with their runtimes, Blender and FFmpeg come to 41.23 GiB. Since our video, the README has grown its model list: with all six offline models the total is now about 72.46 GiB, and the experimental PEAR live preview adds about 2.85 GiB more.

On an 8 GB card, the project's numbers point to starting with GVHMR, or ExMR with Resource Mode set to Low Memory.

How do you install RGB MoCap?

The README's steps, run from Command Prompt in a writable folder (not Program Files). First install Git for Windows, then clone:

cmd
git clone https://github.com/toyxyz/toyxyz_RGBMocap.git
cd toyxyz_RGBMocap

Run the installer. It prepares the runtimes for ExMR, FlowHMR and GVHMR plus Blender and FFmpeg. It does not download the AI weights:

cmd
install.cmd

Then start the app and leave the console window open, because errors show there:

cmd
RGBMoCap.cmd

To update later, close the app and run update.cmd in the same folder. The repo also ships an AGENTS.md and an agent guide so a local coding agent can check your GPU and disk, run the installer and walk you through the model files. Keep passwords and account tokens out of that chat, as the README says.

Which model files do you download by hand?

Open Model Manager in the app. Auto Download fetches the public files; the rest need a free account and a licence click on the provider's site, then Manual Download and Import.

  • SMPL-X neutral body model, from smpl-x.is.tue.mpg.de, for ExMR and GVHMR.
  • MANO right hand file, from mano.is.tue.mpg.de, for finger tracking.
  • SMPL+H neutral model, also from the MANO site, for FlowHMR.
  • SAM 3D Body files on Hugging Face (request access), for ExMR and FlowHMR.

The quickest path to a first result is SMPL-X plus GVHMR, the lightest model.

How do you turn a video into 3D animation?

You load the clip and press Reconstruct 3D. The user guide's start-here flow:

  1. Pick the AI model, then File > Open Video or drag the clip in.
  2. Trim the ends of the Video track to the part you need.
  3. With several people, click Find person and tick who to rebuild.
  4. Click Reconstruct 3D and compare the video, mesh and bone overlay.
  5. Fix foot or hand contacts if needed, then Apply Correction.
  6. File > Export for FBX or BVH.

To animate your own character, use File > Import Character (Mixamo FBX, VRM or PMX), right-click it, choose Retarget and the person, then Export Character. For Blender 4.5 or newer, install blender_addon/rgbmocap_bone_stream.zip from the repo, open the Stream tab in RGB MoCap, and click Connect in Blender's RGB MoCap panel.

Clips work best with a fixed camera, the whole body in frame and nobody crossing in front of anyone else.

What is the catch?

  • Windows and NVIDIA only. No Mac, Linux or AMD path.
  • Big downloads. About 41 GiB for the main three models, up to about 72 GiB for all six offline ones.
  • Not instant. On the author's RTX 5090, a 15 second test clip took 1 min 47 s with ExMR and 5 min 16 s with FlowHMR.
  • Manual sign-ups. Several model files need a free account on the provider's site.
  • Licences. The app code is MIT, but GVHMR is for "educational, research and nonprofit use only", ExMR follows GVHMR-derived terms and the SMPL body models are non-commercial. Fine for learning and previs; read every licence before paid work.

How does RGB MoCap compare with other motion capture options?

OptionPriceRuns onGood for
RGB MoCapfree app, models non-commercialWindows plus NVIDIAone video in, retargeted character and Blender stream out
Rokoko Pro (Vision AI)$70 a month billed monthly, read 2026-11-11Rokoko's own servicemotion from a video file, 15,000 seconds a month on Pro
FreeMoCapfree, AGPL-3.0Windows, Mac, Linuxmarkerless capture with ordinary webcams
GVHMRfree, same non-commercial termsPythonthe raw research model, to script it yourself
Pose2Simfree, BSD-3-ClausePythonsports and biomechanics, export to OpenSim

What did we run for the video?

We did not install or run RGB MoCap. Its install is about 41 GiB on an NVIDIA machine, so the footage in our video is the repo's own published sample videos and screenshots, plus captures of its GitHub pages. Every number on this page comes from the README, user guide or third-party notices, not from our own runs.

If you want to drive a character in other ways, look at LivLiv Player, a browser VTuber player that lip syncs to your voice, and StykAnimate, a free stick figure animator. For making the 3D model in the first place, see SculptForge.

Pull it. Stash it.

Questions people ask

Can I get motion capture from a phone video for free?

Yes, if the video shows a person and you have the right PC. RGB MoCap's own code is MIT licensed and costs nothing, and all the AI runs locally. It needs 64-bit Windows, a compatible NVIDIA graphics card and driver, and OpenGL 4.3.

Does RGB MoCap work on a Mac or with an AMD card?

No. The README says it requires 64-bit Windows and a compatible NVIDIA GPU. There is no Mac, Linux or AMD route in the project's instructions.

Can I use RGB MoCap animation in a commercial game?

Check each licence first. The app code is MIT, but the third-party notices list GVHMR as educational, research and nonprofit use only, ExMR under GVHMR-derived terms, and the SMPL body models under non-commercial terms. GEM-X is the optional model under the NVIDIA Open Model License. This is not legal advice.

How much VRAM does RGB MoCap need?

The project gives measured peaks, not a minimum. In its tests GVHMR peaked at about 5.1 GiB, ExMR at about 11.3 GiB and FlowHMR at 10.7 to 14.9 GiB. Low Memory mode brought ExMR and FlowHMR under 4 GiB on short clips.

Can RGB MoCap send animation straight into Blender?

Yes. A Blender add-on in the repo receives the bones live while you play or scrub the timeline in RGB MoCap, and you can then bake the full motion into Blender Actions.

Sources

  1. 1toyxyz_RGBMocap repository and README
  2. 2RGB MoCap user guide (docs/USER_GUIDE.md)
  3. 3RGB MoCap third-party notices (model licences)
  4. 4GitHub API: toyxyz/toyxyz_RGBMocap (stars, language, created date, checked 2026-11-18)
  5. 5Rokoko pricing (read 2026-11-11)
  6. 6freemocap/freemocap
  7. 7zju3dv/GVHMR
  8. 8perfanalytics/pose2sim

Get tomorrow's repo in your feed

One free, open source repo a day as a short video, shown working, with the catch named. Pull it. Stash it.