UnrealCV is a project to help computer vision researchers build virtual worlds using Unreal Engine 4 (UE4). It extends UE4 with a plugin by providing:

  1. A set of UnrealCV commands to interact with the virtual world.
  2. Communication between UE4 and an external program, such as Caffe.

UnrealCV can be used in two ways. The first one is using a compiled game binary with UnrealCV embedded. This is as simple as running a game, no knowledge of Unreal Engine is required. The second is installing UnrealCV plugin to Unreal Engine 4 (UE4) and use the editor of UE4 to build a new virtual world.

Please read Tutorial: Getting Started to learn using UnrealCV.

annotation Images generated from the technical demo RelisticRendering

Tutorials

Reference

Citation

If you found this project useful, please consider citing our paper

@article{qiu2016unrealcv,
  Author = {Qiu, Weichao and Yuille, Alan},
  Journal = {arXiv preprint arXiv:1609.01326},
  Title = {UnrealCV: Connecting Computer Vision to Unreal Engine},
  Year = {2016}
}

Contact

UnrealCV is an open-source project created by students from Johns Hopkins University and Peking University under the supervision of Prof. Alan Yuille and Prof. Yizhou Wang. It is maintained by the UnrealCV team, see the team member list.

If you have any suggestion or interested in using UnrealCV, please contact us.