UnrealCV - VALSE 18 Demo

Welcome to the VALSE18 demo page of UnrealCV. This page contains what you saw in our demo station.

Video

The first video demonstrates various applications of UnrealCV, including:

  • Object mask generation in a virtual supermarket,
  • Bounding box generation,
  • Semantic point cloud generation,
  • Running a detection algorithm in a virtual scene,
  • Controlling hazardous factors to diagnose the robustness of stereo depth estimation algorithms,
  • Learning indoor navigation, robot manipulation and active object tracking via reinforcement learning.

Click here to watch the video.

The second video includes various 3D scenes that can be used in UnrealCV, including:

  • Diverse scenes,
  • Three example scenes, Matinee, RealisticRendering, Roborecall,
  • Physicial interaction,
  • Controlling the weather and the illumination.

Click here to watch the video.

These papers use UnrealCV as a tool in the research

  • Siyuan Qiao, Wei Shen, Weichao Qiu, Chenxi Liu, and Alan Yuille. “ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond.” ICCV17
  • Roberts Mike, Anh Truong, Debadeepta Dey, Sudipta Sinha, Ashish Kapoor, Neel Joshi, and Pat Hanrahan. “Submodular Trajectory Optimization for Aerial 3D Scanning.” ICCV17
  • Zhang Yi, Weichao Qiu, Qi Chen, Xiaolin Hu, and Alan Yuille. “Unrealstereo: A synthetic dataset for analyzing stereo vision.” arXiv preprint arXiv:1612.04647 (2016).
  • Wenhan Luo, Peng Sun, Fangwei Zhong, Wei Liu, Yizhou Wang, “End-to-end Active Object Tracking via Reinforcement Learning.” arXiv preprint arXiv

More description about UnrealCV can be found in:

Our homepage: unrealcv.org

Weichao Qiu, Fangwei Zhong, Yi Zhang, Siyuan Qiao,Zihao Xiao, Tae Soo Kim, Yizhou Wang, Alan Yuille. “UnrealCV: Virtual Worlds for Computer Vision.” ACM Multimedia 2017 Open Source Software Competition

See more papers and projects which utilize synthetic images here.

Notice

The license of UE4 projects used in the demo belongs to the content creator, please see the model zoo to see where you can get these UE4 projects.

UnrealCV is an open source project created by students of Johns Hopkins University and Peking University. The development of it is under the supervision of Prof. Alan Yuille and Prof. Yizhou Wang.

If anything of this page is unclear, please contact Fangwei Zhong (zfw1226@gmail.com).