3D Vision and Language Pretraining with Large-Scale Synthetic Data

Install

1. Install conda package

conda env create --name 3dsyn --file=environments.yml

2. install pointnet2

cd vision/pointnet2
python3 setup.py install

Prepare dataset

1. Follow Vil3dref and download scannet data under data/scanfamily/scan_data, this folder should look like

./data/scanfamily/scan_data/
├── instance_id_to_gmm_color
├── instance_id_to_loc
├── instance_id_to_name
└── pcd_with_global_alignment

2. Download scanrefer+referit3d, scanqa, and sqa3d, and put them under /data/scanfamily/annotations