Skip to content

Commit

Permalink
Added garden image
Browse files Browse the repository at this point in the history
  • Loading branch information
sxyu committed Jan 15, 2023
1 parent c57f556 commit 0d1cffe
Show file tree
Hide file tree
Showing 2 changed files with 14 additions and 6 deletions.
20 changes: 14 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ A JAX implementation is also available at <https://github.com/sarafridov/plenoxe

![Overview](https://raw.githubusercontent.com/sxyu/svox2/master/github_img/pipeline.png)

### Examples
### Examples use cases

Check out PeRFCeption [Jeong, Shin, Lee, et al], which uses Plenoxels with tuned parameters to generate a large
dataset of radiance fields:
Expand Down Expand Up @@ -58,7 +58,6 @@ To install the main library, simply run
pip install .
```
In the repo root directory.

## Getting datasets

We have backends for NeRF-Blender, LLFF, NSVF, and CO3D dataset formats, and the dataset will be auto-detected.
Expand All @@ -84,7 +83,7 @@ cd opt/scripts
python ingp2nsvf.py <ingp_data_dir> <output_data_dir>
```

## Voxel Optimization (aka Training)
## Optimization

For training a single scene, see `opt/opt.py`. The launch script makes this easier.

Expand All @@ -111,6 +110,7 @@ Usage,

By default this saves all frames, which is very slow. Add `--no_imsave` to avoid this.


## Rendering a spiral

Use `opt/render_imgs_circle.py`
Expand Down Expand Up @@ -183,10 +183,18 @@ To render a video, please see the "rendering a spiral" section.
To convert to a svox1-compatible PlenOctree (not perfect quality since interpolation is not implemented)
you can try `to_svox1.py <ckpt>`

### Recent updates

- Removed COLMAP undistorter since it is very unhelpful (using SIMPLE_PINHOLE for simplicity, could easily use OPENCV camera instead)
- Updated the camera normalization
Example result with the mip-nerf-360 garden data (using custom_alt config as provided)
![Overview](https://raw.githubusercontent.com/sxyu/svox2/master/github_img/garden.png)

## Potential extensions

Due to limited time we did not make the follow extensions which should make the quality and speed better.

- Use exp activation instead of ReLU. May help with the semi-transparent look issue
- Add mip-nerf 360 distortion loss to reduce floaters. PeRFCeption also tuned some parameters to help with the quality
- Use FP16 training. This codebase uses FP32 still. This should improve speed and memory use
- Add a GUI viewer

## Random tip: how to make pip install faster for native extensions

Expand Down
Binary file added github_img/garden.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 0d1cffe

Please sign in to comment.