irtk: Inverse Rendering Toolkit

irtk (Inverse Rendering Toolkit) is designed to simplify the process of conducting inverse rendering experiments with differentiable renderers.

Note

For more information on differentiable rendering and inverse rendering, refer to CVPR 2021 Tutorial on Physics-Based Differentiable Rendering

Currently, a variety of differentiable renderers are available, including psdr-jit, Mitsuba 3, and PyTorch3D. However, the different interfaces of these renderers often pose challenges when attempting to compare or convert between them.

To address this issue, irtk introduces a unified frontend built on PyTorch, along with a set of connectors that facilitate seamless communication with various differentiable renderers. It enables users to render scenes and compute gradients with respect to scene elements across different renderers with minimal code modifications. By abstracting away the complexities of individual renderer interfaces, irtk empowers researchers and developers to focus on their inverse rendering algorithms.