Varun Jampani - Publications

Publications/Reports

Refer to my Google Scholar page for a more up-to-date list of publications.

NAVI: Category-Agnostic Image Collections with High-Quality 3D Shape and Pose Annotations

V. Jampani*, K. K. Maninis*, A. Engelhardt, A. Karpur, K. Truong, K. Sargent, S. Popov, A. Araujo, R. M. Brualla, K. Patel, D. Vlasic, V. Ferrari, A. Makadia, C. Liu, Y. Li, H. Zhou (*equal contribution)

Neural Information Processing Systems, NeurIPS’23

pdf / project page / dataset (github)

ARTIC3D: Learning Robust Articulated 3D Shapes from Noisy Web Image Collections

C-H. Yao, A. Raj, W-C. Hung, Y. Li, M. Rubinstein, M-H. Yang, V. Jampani

Neural Information Processing Systems, NeurIPS’23

pdf / project page / code (github)

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models

W. Feng*, W. Zhu*, T-J. Fu, V. Jampani, A. Akula, X. He, S. Basu, X. E. Wang, W. Y. Wang (*equal contribution)

Neural Information Processing Systems, NeurIPS’23

pdf / project page / code (github)

A Tale of Two Features: Stable Diffusion Complements DINO for Zero-Shot Semantic Correspondence

J. Zhang, C. Herrmann, J. Hur, L. P. Cabrera, V. Jampani, D. Sun, M-H. Yang

Neural Information Processing Systems, NeurIPS’23

pdf / project page / code (github)

DreamBooth3D: Subject-Driven Text-to-3D Generation

A. Raj, S. Kaza, B. Poole, M. Niemeyer, N. Ruiz, B. Mildenhall, S. Zada, K. Aberman, M. Rubinstein, J. Barron, Y, Li, V. Jampani

International Conference on Computer Vision, ICCV’23

pdf / project page / video

ASIC: Aligning Sparse in-the-wild Image Collections

K. Gupta, V. Jampani, C. Esteves, A. Shrivastava, A. Makadia, N. Snavely, A. Kar

International Conference on Computer Vision, ICCV’23

pdf / project page / video

LU-NeRF: Scene and Pose Estimation by Synchronizing Local Unposed NeRFs

Z. Cheng, C. Esteves, V. Jampani, A. Kar, S. Maji, A. Makadia

International Conference on Computer Vision, ICCV’23

pdf / project page

MetaCLUE: Towards Comprehensive Visual Metaphors Research

A. Akula, B. Driscoll, P. Narayana, S. Changpinyo, Z. Jia, S. Damle, G. Pruthi, S. Basu, L. Guibas, W. T. Freeman, Y. Li, V. Jampani

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / video

Hi-LASSIE: High-Fidelity Articulated Shape and Skeleton Discovery from Sparse Image Ensemble

C-H. Yao, W-C. Hung, Y. Li, M. Rubinstein, M-H. Yang, V. Jampani

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / video / code (github)

LOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Grounding

G. Li, V. Jampani, D. Sun, L. Sevilla-Lara

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / video / code (github)

DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation

N. Ruiz, Y. Li, V. Jampani, Y. Pritch, M. Rubinstein, K. Aberman (oral, best student paper honorable mention)

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / code (dataset - github)

ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency

Z. Huang, V. Jampani, N. A. Thai, Y. Li, S. Stojanov, J. M. Rehg

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / video / code (github)

NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs

H. Rangwani, L. Bansal, K. Sharma, T. Karmali, V. Jampani, R. V. Babu

Computer Vision and Pattern Recognition, CVPR’23

pdf / project page / code (github)

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis

W. Feng, X. He, T. J. Fu, V. Jampani, A. Akula, P. Narayana, S. Basu, X. E. Wang, W. Y. Wang

International Conference on Learning Representations, ICLR’23

pdf / project page / code (github)

LASSIE: Learning Articulated Shapes from Sparse Image Ensemble via 3D Part Discovery

C-H. Yao, W-C. Hung, Y. Li, M. Rubinstein, M-H. Yang, V. Jampani

Neural Information Processing Systems, NeurIPS’22

pdf / project page / video / code (github)

SAMURAI: Shape and Material from Unconstrained Real-world Arbitrary Image Collections

M. Boss, A. Engelhardt, A. Kar, Y. Li, D. Sun, J. Barron, H. Lensch, V. Jampani

Neural Information Processing Systems, NeurIPS’22

pdf / project page / video / code (github)

Polynomial Neural Fields for Subband Decomposition and Manipulation

G. Yang, S. Benaim, V. Jampani, K. Genova, J. Barron, T. Funkhouser, B. Hariharan, S. Belongie

Neural Information Processing Systems, NeurIPS’22

pdf / code (github)

Subsidiary Prototype Alignment for Universal Domain Adaptation

J. N. Kundu*, S. Bhambri*, A. Kulkarni*, H. Sarkar, V. Jampani, R. V. Babu (*equal contribution)

Neural Information Processing Systems, NeurIPS’22

pdf / project page / video

CPL: Counterfactual Prompt Learning for Vision and Language Models

X. He, D. Yang, W. Feng, T. J. Fu, A. Akula, V. Jampani, P. Narayana, S. Basu, W. Y. Wang, X. E. Wang

Empirical Methods in Natural Language Processing, EMNLP’22

pdf / code (github)

Multi-Frame Video Prediction with Learnable Motion Encodings

R. Jasti, V. Jampani, D. Sun, M-H. Yang

International Conference on Image Processing, ICIP’22

Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues

Z. Huang, S. Stojanov, A. Thai, V. Jampani, J. M. Rehg

European Conference on Computer Vision, ECCV’22

pdf / project page / code (github)

Improving GANs for Long-Tailed Data through Group Spectral Regularization

H. Rangwani, N. Jaswani, T. Karmali, V. Jampani, R. V. Babu

European Conference on Computer Vision, ECCV’22

pdf / project page / code (github)

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

T. Karmali, R. Parihar, S. Agrawal, H. Rangwani, V. Jampani, M. Singh, R. V. Babu

European Conference on Computer Vision, ECCV’22

pdf / project page / code (github)

Concurrent Subsidiary Supervision for Unsupervised Source-Free Domain Adaptation

J. N. Kundu*, S. Bhambri*, A. Kulkarni*, H. Sarkar, V. Jampani, R. V. Babu (*equal contribution)

European Conference on Computer Vision, ECCV’22

pdf / project page / video / code (github)

Balancing Discriminability and Transferability for Source-Free Domain Adaptation

J. N. Kundu*, A. Kulkarni*, S. Bhambri*, D. Mehta, S. Kulkarni, V. Jampani, R. V. Babu (*equal contribution)

International Conference on Machine Learning, ICML’22

pdf / project page / video / code (github)

Learning ABCs: Approximate Bijective Correspondence for Isolating Factors of Variation with Weak Supervision

K. A. Murphy, V. Jampani, S. Ramalingam, A. Makadia

Computer Vision and Pattern Recognition, CVPR’22

pdf / code (github)

SOMSI: Spherical Novel View Synthesis with Soft Occlusion Multi-Sphere Images

T. A. Habtegebrial, C. Gava, M. Rogge, D. Stricker, V. Jampani

Computer Vision and Pattern Recognition, CVPR’22

pdf / project page / video / code (github)

Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation

J. N. Kundu, S. Seth*, Y. Pradyumna*, V. Jampani, A. Chakraborty, R. V. Babu (*equal contribution)

Computer Vision and Pattern Recognition, CVPR’22

pdf / project page / code (gridve)

VIDT: An efficient and effective fully transformer-based object detector

H. Song, D. Sun, S. Chun, V. Jampani, D. Han, B. Heo, W. Kim, M. H. Yang

International Conference on Learning Representations, ICLR’22

pdf / code (github)

Amplitude Spectrum Transformation for Open Compound Domain Adaptive Semantic Segmentation

J. N. Kundu*, A. Kulkarni*, S. Bhambri*, V. Jampani, R. V. Babu (*equal contribution)

Association for the Advancement of Artificial Intelligence, AAAI’22

pdf / project page / video

LEAD: Self-supervised landmark estimation by aligning distributions of feature similarity

T. Karmali*, A. Atrishi*, S. Harsha, S. Agrawal, V. Jampani, R. V. Babu (*equal contribution)

Winter Conference on Application of Computer Vision, WACV’22

pdf / project page / code (gdrive) / video

Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decomposition

M. Boss, V. Jampani, R. Braun, C. Liu, J. T. Barron, H. Lensch

Neural Information Processing Systems, NeurIPS’21

pdf / project page / video / code (github)

ViSER: Video-Specific Surface Embeddings for Articulated 3D Shape Reconstruction

G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, C. Liu, D. Ramanan

Neural Information Processing Systems, NeurIPS’21

pdf / project page / code (github)

Robust Visual Reasoning via Language Guided Neural Module Networks

A. Akula, V. Jampani, S. Changpinyo, S. C. Zhu

Neural Information Processing Systems, NeurIPS’21

Aligning Silhouette Topology for Self-Adaptive 3D Human Pose Recovery

M. Rakesh*, J. N. Kundu*, V. Jampani, R. V. Babu (*equal contribution)

Neural Information Processing Systems, NeurIPS’21

pdf / project page / video

Non-local Latent Relation Distillation for Self-Adaptive 3D Human Pose Estimation

J. N. Kundu, S. Seth, A. Jamkhandi, Y. Pradyumna, V. Jampani, R. V. Babu, A. Chakraborty

Neural Information Processing Systems, NeurIPS’21

pdf / project page / code (github)

SLIDE: Single Image 3D Photography with Soft Layering and Depth-aware Inpainting

V. Jampani*, H. Chang*, K. Sargent, A. Kar, R. Tucker, M. Krainin, D. Kaeser, W. T. Freeman, D. Salesin, B. Curless, C. Liu (*equal contribution)

International Conference on Computer Vision, ICCV’21 (oral)

pdf / project page / video / results

NeRD: Neural Reflectance Decomposition from Image Collections

M. Boss, R. Braun, V. Jampani, J. T. Barron, C. Liu, H. Lensch

International Conference on Computer Vision, ICCV’21

pdf / project page / video / code (soon)

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

A. Liu*, R. Tucker*, V. Jampani, A. Makadia, N. Snavely, A. Kanazawa (*equal contribution)

International Conference on Computer Vision, ICCV’21 (oral)

pdf / project page / video / code (github)

Discoverying 3D Parts from Image Collections

C-H. Yao, W-C. Hung, V. Jampani, M-H. Yang

International Conference on Computer Vision, ICCV’21

pdf / project page / video / code (soon)

Generalize then Adapt: Source-Free Domain Adaptive Semantic Segmentation

J. N. Kundu*, A. Kulkarni*, A. Singh, V. Jampani, R. V. Babu (*equal contribution)

International Conference on Computer Vision, ICCV’21

pdf / project page / code (soon)

Implicit-PDF: Non-Parametric Representation of Probability Distributions on the Rotation Manifold

K. Murphy*, C. Esteves*, V. Jampani, S. Ramalingam, A. Makadia (*equal contribution)

International Conference on Machine Learning, ICML’21 (spotlight)

pdf / project page / video / code (github)

Decoupled Dynamic Filter Networks

J. Zhou, V. Jampani, Z. Pi, Q. Liu, M-H. Yang.

Computer Vision and Pattern Recognition, CVPR’21

pdf / project page / video / code (github)

LASR: Learning Articulated Shape Reconstruction from a Monocular Video

G. Yang, D. Sun, V. Jampani, D. Vlasic, F. Cole, H. Chang, D. Ramanan, W. T. Freeman, C. Liu

Computer Vision and Pattern Recognition, CVPR’21

pdf / project page / code (github)

AutoFlow: Learning a Better Training Set for Optical Flow

D. Sun, D. Vlasic, C. Hermann, V. Jampani, M. Krainin, H. Chang, R. Zabih, W. T. Freeman, C. Liu

Computer Vision and Pattern Recognition, CVPR’21 (oral)

pdf / project page / code (coming soon)

Adaptive Prototype Learning and Allocation for Few-Shot Segmentation

G. Li, V. Jampani, L. Sevilla-Lara, D.Sun, J. Kim, J. Kim

Computer Vision and Pattern Recognition, CVPR’21

pdf / project page / video / code (github)

Generative View Synthesis: From Single-view Semantics to Novel-view Images

T. A. Habtegebrial, V. Jampani, O. Gallo, D. Stricker

Neural Information Processing Systems, NeurIPS’20

pdf / video / project page / code (github)

Appearance Consensus Driven Self-Supervised Human Mesh Recovery

J. N. Kundu*, M. Rakesh*, V. Jampani, R. M. Venkatesh, R. V. Babu (*equal contribution)

European Conference on Computer Vision, ECCV’20 (oral)

pdf / video / project page / code (github)

Self-supervised Single-view 3D Reconstruction via Semantic Consistency

X. Li, S. Liu, K. Kim, S. D. Mello, V. Jampani, M. H. Yang and J. Kautz

European Conference on Computer Vision, ECCV’20

pdf / video / project page / code (github)

DeepGMR: Learning Latent Gaussian Mixture Models for Registration

W. Yuan, B. Eckart, K. Kim, V. Jampani, D. Fox and J. Kautz

European Conference on Computer Vision, ECCV’20

pdf / video / project page / code (github)

Self-supervised Viewpoint Learning from Image Collections

S. K. Mustikovela, V. Jampani, S. D. Mello, S. Liu, U. Iqbal, C. Rother and J. Kautz

Computer Vision and Pattern Recognition, CVPR’20

pdf / video / project page / code (github)

Two-shot Spatially-varying BRDF and Shape Estimation

M. Boss, V. Jampani, K. Kim, H. Lensch and J. Kautz

Computer Vision and Pattern Recognition, CVPR’20

pdf / video / project page / code (github)

Self-Supervised 3D Human Pose Estimation via Part-Guided Novel Image Synthesis

J. N. Kundu*, S. Seth*, V. Jampani, M. Rakesh, R. V. Babu and A. Chakraborty (*equal contribution)

Computer Vision and Pattern Recognition, CVPR’20 (oral)

pdf / video / code (google drive)

From Image Collections to Point Clouds with Self-supervised Shape and Pose Networks

K. L. Navaneet, A. Mathew, S. Kashyap, W-C. Hung, V. Jampani and R. V. Babu

Computer Vision and Pattern Recognition, CVPR’20

pdf / code (github)

Learning Propagation for Arbitrarily-structured Data

S. Liu, X. Li, V. Jampani, S. D. Mello and J. Kautz

Internationl Conference on Computer Vision, ICCV’19

SENSE: A Shared Encoder Network for Scene Flow Estimation

H. Jiang, D. Sun, V. Jampani, Z. Lv, E. Learned-Miller and J. Kautz

Internationl Conference on Computer Vision, ICCV’19 (oral)

pdf / code (github)

Gated-SCNN: Gated Shape CNNs for Semantic Segmentation

T. Takikawa*, D. Akuna*, V. Jampani and S. Fidler (*equal contribution)

International Conference on Computer Vision, ICCV’19

pdf / code (github) / project page / video

Pixel-Adaptive Convolutional Neural Networks

H. Su, V. Jampani, D. Sun, O. Gallo, E. Learned-Miller and J. Kautz

Computer Vision and Pattern Recognition, CVPR’19

pdf / poster / video / project page / code (github)

SCOPS: Self-Supervised Co-Part Segmentation

W-C. Hung, V. Jampani, S. Liu, P. Molchanov, M-H. Yang and J. Kautz

Computer Vision and Pattern Recognition, CVPR’19

pdf / poster / video / project page / code (github)

Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentation

A. Ranjan, V. Jampani, L. Balles, K. Kim, D. Sun, J. Wulff and M. J. Black

Computer Vision and Pattern Recognition, CVPR’19

pdf / code (github)

DIFFER: Moving Beyond 3D Reconstruction with Differntiable Feature Rendering

K. L. Navaneet, P. Mandikal, V. Jampani and R. V. Babu

3D-WiDGET, CVPR-Workshops’19 (Oral)

pdf / code (github)

Superpixel Sampling Networks

V. Jampani, D. Sun, M-Y. Liu, M-H. Yang and J. Kautz

European Conference on Computer Vision, ECCV’18

pdf / poster / video / project page / code (github)

Switchable Temporal Propagation Network

S. Liu, G. Zhong, S. D. Mello, J. Gu, V. Jampani, M-H. Yang and J. Kautz

European Conference on Computer Vision, ECCV’18

pdf / code (coming soon)

On the Integration of Optical Flow and Action Recognition

L. Sevilla, Y. Liao, F. Güney, V. Jampani, A. Geiger and M. J. Black

German Conference on Pattern Recognition, GCPR’18 (oral)

SPLATNet: Sparse Lattice Networks for Point Cloud Processing

H. Su, V. Jampani, D. Sun, S. Maji, E. Kalogerakis, M-H. Yang and J. Kautz

Computer Vision and Pattern Recognition, CVPR’18 (oral, best paper honorable mention, NVAIL Pioneering Research Award)

pdf / poster / video / CVPR talk / code (github)

Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolation

H. Jiang, D. Sun, V. Jampani, M-H. Yang, E. Learned-Miller and J. Kautz

Computer Vision and Pattern Recognition, CVPR’18 (spotlight)

pdf / supplementary / news / CVPR talk / video results

Learning Superpixels with Segmentation-Aware Affinity Loss

W-C. Tu, M-Y. Liu, V. Jampani, D. Sun, S-Y. Chien, M-H. Yang and J. Kautz

Computer Vision and Pattern Recognition, CVPR’18

pdf / project page / code (github)

Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomization

J. Tremblay*, A. Prakash*, D. Acuna*, M. Brophy*, V. Jampani, C. Anil, T. To, E. Cameracci, S. Boochoon and S. Birchfield (*equal contribution)

Workshop on Autonomous Driving, CVPR-Workshops’18

Semantic Video CNNs through Representation Warping

R. Gadde, V. Jampani and P. V. Gehler

International Conference on Computer Vision, ICCV’17 (oral)

pdf / video / code (github) / ICCV talk / poster

Video Propagation Networks

V. Jampani, R. Gadde and P. V. Gehler

Computer Vision and Pattern Recognition, CVPR’17

pdf / supplementary / project page / code (github) / poster

Efficient 2D and 3D Facade Segmentation using Auto-Context

R. Gadde*, V. Jampani*, R. Marlet and P. V. Gehler (*equal contribution)

Pattern Analysis and Machine Intelligence, PAMI’17

arXiv pre-print / code (bitbucket)

Superpixel Convolutional Networks using Bilateral Inceptions

R. Gadde*, V. Jampani*, M. Kiefel, D. Kappler and P. V. Gehler (*equal contribution)

European Conference on Computer Vision, ECCV’16

pdf / supplementary / project page / code (github) / poster

Learning Sparse High-Dimensional Filters: Image Filtering, Dense CRFs and Bilateral Neural Networks

V. Jampani, M. Kiefel and P. V. Gehler

Computer Vision and Pattern Recognition, CVPR’16

pdf / supplementary / project page / code (github) / poster

Optical Flow with Semantic Segmentation and Localized Layers

L. Sevilla, D. Sun, V. Jampani and M. J. Black

Computer Vision and Pattern Recognition, CVPR’16

pdf / video / project page / code (zip)

Permutohedral Lattice CNNs

M. Kiefel, V. Jampani and P. V. Gehler

International Conference on Learning Representations, ICLR Workshops’15

Consensus Message Passing for Layered Graphical Models

V. Jampani*, S. M. A. Eslami*, D. Tarlow, P. Kohli and J. Winn (*equal contribution)

Artificial Intelligence and Statistics, AISTATS’15

pdf / supplementary / arXiv

Efficient Facade Segmentation using Auto-Contex

V. Jampani*, R. Gadde* and P. V. Gehler (*equal contribution)

Winter Conference on Applications of Computer Vision, WACV’15

pdf / supplementary / code (bitbucket) / project page

The Informed Sampler: A Discriminative Approach to Bayesian Inference in Generative Computer Vision Models

V. Jampani, S. Nowozin, M. Loper and P. V. Gehler

Computer Vision and Image Understanding Journal, CVIU’15

Assessment of Computational Visual Attention Models on Medical Images

V. Jampani, Ujjwal, J. Sivaswamy and V. Vaidya

Indian Conference on Computer Vision, Graphics and Image Processing, ICVGIP’12

Role of Expertise and Contralateral Symmetry in the Diagnosis of Pneumoconiosis: An Experimental Study

V. Jampani, V. Vaidya, J. Sivaswamy and K. L. Tourani

SPIE, Medical Imaging’11

ImageFlow: Streaming Image Search

V. Jampani, G. Ramos and S. Drucker

Microsoft Research Technial Report, Redmond, MSR-TR-2010-148

pdf / news article

Theses

Learning Inference Models for Computer Vision

Learning based techniques for better inference in several computer vision models ranging from inverse graphics to freely parameterized neural networks.

V. Jampani

PhD Thesis, MPI for Intelligent Systems and University of Tübingen, December, 2016

pdf / slides / library

A Study of X-Ray Image Perception for Pneumoconiosis Detection

Eye tracking experimental studies and models for X-Ray Image Perception and Diagnosis.

V. Jampani

Master Thesis, IIIT-Hyderabad, January, 2013