2024
ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization
Luca Eyring*, Shyamgopal Karthik*, Karsten Roth, Alexey Dosovitskiy, Zeynep Akata
Neural Information Processing Systems, NeurIPS 2024
A Practitioner's Guide to Continual Multimodal Pretraining
Karsten Roth*, Vishaal Udandarao*, Sebastian Dziadzio, Ameya Prabhu, Medhi Cherti, Oriol Vinyals, Olivier Henaff, Samuel Albanie, Matthias Bethge, Zeynep Akata
Neural Information Processing Systems, NeurIPS 2024
How should the advent of large language models affect the practice of science?
Marcel Binz*, Stephan Alaniz*, Adina Roskies, Balazs Aczel, Carl T. Bergstrom, Colin Allen, Daniel Schad, Dirk Wulff, Jevin D. West, Qiong Zhang, Richard M. Shiffrin, Samuel J. Gershman, Ven Popov, Emily M. Bender, Marco Marelli, Matthew M. Botvinick, Zeynep Akata, Eric Schulz
Provisionally Accepted at Proceedings of the National Academy of Sciences (PNAS) 2024
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
Thomas Hummel*, Shyamgopal Karthik*, Mariana-Iuliana Georgescu, Zeynep Akata
European Conference on Computer Vision, ECCV 2024
Improving Intervention Efficacy via Concept Realignment in Concept Bottleneck Models
Nishad Singhi, Jae Myung Kim, Karsten Roth, Zeynep Akata
European Conference on Computer Vision, ECCV 2024
DataDream: Few-shot Guided Dataset Generation
Jae Myung Kim, Jessica Bader, Stephan Alaniz, Cordelia Schmid, Zeynep Akata
European Conference on Computer Vision, ECCV 2024
Geometry Fidelity for Spherical Images
Anders Christensen, Nooshin Mojab, Khushman Patel, Karan Ahuja, Zeynep Akata, Ole Winther, Mar Gonzalez-Franco, Andrea Colaco
European Conference on Computer Vision, ECCV 2024
Reflecting on the State of Rehearsal-Free Continual Learning with Pretrained Models
Lukas Thede*, Karsten Roth*, Olivier Hénaff, Matthias Bethge, Zeynep Akata
Conference on Lifelong Learning Agents, CoLLAs 2024
ETHER: Efficient Finetuning of Large-Scale Models with Hyperplane Reflections
Massimo Bini, Karsten Roth, Zeynep Akata, Anna Khoreva
International Conference on Machine Learning, ICML 2024
SemioLLM: Assessing Large Language Models for Semiological Analysis in Epilepsy Research
Meghal Dani, Muthu Jeyanthi Prakash, Zeynep Akata, Stefanie Liebe
The International Conference on Machine Learning, ICML (AI4Science Workshop) 2024
Unbalancedness in Neural Monge Maps Improves Unpaired Domain Translation
Luca Eyring*, Dominik Klein*, Théo Uscidda*, Giovanni Palla, Niki Kilbertus, Zeynep Akata, Fabian Theis
International Conference on Learning Representations, ICLR 2024
Vision-by-Language for Training-Free Compositional Image Retrieval
Shyamgopal Karthik*, Karsten Roth*, Massimiliano Mancini, Zeynep Akata
International Conference on Learning Representations, ICLR 2024
Fantastic Gains and Where to Find Them - On the Existence and Prospect of General Knowledge Transfer
Karsten Roth*, Lukas Thede*, A. S. Koepke, Oriol Vinyals, Olivier Hénaff, Zeynep Akata
International Conference on Learning Representations, ICLR 2024
2023
Addressing caveats of neural persistence with deep graph persistence
Leander Girrbach, Anders Christensen, Ole Winther, Zeynep Akata, A. Sophia Koepke
Transactions on Machine Learning Research, TMLR 2023
Zero-shot audio captioning with audio-language model guidance and audio context keywords
Leonard Salewski, Stefan Fauth, A. Sophia Koepke, Zeynep Akata
Neural Information Processing Systems, NeurIPS Machine Learning for Audio Workshop (Oral) 2023
Meta-in-context learning in large language models
Julian Coda-Forno, Marcel Binz, Zeynep Akata, Matthew Botvinick, Jane X. Wang, Eric Schulz
Neural Information Processing Systems, NeurIPS 2023
Transitivity Recovering Decompositions: Interpretable and Robust Fine-Grained Relationships
Abhra Chaudhuri, Massimiliano Mancini, Zeynep Akata, Anjan Dutta
Neural Information Processing Systems, NeurIPS 2023
In-Context Impersonation Reveals Large Language Models' Strengths and Biases
Leonard Salewski, Stephan Alaniz, Isabel Rio-Torto, Eric Schulz, Zeynep Akata
Neural Information Processing Systems, NeurIPS (Spotlight) 2023
Text-to-feature diffusion for audio-visual few-shot learning
Otniel-Bogdan Mercea, Thomas Hummel, A. Sophia Koepke, Zeynep Akata
DAGM German Conference on Pattern Recognition, GCPR 2023
DeViL: Decoding Vision Features into Language
Meghal Dani, Isabel Rio-Torto, Stephan Alaniz, and Zeynep Akata
DAGM German Conference on Pattern Recognition, GCPR 2023
Zero-shot Translation of Attention Patterns in VQA Models to Natural Language
Leonard Salewski, A. Sophia Koepke, Hendrik P.A. Lensch, Zeynep Akata
DAGM German Conference on Pattern Recognition, GCPR 2023
Video-adverb retrieval with compositional adverb-action embeddings
Thomas Hummel, Otniel-Bogdan Mercea, A. Sophia Koepke, Zeynep Akata
British Machine Vision Conference, BMVC 2023
Iterative Superquadric Recomposition of 3D Objects from Multiple Views
Stephan Alaniz, Massimiliano Mancini, Zeynep Akata
International Conference on Computer Vision, ICCV 2023
Image-free Classifier Injection for Zero-Shot Classification
Anders Christensen, Massimiliano Mancini, A. Sophia Koepke, Ole Winther, Zeynep Akata
IEEE International Conference on Computer Vision, ICCV 2023
ProbVLM: Probabilistic Adapter for Frozen Vision-Language Models
Uddeshya Upadhyay*, Shyamgopal Karthik*, Massimiliano Mancini, Zeynep Akata
IEEE International Conference on Computer Vision, ICCV 2023
Waffling around for Performance - Visual Classification with Random Words and Broad Concepts
Karsten Roth, Jae Myung Kim, Almut Sophia Koepke, Oriol Vinyals, Cordelia Schmid, Zeynep Akata
International Conference on Computer Vision, ICCV 2023
PDiscoNet: Semantically consistent part discovery for fine-grained recognition
Robert van der Klis, Stephan Alaniz, Massimiliano Mancini, Cassio Dantas, Dino Ienco, Zeynep Akata, Diego Marcos
International Conference on Computer Vision, ICCV 2023
USIM-DAL: Uncertainty-aware Statistical Image Modeling-based Dense Active Learning for Super-resolution
Vikrant Rangnekar*, Uddeshya Upadhyay*, Zeynep Akata, Biplab Banerjee
The Conference on Uncertainty in Artificial Intelligence (UAI), 2023 2023
The Manifold Hypothesis for Gradient-Based Explanations
Sebastian Bordt, Uddeshya Upadhyay, Zeynep Akata, Urlike von Luxburg
Explainable AI for Computer Vision (XAI4CV) Workshop - The IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR), 2023 2023
Classifying the unknown: Insect identification with deep hierarchical Bayesian learning
Sarkhan Badirli, Christine Johanna Picard, George Mohler, Frannie Richert, Zeynep Akata, Murat Dundar
'Methods in Ecology and Evolution' published by John Wiley & Sons Ltd on behalf of British Ecological Society 2023
Bridging the Gap between Model Explanations in Partially Annotated Multi-label Classification
Youngwook Kim, Jae Myung Kim, Jieun Jeong, Cordelia Schmid, Zeynep Akata, Jungwoo Lee
The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2023 2023
Disentanglement of Correlated Factors via Hausdorff Factorized Support
Karsten Roth, Mark Ibrahim, Zeynep Akata, Pascal Vincent*, Diane Bouchacourt*
International Conference on Learning Representations, ICLR 2023
2022
PlanT: Explainable Planning Transformers via Object-Level Representations
Katrin Renz, Kashyap Chitta, Otniel-Bogdan Mercea, A. Sophia Koepke, Zeynep Akata, Andreas Geiger
Conference on Robot Learning, CoRL 2022
Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment
Yuchen Ma*, Yanbei Chen*, Zeynep Akata
The British Machine Vision Conference (BMVC) 2022
Cross-Modal Fusion Distillation for Fine-Grained Sketch-Based Image Retrieval
Abhra Chaudhuri, Massimiliano Mancini, Yanbei Chen, Zeynep Akata, Anjan Dutta
British Machine Vision Conference BMVC 2022
Relational Proxies: Emergent Relationships as Fine-Grained Discriminators
Abhra Chaudhuri, Massimiliano Mancini, Zeynep Akata, Anjan Dutta
Neural Information Processing Systems, NeurIPS 2022
A Non-isotropic Probabilistic Take on Proxy-based Deep Metric Learning
Michael Kirchhof *, Karsten Roth *, Zeynep Akata, Enkelejda Kasneci
European Conference on Computer Vision, ECCV 2022
Abstracting Sketches through Simple Primitives
Stephan Alaniz, Massimiliano Mancini, Anjan Dutta, Diego Marcos, Zeynep Akata
European Conference on Computer Vision, ECCV 2022
Temporal and cross-modal attention for audio-visual zero-shot learning
Otniel-Bogdan Mercea *, Thomas Hummel *, A. Sophia Koepke, Zeynep Akata
European Conference on Computer Vision, ECCV 2022
BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks
Uddeshya Upadhyay*, Shyamgopal Karthik*, Yanbei Chen, Massimiliano Mancini, Zeynep Akata
European Conference on Computer Vision, ECCV 2022
Semi-Supervised and Unsupervised Deep Visual Learning: A Survey
Yanbei Chen, Massimiliano Mancini, Xiatian Zhu, Zeynep Akata
IEEE Transactions on Pattern Analysis and Machine Intelligence, TPAMI 2022
Semantic Image Synthesis with Semantically Coupled VQ-Model
Stephan Alaniz*, Thomas Hummel*, Zeynep Akata
Workshop on Deep Generative Models for Highly Structured Data (DGM4HSD), ICLR 2022
Attribute Prototype Network for Any-Shot Learning
Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, Zeynep Akata
International Journal of Computer Vision, IJCV 2022
Integrating Language Guidance into Vision-based Deep Metric Learning
Karsten Roth, Oriol Vinyals, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
KG-SP: Knowledge Guided Simple Primitives for Open World Compositional Zero-Shot Learning
Shyamgopal Karthik, Massimiliano Mancini, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
Large Loss Matters in Weakly Supervised Multi-Label Classification
Youngwook Kim*, Jae Myung Kim*, Zeynep Akata, Jungwoo Lee
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
Non-isotropy Regularization for Proxy-based Deep Metric Learning
Karsten Roth, Oriol Vinyals, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot Learning
Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
Attention Consistency on Visual Corruptions for Single-Source Domain Generalization
Ilke Cugu, Massimiliano Mancini, Yanbei Chen, Zeynep Akata
Workshop on Learning with Limited Labelled Data for Image and Video Understanding (L3D-IVU), CVPR 2022
Audio-visual Generalised Zero-shot Learning with Cross-modal Attention and Language
Otniel-Bogdan Mercea, Lukas Riesch, A. Sophia Koepke, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
Compositional Mixture Representations for Vision and Text
Stephan Alaniz, Marco Federici, Zeynep Akata
Workshop on Learning with Limited Labelled Data for Image and Video Understanding (L3D-IVU), CVPR 2022
Learning Graph Embeddings for Open World Compositional Zero-Shot Learning
Massimiliano Mancini, Muhammad Ferjad Naeem, Yongqin Xian, Zeynep Akata
IEEE Transactions on Pattern Analysis and Machine Intelligence, TPAMI 2022
CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
Leonard Salewski, A. Sophia Koepke, Hendrik P. A. Lensch, Zeynep Akata
Springer LNAI 13200 xxAI – Beyond explainable Artificial Intelligence 2022
2021
Robustness via Uncertainty-aware Cycle Consistency
Uddeshya Upadhyay, Yanbei Chen, Zeynep Akata
Neural Information Processing Systems, NeurIPS 2021
Fine-Grained Zero-Shot Learning with DNA as Side Information
Sarkhan Badirli, Zeynep Akata, George Mohler, Christine J. Picard, Murat Dundar
Neural Information Processing Systems, NeurIPS 2021
Conditional De-Identification of 3D Magnetic Resonance Images
Lennart Van der Goten, Tobias Hepp, Zeynep Akata, Kevin Smith
British Machine Vision Conference, BMVC 2021
Human Attention in Fine-Grained Classification
Yao Rong, Wenjia Xu, Zeynep Akata, Enkelejda Kasneci
British Machine Vision Conference, BMVC 2021
Prototype-based Incremental Few-Shot Segmentation
Fabio Cermelli, Massimiliano Mancini, Yongqin Xian, Zeynep Akata, Barbara Caputo
British Machine Vision Conference, BMVC 2021
Audio Retrieval with Natural Language Queries
Andreea-Maria Oncescu, A. Sophia Koepke, Joao F. Henriques, Zeynep Akata, Samuel Albanie
INTERSPEECH 2021
Keep CALM and Improve Visual Feature Attribution
Jae Myung Kim, Junsuk Choe, Zeynep Akata, Seong Joon Oh
IEEE International Conference of Computer Vision, ICCV 2021
e-ViL: A Dataset and Benchmark for Natural Language Explanations in Vision-Language Tasks
Maxime Kayser, Oana-Maria Camburu, Leonard Salewski, Cornelius Emde, Virginie Do, Zeynep Akata, Thomas Lukasiewicz
IEEE International Conference of Computer Vision, ICCV 2021
Uncertainty-Guided Progressive GANs for Medical Image Translation
Uddeshya Upadhyay, Yanbei Chen, Tobias Hepp, Sergios Gatidis, Zeynep Akata
Medical Image Computing and Computer Assisted Interventions, MICCAI 2021
Learning Graph Embeddings for Compositional Zero-shot Learning
Mohammad Ferjad Naeem, Yongqin Xian, Federico Tombari, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021
Learning Decision Trees Recurrently Through Communication
Stephan Alaniz, Diego Marcos, Bernt Schiele, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021
Distilling Audio-Visual Knowledge by Compositional Contrastive Learning
Yanbei Chen, Yongqin Xian, A. Sophia Koepke, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021
Open World Compositional Zero-Shot Learning
Massimiliano Mancini, Mohammad Ferjad Naeem, Yongqin Xian, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021
2020
Attribute Prototype Network for Zero-Shot Learning
Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, Zeynep Akata
Neural Information Processing Systems (NeurIPS) 2020
Towards Recognizing Unseen Categories in Unseen Domains
Massimiliano Mancini, Zeynep Akata, Elisa Ricci, Barbara Caputo
European Conference of Computer Vision (ECCV) 2020
Semantically Tied Paired Cycle Consistency for Zero-Shot Sketch-based Image Retrieval
Anjan Dutta, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition CVPR 2020
Learning Robust Representations via Multi-View Information Bottleneck
Marco Federici, Anjan Dutta, Patrick Forré, Nate Kushman, Zeynep Akata
International Conference on Learning Representations (ICLR) 2020
Evaluating Weakly Supervised Object Localization Methods Right
Junsuk Choe, Seong Joon Oh, Seungho Lee, Sanghyuk Chun, Zeynep Akata, Hyunjung Shim
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2020
Manipulating Attributes of Natural Scenes via Hallucination
Levent Karacan, Zeynep Akata, Aykut Erdem, Erkut Erdem
ACM SIGGRAPH 2020 (invited paper) 2020
2019
Modeling Conceptual Understanding in Image Reference Games
Rodolfo Corona, Stephan Alaniz, Zeynep Akata
Neural Information Processing Systems, NeurIPS (Spotlight) 2019
Combining Generative and Discriminative Models for Hybrid Inference
Victor Garcia Satorras, Zeynep Akata, Max Welling
Neural Information Processing Systems, NeurIPS (Spotlight) 2019
f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learning
Yongqin Xian, Saurabh Sharma, Bernt Schiele, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019
Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoders
Edgar Schönfeld, Sayna Ebrahimi, Samarth Sinha, Trevor Darrell, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019
Semantic Projection Network for Zero- and Few-Label Semantic Segmentation
Yongqin Xian, Subharata Choudhury, Yang He, Bernt Schiele, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019
Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly
Yongqin Xian, Christoph H. Lampert, Bernt Schiele, Zeynep Akata
IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019