code & projects

Open-source code, datasets, demos and tutorials by Sushil Awale on multimodal retrieval, patent search, vision-language models and knowledge graphs.

iPatent

PatentSemTech @ SIGIR 2025

Interactive search system for multimodal patent image search and interpretation, with clustering for exploring results. Live demo hosted by TIB.

Patent Figure Classification

ECIR 2025

Code and the PatFigCLS / PatFigVQA datasets for classifying patent figures by type, projection, patent class and object with large vision-language models, including a tournament-style multiple-choice strategy for large label sets.

CARA

Software, 2026

Open-source tool for building relevance judgments for image retrieval test collections. Annotators judge pools in groups of similar images, and a built-in simulator compares grouping settings before a study starts.

DBLP-QuAD

BIR @ ECIR 2023

10,000 question-answer pairs with SPARQL queries over the DBLP scholarly knowledge graph, for knowledge graph question answering.

More on GitHub: github.com/awalesushil · TIB Visual Analytics