code & projects
Open-source code, datasets, demos and tutorials by Sushil Awale on multimodal retrieval, patent search, vision-language models and knowledge graphs.
iPatent
PatentSemTech @ SIGIR 2025
Interactive search system for multimodal patent image search and interpretation, with clustering for exploring results. Live demo hosted by TIB.
Patent Figure Classification
ECIR 2025
Code and the PatFigCLS / PatFigVQA datasets for classifying patent figures by type, projection, patent class and object with large vision-language models, including a tournament-style multiple-choice strategy for large label sets.
CARA
Software, 2026
Open-source tool for building relevance judgments for image retrieval test collections. Annotators judge pools in groups of similar images, and a built-in simulator compares grouping settings before a study starts.
DBLP-QuAD
BIR @ ECIR 2023
10,000 question-answer pairs with SPARQL queries over the DBLP scholarly knowledge graph, for knowledge graph question answering.
More projects
-
Colonial-Context VLM Bias Dataset WebSci 2026
Annotated historical photographs for measuring gender and skin-tone retrieval bias of vision-language models in archival collections.
-
Fusing Vision and Language Tutorial KONVENS 2025
Full-day hands-on tutorial on vision-language models for multimodal content analysis, with slides and notebooks.
-
Hindi WordNet Extension
Enriching Hindi WordNet using knowledge graph completion approaches.
-
Patent Search on CLEF-IP
Multimodal patent search application demo for the CLEF-IP dataset.
-
Biomedical QA
Information retrieval-based biomedical question answering system using Elasticsearch and BERT.
More on GitHub: github.com/awalesushil · TIB Visual Analytics



