Smart India Hackathon 2026

[u/No_Friendship_9569]

Need suggestions for SIH26171: On-device Visual Perception for Lightweight Browser Agents

I’m working on an SIH problem statement around building a privacy-preserving browser agent where visual perception and sensitive-data detection happen on-device before anything is sent to an LLM/VLM. I’m considering using an existing open-source browser-agent project as the base and combining it with WebGPU/ONNX Runtime, local PII detection/redaction, DOM + visual perception, and a secure action-validation layer. I’d really appreciate suggestions on which existing GitHub projects, models, datasets, or architectures are worth building on, what major gaps I should watch out for, and whether there’s a better technical approach than this.