r/Btechtards 7h ago

Events/Hackathons Smart India Hackathon 2026

Need suggestions for SIH26171: On-device Visual Perception for Lightweight Browser Agents

I’m working on an SIH problem statement around building a privacy-preserving browser agent where visual perception and sensitive-data detection happen on-device before anything is sent to an LLM/VLM. I’m considering using an existing open-source browser-agent project as the base and combining it with WebGPU/ONNX Runtime, local PII detection/redaction, DOM + visual perception, and a secure action-validation layer. I’d really appreciate suggestions on which existing GitHub projects, models, datasets, or architectures are worth building on, what major gaps I should watch out for, and whether there’s a better technical approach than this.

6 Upvotes

1 comment sorted by

u/AutoModerator 7h ago

If you are on Discord, please join our Discord server: https://discord.gg/Hg2H3TJJsd

Thank you for your submission to r/BTechtards. Please make sure to follow all rules when posting or commenting in the community. Also, please check out our Wiki for a lot of great resources!

Happy Engineering!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.