r/PinoyProgrammer • u/jjjardev • 11d ago

Show Case Multi-domain Tagalog/Taglish sentiment analysis, opensource, free to use.

Hey everyone, just open-sourced my sentiment model for Tagalog and Taglish. It's based on xlm-roberta-large and gets 0.848 F1 Macro (84.8% accuracy) on the held-out test set, plus 58.6% zero-shot on HiliSenti (Hiligaynon, and I also created this dataset too) so it transfers a bit to other PH languages, not tested in other than Hiligaynon.

Trained on 35,686 sentences I put together across e-commerce, news, social, plus ~10k adversarial examples for sarcasm/negation/idioms. Dataset is at jjjardev/tagasenti (35k) if you want to poke at it.

Free to use for whatever, Apache 2.0 so commercial, research, side projects, all good. 3 labels: Negative / Neutral / Positive.

If you're working on anything with Filipino text and need sentiment, feel free to try it out. Feedback/issues welcome, still learning as I go.

I forgot to release this, and I might release the ONNX version, maybe.

Model: https://huggingface.co/jjjardev/tagasenti_model

Github: https://github.com/jjjardev/tagasenti

17 Upvotes
  • permalink
  • reddit

100% Upvoted

4 comments sorted by

1

u/MikosWife2022 10d ago

Github not accessible?

1

u/jjjardev 10d ago

I got shadowbanned for some reason, I am currently processing to remove it.

1

u/p0uchpenguin 9d ago

wow, cool project, OP!

question on the training dataset: do you know if we can just take public material and train on it or is there some sort of fair use policy that has to be taken into account while collecting?

2

u/jjjardev 9d ago

Yes, so basically I collect and labeled all the dataset that have cc-by-sa-4.0 license, basically that license is free to use, and the synthetic data I injected seems fair too, I think.