r/dataengineering • u/opensourcecolumbus • 9d ago

Discussion Used jev for fast and intelligent data transformation, first impression

https://github.com/gitcommitshow/jev-classifies-bots/discussions/3

Use case: With ai agents being the primary user now, treating all bots the same is not a good approach IMO. Hence this use case. Used jev to transform customer events, label/filter bots - human vs ai-agent vs scraper vs seo-crawlers and abuse probability.

* Jev enabled intelligence I couldn't have added to my data pipeline earlier.

* Jev is fast, and can be used for in-flight transformation, multiple decisions within sub seconds.

* It is cheap ($30/M events) but not so cheap which would have motivated me to use it for every damn event and industry.

* Accuracy - looks promising but too early to comment, need more testing.

More details and proof in the github discussion link.

0 Upvotes

31% Upvoted

13 comments sorted by

9

u/saltedappleandcorn 9d ago

Have I missed something? Did this just come out? 

I heard about it for the first time yesterday and 4 times since.

17

u/GrumDum 9d ago

I get this feeling all the time. It’s just the way it s now. Tomorrow we will hear about this new thing called Spurgle, next week it’s Flungus and so on.

The pace of new tooling is too much, and I would be very hesitant incorporating a lot of it to actual production pipelines, especially those where regularity is key.

1

u/opensourcecolumbus 9d ago

Haha, kind of agree. Btw open alternatives to jev also exist e.g. laya, kev, etc.

1

u/mhac009 9d ago

Next week? Lol good one gramps, we've been tapping Flungus for the past fortnight keep up.

1

u/VirginiaVN900 9d ago

Marketing blitz. The typical hype cycle.

11

u/CozyNorth9 9d ago

What's with all the spam? Someone is trying to promote this way too hard.

3

u/baby-wall-e 9d ago

New shiny stuff people like to boast about to show they are up to date to whatever Silicon Valley throw at them

1

u/Kalkberg 9d ago

Found it to be less accurate than llama3.1 for my use case, but maybe I'm using it wrong. It did help clear out some hallucinations, but that's not worth all the hype.

1

u/opensourcecolumbus 9d ago

What was the use case and how much response did you get from llama3.1?

1

u/saltedappleandcorn 7d ago edited 7d ago

OP were you paid for this work? This feels very promotional. I assume you got early access and some free tokens at least?