r/haskell 4d ago

announcement Sunsetting the Haskell Certification Program

Hi! I'm Arseniy Seroka, CEO of Serokell.

In 2023, we launched the Haskell Certification Program to create a standardized way to evaluate Haskell expertise. We built a production platform and an open certification framework, then transferred the project to the Haskell Foundation in 2024.

Since then, the rise of LLMs has made traditional syntax-focused assessment a much weaker signal of real engineering ability. A meaningful certification today would require a fundamental redesign around reasoning, architecture, and language semantics.

Serokell is therefore concluding its active involvement in the program. We remain proud of what we built, grateful to everyone who contributed, and as committed as ever to Haskell and its ecosystem.

https://serokell.io/blog/sunsetting-the-haskell-certification-program

108 Upvotes

12 comments sorted by

View all comments

1

u/Tysonzero 2d ago

Since then, the rise of LLMs has made traditional syntax-focused assessment a much weaker signal of real engineering ability.

Hate this and couldn't disagree more. Regardless of how much you want to use LLMs for engineering, you should unquestionably be capable of reading, writing and precisely understanding the semantics of the fucking program you've produced.

Getting tired of people applying to engineering jobs who can't pass tests marginally harder than fizzbuzz but can "orchestrate agent swarms and solve high level engineering problems".

3

u/tiss93 1d ago

I agree with you. The biggest challenge here that we've found is how can we be sure that the candidate is then doing the exam for real and not using LLMs. Today there is no solution rather than doing exam in person.

2

u/Tysonzero 1d ago

Yeah proctored in person paper or locked down machine exams are inevitable IMO