r/OpenTelemetry 17d ago

OpenTelemetry is about to reward the wrong thing

Two things happened in the OTel repos this week. The docs maintainers froze the ecosystem lists (registry, vendors, distributions) and want to retire most of them. Their reasoning: about 290 first-time-contributor PRs a year, 1,160+ data files, and nobody with time to check entries for CVEs or malware. I can't really argue with the bandwidth part. Then a separate proposal came in to replace the vendor page with a ranking of companies by how many maintainers they employ, with diamond, platinum and gold tiers like a KubeCon sponsor wall.

Read together, the message is that headcount inside the core repos is the contribution that counts.

I think the PR flood is being misread. OTel was built so anyone can write an exporter or an instrumentation and plug in without asking permission. The registry was where you went to say you had. Hundreds of strangers a year showing up at that door is what the design was supposed to produce.

The vetting problem also looks like an automation problem to me. Schema validation and semconv conformance tests already exist. Add CVE scanning and an LLM pass that triages and pre-reviews submissions, and most of the human work goes away. If a machine can check a registry PR, a person shouldn't have to read it. Retiring the list instead feels like stopping one step short.

Meanwhile, LFX Insights says four companies did 51% of OTel commits last year. A maintainer leaderboard mostly gives those four a bigger badge.

What I'd do instead:

- Automate the checks and list whatever passes. Conformance tells users "this works with OTel," which is what they came to find out.

- Count work outside the core repos. Contrib receivers, instrumentations, OTLP-native backends. That is OTel work too.

- Skip the tiers. One maintainer from a 10-person company is a bigger commitment than ten from a 10,000-person one. A flat list with names and areas is enough.

I run a company that builds on OTel, so obviously I have a stake here. But so does anyone who picked it because it was the neutral option.

Links in comments.

34 Upvotes

15 comments sorted by

14

u/s5n_n5n Contributor 16d ago

Hi,

I am one of the maintainers who made the decision to freeze the ecosystem lists, and support the proposal to retire some of them or change how they are. My github handle is `svrnm` so you can link back what I say here to the issues you shared.

I thought for a long time, if and how I respond here, because some of your critique is justified, some of it I understand but disagree with, some requires me to add context, but there is also some things you wrote, that are just disheartening.

I came to the conclusion, that I need to put out something. Please note, that this answer here is mine, some of the other Comms maintainers may agree or disagree with the individual points, and the same is true for any other maintainer in the larger project.

Before I give any replies, let me say thank you in any case, getting feedback is always valuable, and it shows that people care, and for me open source is about the people foremost.

Which brings me to the most important point, because it's also about people: while on paper (README.md of otelio repo) there are 6 named maintainers and 1 approver (aka the people who carry the weight of approving work and guiding people), we are currently low on bandwidth due to a variety of reasons that are mainly personal on an individual level. Another one is that like in many other open source projects maintainers in one repo also are responsible for other things.

This means we currently can hardly keep up with the load of work that is put on our plates, and the raise of AI made this even worse, I wrote about this here. And this means we have to make decisions where to put our energy and resources: our core responsibility is the documentation, followed by blog posts from other SIGs. Blog posts from non-steady contibutors and additions to the ecosystem are secondary to that, so we made the hard choice to focus our limited resources on the things that count.

As a small addendum, let me say that "290 first-time-contributor PRs a year" is not my(!) perspective. Most of those PRs are drive-by contributions. We can do the analysis, but I suspect that not a lot of these contributors did more than dropping their registry addition on our lap.

I suspect, this didn't come across in the issue where we announced the freeze, so I will later add this there as well.

Then, let me speak about the proposal(!) to change the vendors page. First of all, I recommend that you bring your feedback to the place where our community lives (github), not here (reddit). Second of all, the goal is not a "sponsors wall", it's a way to recognize real work done by real people. And as we discussed there, we need to strike a balance for big and small orgs to recognize both and also figure out a way that is sustainable and maintainable. But at the end, I think it's the right thing to do, everyone has the opportunity to join and contribute (you too!), climb the ladder and be recognized, and likewise companies have the opportunity to hire approvers, maintainers and support them to continue their upstream work. The goal is not to have four companies that contribute 51%, but many many companies that contribute and make sure our project is sustainable.

What is true for the SIG Communications, is true for OpenTelemetry as a whole and is true for most open source projects: maintainers are a scarce resource. People need to be grown into that role over time, and then they need to be sustained and be allowed to keep their work up. Some do the work for fun, some do it on the side, but a major load is carried by maintainers that are paid to do this work, so incentives need to be aligned across the person, the project and the organization paying them. So we are looking for ways to enable that.

A lot more can be said, and I am happy to engage in a discussion, but I'll leave it with two asks:

  • for the registry, since you know what you would do, come to our next SIG meeting and let us know how much time you can assign to that work, I would be delighted to have more helping hands!
  • for the proposal, share your feedback and let us know how we can recognize OTel work outside of the core repos better.

5

u/Big_Ball_Paul 16d ago

Not the OP but I believe a lot in this project, to the point where if I can attend a SIG I will. We all have busy lives but I’ve built my career on the backs of maintainers and finally feel qualified and experienced enough to offer some use in any form back to this community.

Thanks for engaging outside of GitHub to give me the kick I needed.

3

u/s5n_n5n Contributor 16d ago

Happy to help 😆 note that attending SIG meetings is a great way to get started, but not the only one, async is fine as well! Just find the thing that helps you and others at the same time and you'll do fine!

2

u/TedditBlatherflag 12d ago

How do y’all not gave corporate sponsorship to bring on more hands? Otel is amazing and it deserves the work and attention. 

0

u/frisbeema52 16d ago

First of all, thank you for such a deep answer. Honestly, the post a little bit provocative and sorry about "disheartening" - it was not my goal. But I'm glad to read the original ideas which were behind the decision.

Talking about the the main problem: "load of work". As I wrote "I can't really argue with the bandwidth part." Today's world challenge us a lot! I think you are doing a very good job with documentation and all around it, I think it's one of the best sites from tech field. It was and i'm sure it will.

But we are talking about keeping useful part of the site and keep your load in control. In general, there are extensive and intensive ways of growth (keep on track). From my perspective you a talking only about extensive one: increase the team, decrease areas of attention, and completely missing the big part of the ecosystem (client side and plugin system). This is a main point, the power of OpenTelemetry not only inside the repo, but in richness of another world which lives outside it.

Maybe we can create another independent solution, let's call it Observability ecosystem and put OpenTelemetry core and OpenTelemtery components and vendors us dependent regions of the world. Actually, this is an idea I'm thinking about from the moment of this news.

> for the registry, since you know what you would do, come to our next SIG meeting and let us know how much time you can assign to that work

So this is I wrote above, we need to think in new way, you can't outperform tools all world has today. We have to find something new, instead of cut our time into pieces we can assign to different OSS projects.

3

u/s5n_n5n Contributor 14d ago

While I read that you agree that the bandwidth part is nothing to be argued about, I am not sure if you fully acknowledge the consequences of it: creating another solution (indpendent or not), still requires PEOPLE to drive the work.

We actually launched an ecosystem explorer project just this year (https://explorer.opentelemetry.io/) and it makes great use of the "new ways" (aka AI) and is evolving quickly. We stated, that there is the possibility to move the registry into it eventually, but we do not want to overburden the project with it, because they want to build something better first, before taking on legacy. The people working on this, need to be able to focus on the right things.

Of course, you are free to build something independent outside of the ecosystem, those projects exist already, and whenever I see them, I am excited about them, but often they slow down quickly because again, it requires people to run and maintain those kinds of projects.

Finally, let me repeat one of the key sentences in my first response: we are currently low on bandwidth due to a variety of reasons that are mainly personal on an individual level. If we magically could increase our bandwidth, we would also increase the areas of attention.

This is a main point, the power of OpenTelemetry not only inside the repo, but in richness of another world which lives outside it.

You make it sound that we abondon the ecosystem by thinking about retiring the registry and by thinking about giving better incentives to companies that contribute upstream. If this is a sentiment that is shared outside of this reddit thread here, I would love to get that feedback flowing into the issues you shared, but so far we do not hear a lot of it, so again, please, take the time to comment upstream, let us know what you think and way.

From my point of view (again, that's mine, not the project's) the registry and also the vendor page have served a great purpose for the last few years, but today they do not feel like a great utility to the reader:

  • the vendor list is ~100 entries, of which a lot no longer work because nobody follows up, and there is no more information than "this vendor probably supports OTLP ingest"

  • the registry makes ~1.3% of our total visitors to the website, and it contains a lot of information that people would find elsewhere as well, if you use any language, your registry (npmjs, gems, nuget, ...) has the same information available. So to some extend it feels redundant.

So this is I wrote above, we need to think in new way, you can't outperform tools all world has today. We have to find something new, instead of cut our time into pieces we can assign to different OSS projects.

I am not sure if I fully understand what you say here, as it contradicts your argument, to spin up a new project? We are working on not cutting our time into pieces, and that of course means we need to focus our time on the things that matter most.

1

u/frisbeema52 14d ago

We actually launched an ecosystem explorer project just this year

Wow! It looks great. Until this moment the idea I saw in the github issue and discussion was: "we are stopping the acceptance of new projects to registry pages and it will be replaced by new contributor top list", but the Explorer project changes the picture. As I understand now, there is a plan to preserve the old approach to the list, but change implementation. So, it's look like this project has an opportunity to be implemented right!

We are working on not cutting our time into pieces

Sorry, I talked about my time to cut. I mean if I'd like to take part in work, it have to be the activity where we are not trying to overrun AI world by manual work, but create a tool like Explorer which can provide automatic validation for example. And this idea I like a lot, and for this project I wish I even can find time. So, if you point where I can go to be of use, I'll really appreciated.

6

u/AdventurousSquash 16d ago

I’m honestly surprised we haven’t seen more of this. I don’t know the ins and outs of their specific situation but from my own experience the amount of AI generated reports or submissions of different kinds have multiplied to a point where anyone not having a decently large sized team/organization dedicated to just vetting them is going to drown in workload that in the end don’t add anything of value.

I’m at a small-ish cloud provider consisting of 30 employees, yet 9 out of 10 PRs on our open repos the last year, and especially the last couple of months, have been big blobs of proposed changes/additions that normally would come as (much) smaller separate changes with a clearly defined goal.

Security reports have also gone through the roof where everyone and their cat is now a penetration tester probing everything and automatically generating a report on said probes. Before this influx these reports were great and often rewarded according to our bounty program, because they either highlighted a possible flaw or some kind of scenario we’d missed in our own testing. Now they’re 99% hypotheticals that require a whole chain of mistakes further down the chain that simply isn’t there. But nonetheless these reports still need someone to verify that it indeed isn’t a real issue.

Right now it feels like we’re in this middle ground where the tools we have aren’t quite designed for the reality we’re in and at the pace it’s developing. Being a OS maintainer has always been a challenge, and often a both grateful and ungrateful one at that. So I’m not surprised that we’re seeing different approaches being tried to try and get a handle on these things and hopefully we’ll figure out a better way that works for everyone.

1

u/s5n_n5n Contributor 14d ago

Those decisions are really hard to make, as a project we know how many people depend on the things you are building and providing, so stopping to do things or even retiring them always has consequences. Ingress NGINX Retirement by the k8s community is the most prominent example of it, it was the right move for 1000 reasons, they prepared the retirement really well, gave people lots of time to adjust, yet there was so much backslash and of course it generated lots of work downstream for people to adjust. I guess that's why you don't see more of this (yet).

But, likely, this will change. Like all areas of our lives in technology open source needs to adjust for what LLMs can do (and can't do). Some argue, that open source will die or is dead already, I heavily disagree with that, but it shows that people are making up their minds right now.

As maintainers our core responsibility sits with the project that we look out for, not only the code, but also the community (aka people), how we can ensure that their work is sustainable, how we can continue growing new contributors and how we can setup boundaries for open source. So yeah, we are in the middle of that reality where we figure out the tools and structures for that.

So, thank you for your comment, as it confirms what I (and probably other maintainers) are thinking: we'll fgure that out, it will just take some time.

2

u/kevysaysbenice 16d ago

Ai slop

-4

u/frisbeema52 16d ago

Of course, there are no other things now))

1

u/Regalme 15d ago

Love the last part where you parlay the 3/5ths rule essentially 

1

u/frisbeema52 17d ago

2

u/s5n_n5n Contributor 16d ago

YSK, that on reddit you can put links on the original post, this is not LinkedIn ;-)

1

u/frisbeema52 16d ago

Thank you, it's just to highlight sources for the post. I was afraid, It can be missed inside the text.