cross-posted from: https://lemmy.zip/post/64538696

Multiple researchers using the same tools to find the same bugs are creating ‘unnecessary pain and pointless work’

  • RobertoOberto@sh.itjust.works
    link
    fedilink
    arrow-up
    4
    ·
    6 days ago

    …just because ethics.

    Not ethics, practicality. There are only so many people contributing so many hours to open source projects. It’s impossible to handle the entire incoming stream of reports without some filtering.

    And your analogy isn’t really capturing the problem. If you want to stick with the (slightly hyperbolic) nuke analogy, it’s more like getting 9 reports that nukes are going to be launched but 6 of them name different source countries, 4 of them say it’ll actually be tomorrow night, 2 of them say the nukes will be unarmed for some reason, and one says it’s actually bottle rockets being launched. I hope you can find them in time because they’re buried among 362 other intelligence reports about god knows what, many of which are duplicates of things you already knew about. Also, you don’t know any of the sources or what their motives and competency levels are.

    @[email protected] didn’t say anything about banning AI usage at all, just that we need a better system to restrict contributions to people who can demonstrate that they can filter the noise out of their own contributions instead of just spamming mailing lists with everything their chosen tool spits out. No one is going to dump a valid bug report just because a contributor used AI to find it. They want to dump the endless stream of duplicate and invalid reports being submitted by people that don’t bother confirming that the reports they’re submitting are new and valid.

    • sonofearth@lemmy.world
      link
      fedilink
      arrow-up
      1
      arrow-down
      1
      ·
      5 days ago

      Okay let’s say what you said is 100% right. How are you going to filter them or restrict them? OC said using a video interview. Who’s gonna conduct the interview? Who will pay the interviewer? How can we verify the answers that the interviewee gives are not AI generated? Wouldn’t reviewing the reports and the contributions instead would be faster even if most of them are wrong?

      • RobertoOberto@sh.itjust.works
        link
        fedilink
        arrow-up
        2
        ·
        5 days ago

        Wouldn’t reviewing the reports and the contributions instead would be faster even if most of them are wrong?

        No. That’s what this whole post is about. The current state is unsustainable and a better system is needed.

        I don’t think anybody has the answers to your other questions yet - that’s the whole point of the discussion. Open source projects are facing a new challenge and the community as a whole needs to do some brainstorming and experimentation to figure out how to solve it. Video interviews may not be the right solution at all, it’s just one idea among others.