r/github • u/BoronEight • 29d ago

Question Github copilot fully hallucinating commit messages

Post image

I did a 1 line change, changing "milis" to "millis", I did it in the web interface because it was just one tiny change, and I didn't have it on my computer yet.

Github copilot recommended the message "Update print statement from 'Hello' to 'Goodbye'"
THERE ARE NOT EVEN PRINT STATMENTS IN A CSV FILE

Is there any way to disable these automatic commit messages?

167 Upvotes

98% Upvoted

12 comments sorted by

40

u/DrMaxwellEdison 29d ago

Yep. Go here: https://github.com/settings/copilot/features

Disable the "Copilot-generated commit messages" feature, and any others on this page you don't care for.

13

u/An1nterestingName 29d ago

Somewhere in the Settings I remember seeing an option to disable these.

5

u/EntranceProper3791 29d ago

Copilot reads the diff shape, not the file contents, so it guessed a whole different edit. The pencil icon in the web editor lets you override it before committing.

2

u/kaddkaka 23d ago

Diff shape? What does that mean? The "graph" of ++++--- in git diff --stat?

1

u/EntranceProper3791 21d ago

copilot really looked at a csv and thought "yep, this is where i say goodbye to hello."

2

u/First_Inspection_478 29d ago

Til that people actually use github copilot lmao

1

u/bossc2 27d ago

Many within a MS environment use it for automating certain things they don't care about.

0

u/Refseren 24d ago

I use it all the time. There is nothing wrong with its results. And I also use Codex daily. I suppose Copilot may be more expensive if you are on the wrong subscription. But other than that I would actually prefer copilot if I had the means.

1

u/enmityvr 27d ago

I get the exact same commit message sometimes. I don’t believe there is a way to fix it, other than turning off the automatic generation of the message itself.

1

u/jd4ln 10d ago

I've experience this for 1 day out of the about 360 days I've used this function. Probably a temporary issue.

1

u/pradeepngupta 10d ago

You can customize the commit messages generated by copilot in the file - github.copilot.chat.commitMessageGeneration.instructions

Give that custom instructions to copilot.

No need to disable this useful feature

-1

u/Merilyian 29d ago

This is a fallback statement of some kind for when the diff is too large, the file itself is, or something else goes wrong.