by ketralnis on 1/19/23, 10:44 PM
I don't really ever want to read answers from GPT to questions that I didn't knowingly myself ask GPT. If GPT can write a commit message from you, don't write it at all and let me ask it that if that's what I want. It may be a positive to you to spend a few seconds less on commit messages but it's a net negative for the world for it to become polluted with vast amounts of flatly incorrect text with no knowledge as to its provenance. I'd rather have no commit message than one that I can't trust whether it's written by the same human that wrote the code or not.
Put another way, you asking GPT for stuff that it learned from Stack Overflow: good. Using it to post to Stack Overflow: bad.
by pachico on 1/19/23, 9:35 PM
I find commit messages have more value when they don't just repeat what you can see by looking at a diff but when they explain the reasons behind.
by smashedtoatoms on 1/19/23, 10:19 PM
Because what we need is more of the what was done, with no regard to the why. Why provide any context as to why the change was made when you can fill it with an AI description of what one could accurately tell by looking at the code? I kinda can't believe this isn't a joke. Just squash it to the emoji that best captures the sentiment! Why use the tool to enhance you and your peers lives, when you can use AI to make it pointless!
by NBJack on 1/19/23, 9:34 PM
Neat concept, but this opens up a can of worms for corporate security. Pretty sure I won't get approval to submit proprietary code to a third party service just because I was too lazy to write a few lines of text. Might be helpful to open source projects?
by polemic on 1/19/23, 11:59 PM
The very last thing you should do is commit a GPT-3 generated commit message for a fairly simple reason: if GPT-3 can interpret and and explain the change as written,
there is no reason to commit that message. You will always be able re-run the generator at any later date, over any range of changes, to get the same or (presumably, in future) improved results.
As pointed out by other comments, the commit message should be telling you facts about the change that are not evident from the change itself. GPT-3 can't tell readers why the change happened.
by 0x000xca0xfe on 1/20/23, 12:13 AM
Writing commit messages (or comments in general) is like practicing vocabulary, but for your mental understanding of the current problem.
Taking a step back and thinking about what I have actually done often helps me to find misconceptions, the worst bugs of them all.
Automating this away would be like learning a foreign language by pasting book exercises into a translation app... you may get good grades, but does it help your understanding if you didn't put in the effort yourself?
by jim-jim-jim on 1/20/23, 1:57 AM
In the early days of Covid, the web was awash with all sorts of stupid fucking designs that reimagined public space under the new normal or whatever. It was chaff that creators and readers alike knew would never be put to practical use, or even be produced in the first place. There's a good writeup about it here.
https://mcmansionhell.com/post/618938984050147328/coronagrif...
I think the same phenomenon is at play here. Everybody sharing their own silly parrot tricks: it's the least interesting topic in the world right now.
by Rogach on 1/20/23, 8:21 AM
I don't want to debate the presence or absence of merits in this tool (these are extensively covered in other comments), but I want to point out that even in the demo examples 2 out of 3 commit messages are plainly incorrect:
- in Demo 1 tool wrote "Switch to colored output..." while in the diff we can see that colored output was already present;
- in Demo 3 tool wrote "Add installation options and demo link to README", while in the actuall diff we only see a link being added, no changes to installation options.
Props to the author for being honest and not cherry-picking the examples.
by haney on 1/19/23, 10:24 PM
This is interesting but I’d hate to work on a project where this was used. Commits should tell me why a change happened not just what code changed.
by gkfasdfasdf on 1/20/23, 1:09 AM
To everyone hating on this...I think a GPT-3 summary of a diff is a great thing to have, because it's a summary of the change and thus can be quicker to grok than picking through a diff. Also this doesn't seem to preclude a developer adding their own text to the commit (the why, etc). Finally, if the summary looks weird/incoherent it could serve as a signal to the developer that the commit needs more work.
by SketchySeaBeast on 1/19/23, 10:08 PM
I can kind of understand getting help writing the description of a large PR. But a commit message? Whose commits are so long so often that they need the help of an AI assistant to come up with the contents?
by darekkay on 1/20/23, 6:21 AM
With WhatTheCommit [1], I never have to come up with commit messages again. /s
I even wrote an IntelliJ IDEA plugin 9 years ago [2]. Half as a joke, half to learn about IDEA plugin development. I'm puzzled by seing so many people actually using it. Last month the HTTP link became invalid, and soon after someone opened a PR with a fix. I really hope noone actually uses those commit messages on shared repositories.
[1] https://whatthecommit.com/
[2] https://darekkay.com/blog/what-the-commit-plugin-for-intelli...
by yowlingcat on 1/19/23, 10:58 PM
The worst part about GPT-3 is people using it to automate things where the entire value comes from what the human annotates rather than automates. This is an idea, which like many others involving GPT-3, which I believe will destroy more value than it creates.
by zactato on 1/20/23, 12:02 AM
Did the OP use the tool to write his own commit messages?
A lot of the commit messages were typical and sort of redundant but this one stood out to me
https://github.com/zurawiki/gptcommit/commit/82294555e7269e6...
"Add github token to address GH Workflow rate limits"
This is a good commit message, it describes a problem and a solution. I'd be very impressed if the GPTCommit tool wrote this and knew why the github token was being added.
by avgcorrection on 1/19/23, 11:02 PM
There are tools that I wish didn’t exist and this is one of them.
by FastEatSlow on 1/19/23, 8:32 PM
Perhaps this could be more useful if it could be fed information from a bug tracker, so it could use the context to create a meaningful (if inaccurate) commit message.
by tjpnz on 1/20/23, 3:36 AM
If you're unable to write your own commit messages that's a strong signal to me that either your commits are too large or that you're unable to explain in simple words what you just did. While the first can be remedied I would find it hard working with someone who consistently displayed the second.
by AnimalMuppet on 1/20/23, 12:01 AM
1. If automating writing commit messages significantly improves your experience as a developer, you're doing something wrong.
2. If GPT-3 can write commit messages even close to as clear as you can, you're doing something wrong.
by warkanlock on 1/19/23, 10:02 PM
The peak of human society right here
by micimize on 1/19/23, 11:08 PM
Comments here are acting like you can't add/edit the commit. It offers a starting point. Yes it's just-above-diff level, but it is at-least-above-diff level.
But my main though is that IDK about using this for anything closed source. Feed openai's API your codebase, one commit at a time. Even if they promise not to train on your prompt history today, ToS could change. Seems fine if you run it locally though.
by xg15 on 1/20/23, 12:02 AM
Fun fact: you can probably turn this around too: Write a fictional commit history and have ChatGPT generate the actual commits for you.
by joshe on 1/20/23, 12:27 AM
This is fun.
Would also be cool to generate commit messages while viewing history, it could really do a good job of orienting you. I'm imagining "human commit msg | gpt commit msg" so you can look at both. It's a little simplistic right now, kinda just describes the diff, but GPT-3.2 could rock.
by rawfan on 1/19/23, 11:38 PM
At least the first line of commit messages shouldn’t describe WHAT changed but WHY the change was made.
by nora-puchreiner on 1/20/23, 12:49 AM
I was wondering if there is a possibility of obtaining an offline version of the service, in order to mitigate the inherent risks associated with transmitting proprietary code to external servers, thus ensuring optimal security and confidentiality of said code?
by failuser on 1/20/23, 1:41 AM
Cool, but I hope his is never used as is, just submit with some keyword and call the latest version of GPT on the diff when looking through the history later. A bad commit message is worse than no message and it can’t be easily fixed.
by hooande on 1/19/23, 11:49 PM
I like writing commit messages. I find it helps me to think through and explain the change that I'm committing. personal quirk: for major commits I'll add fun ascii art, just as a treat
by abi on 1/19/23, 9:57 PM
by coding123 on 1/20/23, 3:51 AM
The repo for this isn't eating it's own dogfood.
by ilikehurdles on 1/19/23, 11:34 PM
Might as well commit “I don’t remember writing that commit” because that’s going to be your every answer when someone has a question about what you did.
by jupp0r on 1/19/23, 10:59 PM
This is horrible. Commit messages should contain the reason why this change has been made and not imprecise prose summaries of what the diff looks like.
by dragonwriter on 1/20/23, 12:15 AM
Be more impressed if I write the commit message and GPT writes the code than vice versa.
If I wrote the code, writing a commit message is trivial.
by BuckyBeaver on 1/20/23, 3:46 AM
I'll write a shitload of commit messages before I'll give OpenAI my phone number.
by LeicaLatte on 1/19/23, 11:10 PM
I don’t get the hate. Don’t use it all the time, but this could be useful as part of a danger report.
A readable summary for the ones who may not understand code - your developer will never write that.
by tobyhinloopen on 1/19/23, 11:55 PM
Why are the demos videos?
by sigmonsays on 1/19/23, 11:07 PM
this is awful.
by xrd on 1/19/23, 9:35 PM
Now do this for branching strategies.
This is amazing. Humans should only need to read commit messages, never write them.