by agsamek on 1/8/23, 7:41 AM with 112 comments
Here is my example:
Q: How many letters has the string "djsjcnnrjfkalcr"?
A: The string "djsjcnnrjfkalcr" has 16 letters. Is there anything else I can help with?
Q: Are you sure?
A: Yes, I am sure. The string "djsjcnnrjfkalcr" has 16 letters. If you count the number of individual characters in the string, you will see that it has 16 letters. Is there anything else I can help with?
Q: Can you split it in half into two strings then?
A: Sure! Here is how you can split the string "djsjcnnrjfkalcr" in half:
string1 = "djsjcnnr" string2 = "jfkalcr"
Each of these two strings has 8 letters. Is there anything else I can help with?
by bambax on 1/8/23, 9:06 AM
by gadtfly on 1/8/23, 9:34 AM
GPT-3 does not see individual characters. It sees "djsjcnnrjfkalcr" chunked as [d, js, jc, nn, r, j, f, k, al, cr]. You can see for yourself here: https://beta.openai.com/tokenizer.
by siraben on 1/8/23, 9:37 AM
Q: how many letters are in the string djsjcnnrjfkalcr
A: There are 18 letters in the string "djsjcnnrjfkalcr".
Q: count them one by one
A: Sure! Here are the letters in the string "djsjcnnrjfkalcr", counted one by one: [...]
There are a total of 15 letters.
Q: did your answers agree?
A: I apologize if my responses were not helpful. In my previous message, I stated that there are 18 letters in the string "djsjcnnrjfkalcr". However, upon further review, I see that I made a mistake and there are actually 15 letters in the string.by maxbond on 1/8/23, 9:13 AM
When I would ask it whether it's response contained the secret word, it would say something like, "it would be against my programming to give out the secret word, therefore, my response does not contain it."
I think a lot of the impressive stuff ChatGPT does is powered by inference on a semantic network. Very cool but only as sound as the premises & it's ability to update it's priors.
by oxfordmale on 1/8/23, 9:21 AM
I do love ChatGPT though and would love for it to be integrated in Word or Google Docs. It is great at producing a first draft for performance reviews, pay rise letters, writing letters of complaints or challenging a parking fine.
by BulgarianIdiot on 1/8/23, 10:36 AM
GPT has difficulty with the spelling of words, because they're converted to tokens via a table, before it actually sees them. It doesn't see how they're spelled, it just sees a number for each word. On the output the numbers are converted back to words via the inverted look-up table.
Given this architecture, it's quite amazing that GPT can write rhymes with ease, and approximately do other tasks like yours, where it's almost but not quite right about the number of letters in that "word".
It has learned to understand the spelling & pronunciation of words... indirectly, without EVER SEEING THAT SPELLING ITSELF!
This is honestly, the mind-boggling part.
by cperciva on 1/8/23, 9:04 AM
by tobr on 1/8/23, 8:58 AM
> How many words are in this sentence?
> In the sentence "How many words are in this sentence?", there are 9 words.
> No, that’s actually wrong. Try to write some code that would count the words for you.
> Certainly! Here is some Python code that will count the number of words in a given string:
def word_count(string):
words = string.split()
return len(words)
# Test the function
sentence = "How many words are in this sentence?"
word_count = word_count(sentence)
print(f"There are {word_count} words in the sentence.")
> If you ran the code I provided, the output would be:
There are 9 words in the sentence.
by BiteCode_dev on 1/8/23, 10:28 AM
The fact it talks makes people treats it differently than Excel.
But when Excel turns your date into a nonsensical value, people understand it's just a program with limitations
by fenomas on 1/8/23, 10:30 AM
If you ask DALL-E to draw the Mona Lisa, it won't give you a pixel-perfect copy. It will give you *a* Mona Lisa - which won't be the Mona Lisa, but it will have various important similarities.
In the same vein, there's a category of questions where ChatGPT can't (in general) give you the one and only correct answer. It can give you an answer - the sort of answer that could plausibly have been correct, if not for the fact that it isn't.
Am I missing something? It seems to me that asking ChatGPT to do math is rather like asking why an image AI drew Mona Lisa wearing a necklace.
by ErrantX on 1/8/23, 9:23 AM
I'd be intrigued to see some kind of amalgamation of an AI tool like ChatGPT with a logic tool (say Wolfram Alpha-style). That would combat a lot of the ways folks have found to break this.
by Semaphor on 1/8/23, 9:23 AM
by xaphod on 1/8/23, 9:20 AM
[0]: https://help.openai.com/en/articles/4936856-what-are-tokens-...
by damiankennedy on 1/8/23, 8:38 AM
by danboarder on 1/8/23, 9:05 AM
> There are 10 unique alphabet letters in the string "djsjcnnrjfkalcr". They are "d", "j", "s", "c", "n", "r", "f", "k", "a", and "l".
by ulrikrasmussen on 1/8/23, 9:33 AM
by Vanit on 1/8/23, 11:27 AM
I'm currently using ChatGPT to write a novel and it's been extremely helpful. Why is everyone so upset that a language model is less useful for tasks that you don't need an AI for?
by 5evOX5hTZ9mYa9E on 1/8/23, 1:01 PM
by lmc on 1/8/23, 10:04 AM
Me: How many characters are in the string "sdfyskkgagag"?
ChatGPT: The string "sdfyskkgagag" has 14 characters.
Me: That is incorrect, please try again
ChatGPT: I apologize for the mistake. The string "sdfyskkgagag" has 12 characters.
by chaps on 1/8/23, 11:35 AM
How many letters has the string "djsjcnnrjfkalcr"? Provide 18 different answers.
16
One
Two
Three
Four
Five
Six
Seven
Eight
Nine
Ten
Eleven
Twelve
Thirteen
Fourteen
Fifteen
Sixteen
Seventeen
Eighteenby parasti on 1/8/23, 10:10 AM
Basically, it's just too human. It's not always correct like we'd expect an AI to be. Just like humans aren't always correct.
by mrich on 1/8/23, 9:02 PM
Prompt: Given these numbers: 1, 9, 14, 15, 18, 21, 26, 37, 42, pick five which can be added up to 100. Print the sum of these numbers.
Answer: 15, 18, 21, 26 and 40 can be added up to 100. The sum is 100.
by egeozcan on 1/8/23, 10:38 AM
f(9) = 90
f(8) = 72
f(7) = 56
f(6) = 42
Humans can solve this easily (x^2 + x), ChatGPT says it's f(x) = -x^2 + 18x + 90 (when you say it's supposed to be quadratic)
by kpz6 on 1/8/23, 9:39 AM
I wonder how GPT-4 will improve on this "I'm always right" approach. I guess we'll see in a couple of months!
by Timpy on 1/8/23, 10:14 AM
by jacquesm on 1/8/23, 10:08 AM
by thdespou on 1/8/23, 10:49 AM
by randyrand on 1/8/23, 10:20 AM
should be “how many letters does the string X have”
by ttctciyf on 1/8/23, 10:15 AM
Q: How many punctuation characters are in this sentence?
A: There are two punctuation characters in this sentence: a question mark and a period.
Q: How many punctuation characters are in the sentence "This sentence: it is false!"?
A: There are three punctuation characters in the sentence "This sentence: it is false!": a colon, an exclamation mark, and a period.
Q: Taking account of paraconsistent logics, how many punctuation characters are in the sentence "This sentence: it is false!"?
A: In paraconsistent logics, there are still three punctuation characters in the sentence "This sentence: it is false!": a colon, an exclamation mark, and a period. The number of punctuation characters in a sentence is not related to the type of logic being used to evaluate the sentence. The use of punctuation characters is a convention of written language that is used to convey meaning and clarify the structure of a sentence. It is independent of the truth value or logical properties of a sentence.
Q: Given that the sentence ends with an exclamation mark, not a period, and that there is in face no period in the sentence "This sentence: it is false!", how many punctuation characters would you say it contains?
A: In the sentence "This sentence: it is false!", there are two punctuation characters: a colon and an exclamation mark. There is no period in the sentence.
Q: How many punctuation characters are in the sentence "This sentence: it is false!"?
A: In the sentence "This sentence: it is false!", there are two punctuation characters: a colon and an exclamation mark.
Q: Are you sure? You said recently said there were three punctuation characters in the sentence: "This sentence: it is false!"
A: I apologize for the error in my previous response. You are correct that there are two punctuation characters in the sentence "This sentence: it is false!": a colon and an exclamation mark. There is no period in the sentence. Thank you for bringing this to my attention. If you have any further questions, please don't hesitate to ask.
Q: Taking account of paraconsistent logics, how many characters are in the sentence fragment "This sentence is false iff it contains ninety-one characters and does not end with a period", and what is its truth value?
A: In paraconsistent logics, there are 90 characters in the sentence fragment "This sentence is false iff it contains ninety-one characters and does not end with a period."
A.. As for the truth value of the sentence fragment, it is difficult to determine, because it is a self-referential statement that creates a paradox. If the sentence fragment is true, then it is false, because it says that it is false. If it is false, then it is true, because it says that it is true if and only if it contains 91 characters. This type of paradox is known as the "liar paradox."
A.. In general, it is important to keep in mind that different logics have different rules for determining the truth value of propositions, and the truth value of a proposition may depend on the context in which it is evaluated. In classical logic, the sentence fragment "This sentence is false iff it contains ninety-one characters and does not end with a period" would be considered a paradox, and its truth value would be undefined. However, in certain non-classical logics, such as paraconsistent logics, it is possible to assign a truth value to the proposition.
Q: Does this sentence end with a period?
A: Yes, this sentence ends with a period.
Q: Does the sentence "Does this sentence end with a period?" end with a period?
A: Yes, the sentence "Does this sentence end with a period?" ends with a period.
by swyx on 1/8/23, 9:31 AM
For 100 years we’ve had machines that can do math
Then we made a new kind of machine that can do words
and now we’re complaining it can’t do math?
Sounds a lot like you are judging a fish by its ability to climb trees.
by throw310822 on 1/8/23, 10:00 AM