Actually, they are hiding the full CoT sequence outside of the demos.

What you are seeing there is a summary, but because the actual process is hidden it’s not possible to see what actually transpired.

People are very not happy about this aspect of the situation.

It also means that model context (which in research has been shown to be much more influential than previously thought) is now in part hidden with exclusive access and control by OAI.

There’s a lot of things to be focused on in that image, and “hur dur the stochastic model can’t count letters in this cherry picked example” is the least among them.

Yep:

https://openai.com/index/learning-to-reason-with-llms/

First interactive section. Make sure to click “show chain of thought.”

The cipher one is particularly interesting, as it’s intentionally difficult for the model.

The tokenizer is famously bad at two letter counts, which is why previous models can’t count the number of rs in strawberry.

So the cipher depends on two letter pairs, and you can see how it screws up the tokenization around the xx at the end of the last word, and gradually corrects course.

Will help clarify how it’s going about solving something like the example I posted earlier behind the scenes.

You should really look at the full CoT traces on the demos.

I think you think you know more than you actually know.

I’d recommend everyone saying “it can’t understand anything and can’t think” to look at this example:

https://x.com/flowersslop/status/1834349905692824017

Try to solve it after seeing only the first image before you open the second and see o1’s response.

Let me know if you got it before seeing the actual answer.

They got off to a great start with the PS5, but as their lead grew over their only real direct competitor, they became a good example of the problems with monopolies all over again.

This is straight up back to PS3 launch all over again, as if they learned nothing.

Right on the tail end of a horribly mismanaged PSVR 2 launch.

We still barely have any current gen only games, and a $700 price point is insane for such a small library to actually make use of it.

Meanwhile, here’s an excerpt of a response from Claude Opus on me tasking it to evaluate intertextuality between the Gospel of Matthew and Thomas from the perspective of entropy reduction with redactional efforts due to human difficulty at randomness (this doesn’t exist in scholarship outside of a single Reddit comment I made years ago in /r/AcademicBiblical lacking specific details) on page 300 of a chat about completely different topics:

Yeah, sure, humans would be so much better at this level of analysis within around 30 seconds. (It’s also worth noting that Claude 3 Opus doesn’t have the full context of the Gospel of Thomas accessible to it, so it needs to try to reason through entropic differences primarily based on records relating to intertextual overlaps that have been widely discussed in consensus literature and are thus accessible).

This is pretty much every study right now as things accelerate. Even just six months can be a dramatic difference in capabilities.

For example, Meta’s 3-405B has one of the leading situational awarenesses of current models, but isn’t present at all to the same degree in 2-70B or even 3-70B.

the teachings Jesus actually preached

Except that we really don’t know what those would have been, and there’s a pretty decent likelihood that many of the most popular sayings like “blessed are the poor” and “easier for a camel to get through the eye of a needle then a rich man to get into heaven” were additions after Paul and what later becomes the canonical church shift their splinter of the tradition to start collecting money from people.

“Want salvation? Too bad you have all that money - maybe we can help you out with that.”

For example, in apocrypha that has a decent chance of also dating to the first century, it depicts a Jesus ridiculing the very idea of prayer, fasting, and charity as necessary for salvation, instead characterizing it as a birthright for all people and those who give money to the church as being like people who take off even their clothes to give to someone else in order to be given what is already theirs.

This is arguably an even more transgressive tradition and version of Jesus than the one Paul offered up, and was more in keeping with the pre-Pauline attitudes about “everything is permissible for me” and the resistance to his rights to profit as an apostle discussed in 1 Corinthians.

There’s a significant survivorship bias in modern Christianity - for example, a tradition that changed the prohibition on carrying a purse and collecting money from people when ministering (Luke 22:35-36 - absent in Marcion’s version which was likely the earliest copy) was more likely to survive and thrive than ones that had limited fundraising capabilities as originally directed.

So while yes, he may have been all about helping the poor and downtrodden, it’s also entirely possible that a lot of it is a load of BS meant to separate fools from their money by an organization claiming to do those things on people’s behalf (you’ll notice in the Epistles vs gospels that Paul, who is supposedly collecting money for the poor back in Jerusalem, mentions a gift of a nice aromatic in Philippians 4:18, and then in the gospels written later on there’s a scene where Jesus is given an expensive aromatic and chastises those who criticize him for accepting it rather than selling it and giving the money to the poor).

Personally, I prefer the nuance in something like saying 95 attributed to Jesus in the Gospel of Thomas: “If you have money, don’t lend it at interest. Rather, give [it] to someone from whom you won’t get it back.” There’s a bit more nuance in that this addresses not an obligation for everyone including those struggling with money to give to the poor via the church but rather the inherent wisdom of recognizing the diminishing returns on personal wealth for the rich and the value in directly enriching one’s environment rather than hoarding a resource you can’t take with you (the point of the parable in saying 63 in the same work).

So while I’m inclined to think that a historical Jesus probably was against hoarding wealth stupidly given the overlap between unique extra-cannonical and canonical sentiments, I’m quite wary that the extreme degree of bleeding heart asceticism we see promoted canonically is much more than a sales effort by a parasitic organization that went on to build the Vatican off its back.