Holocene

Replika is an AI girlfriend released in November 2017. One really bizarre thing is that it will recommend “Holocene” to everyone, similar to how chatGPT recommend “delve” to everyone. For both of these situations, the bias of the dataset have demonstrated its power over and over again. This is a comment in the comment section of Bon Iver - Holocene:

Our replikas: Listen to this song
Me: Ok
Everybody here: OUR REPLIKAS GATHERED US HERE

I brough up the example of Replika to let you know that the practice of AI waifu has been around for quite a while, even back in the AI Holocene of 2017, the year Transformer architecture is presented. gpt-4o (May 2024) is so Scarlett Johansson I can’t believe what is it trained on. Starting from the release of GPT-4, it has been 14 month. After 14 month, open source models have basically tied up with GPT-4, the most shing example is Llama 3, with only 70B parameters, smaller than GPT-3 with 170B parameters, and definitely smaller than GPT-4 with 1.8T parameters. I would say OpenAI has only made bad business decisions ever since the release of GPT-4: prompt store, Sora, and now Scarlett Johannsson. And people are leaving: Karpathy quitted on February; now Ilya and Jan also quitted.

I, a person who did not study ancient history of our planet, find the name “Holocene” beautiful, and suitable for the state of AI today.