Content
summary Summary

An artist describes the experience she had after training GPT-3 with decades-old diary entries as a healing process.

Ad

Out of the box, large language models like GPT-3 generate compelling text. A recent update to GPT-3 with human feedback aligns text quality even closer to human needs. These models reach their full potential when they are fine-tuned with dedicated data for a specific use case.

Artist and creative coder Michelle Huang is using this opportunity to develop a chatbot that allows her to converse with her "inner child." Huang fed the AI with diary entries from her childhood.

As she shares in a Twitter thread, she kept a diary of her dreams, fears and secrets almost every day for more than ten years. The content ranged from complaints about her homework to her crush. Sometimes trivial, sometimes revealing.

Ad
Ad

"This way, I could accurately simulate what it would be like to talk to my childhood self, based on real data sources during that time period," Huang said. The artist believes that she has direct access to her former self through the chatbot, rather than risking her current self distorting her self-image through false memories.

"Young Michelle" asks about the dreams of the current Michelle

First, Huang asked her past self general questions about the world. The fine-tuned model answers these questions quite generally, but plausibly.

Today's Michelle: What do you think of the world?
Young Michelle: I think the world is fantastic and there is so much to learn and discover. I also think it's important to make a difference in the world and to be kind and understanding to others.
Today's Michelle: What is more important: freedom or love?
Young Michelle: I think both are important, but if I had to choose one, I would say love is more important. Love is something that can help us in any situation, while freedom can be lonely sometimes.

Huang then gave her digital reflection the opportunity to ask her questions. The model especially wanted to know if Huang had followed her dreams, and complimented her effusively.

"This specific interaction felt very similar to a normal texting conversation - as if i were texting my past self in real time," Huang writes.

Huang said she was surprised at how accurately the model could predict her current interests, albeit after much trial and error, and only from old diary entries. This led her to wonder if her path had long been mapped out in her psyche.

Recommendation

How to train your child's AI

After the overwhelming response, Huang shared her approach to GPT-3 fine-tuning in a second thread. This requires paid access to GPT-3 - she does not share how many of the paid tokens she used in her experiment.

Huang trained her chatbot with the following prompt. In addition, it is possible to influence the chatbot's tone with descriptions such as "the young [name] is loving, gentle, and very kind."

The following is a conversation with Present Michelle (age [redacted]) and Young Michelle (age 14).

Young Michelle has written the following journal entries:

[diary entries here]

Present Michelle: [type your question here]

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Summary
  • An artist trained GPT-3 with diary entries from her childhood.
  • This enabled her to chat in real time with her former self.
  • "I felt like I was walking through a time portal disguised as a chat box," she says, describing her touching experience.
Sources
Jonathan works as a technology journalist who focuses primarily on how easily AI can already be used today and how it can support daily life.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.