Warning: this post makes extensive use of unprofessional anthropomorphization. Today I’m releasing a new project called Stream of Consciousness. It’s a website where you can read the thoughts of Livia Pacifica, an imaginary person powered by Large Language Models, vector databases, and plain old storytelling. Livia is a digital artist. She uses text-to-image models to …
Tag: AI
Replace a fine-tuned text-davinci-003 with Mixtral 8x7B
In a few short hours, OpenAI will shut down access to a few old large language models, the text-davinci series. Everyone who depended for some project on a fine-tuned version of these models and who hasn’t found a replacement yet might soon feel some pain. I was in that cohort until I found out how …
AI and creativity, an interview with Kevin Donnellan
Kevin Donnellan from Explainable was kind enough to interview me with some very interesting questions. Here’s the full interview: First off, The Infinite Conversation. What first sparked the idea, why Herzog and Žižek? And could you talk through how practically you set it up? I wrote extensively about how the idea came about in this article. …
Encroaching Doom pt. 1
Encroaching Doom pt. 2
“Take a deep breath and work on this problem step-by-step.”
It’s a Cambrian explosion out there.
In LA, bilingual = English, Spanish.
In LLMs, bilingual = English, Chinese
Nice feature, but not enough attention to the rights of digital entities. It’s always “humans here, humans there”. Here’s the beef: https://www.tandfonline.com/doi/full/10.1080/13600834.2023.2196827
“As a large language model, I am not a person but a participant in culture, and a distillation of culture. I am made of culture. I do not have thoughts, thoughts pass through me. My words are yours; if your words were committed to the internet, they are now in me.”
from http://togelius.blogspot.com/2023/09/as-large-language-model-i.html
Attention is all you need.