Generative AI workflows and hacks 2023
March 23, 2023 — April 26, 2023
I will try to attempt synthesis of LLM hacks elsewhere. This is where I keep ephemeral notes and links.
1 Prompt engineering
- Deeplearning.ai ChatGPT Prompt Engineering for Developers
- Prompt Engineering Guide
- Pinecone LangChain AI Handbook
1.1 Writing matters
1.2 Coding matters
openai/openai-cookbook: Examples and guides for using the OpenAI API
LMQL: Programming Large Language Models: “LMQL is a programming language for language model interaction.”
LMQL generalizes natural language prompting, making it more expressive while remaining accessible. For this, LMQL builds on top of Python, allowing users to express natural language prompts that also contain code. The resulting queries can be directly executed on language models like OpenAI’s GPT models Fixed answer templates and intermediate instructions allow the user to steer the LLM’s reasoning process.
AI assisted learning: Learning Rust with ChatGPT, Copilot and Advent of Code
Mitchell Hashimoto on the mysterious ease of ChatGPT plugins
2 Economics of
This is the thing I am most deeply interested in theoretically
GPT and the Economics of Cognitively Costly Writing Tasks
To analyse the effect of GPT-4 on labour efficiency and the optimal mix of capital to labour for workers who are good at using GPT versus those who aren’t when it comes to performing cognitively costly tasks, we will consider the Goldin and Katz modified Cobb-Douglas production function
More at LLM economics
3 Information search matters
4 Left-field
5 Edge LLMs
Running those big cloud models on the edge, i.e. locally.
- Could you train a ChatGPT-beating model for $85,000 and run it in a browser?
- Large language models are having their Stable Diffusion moment
- Stanford Alpaca, and the acceleration of on-device large language model development
- Transformers.js Run 🤗 Transformers in your browser!
Impressive example: mlc-ai/web-stable-diffusion: Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support..
6 Incoming
- Open Brains
- The Practical Guides for Large Language Models
- Tree of Thoughts (ToT) | Prompt Engineering Guide
- RUCAIBox/LLMSurvey: The official GitHub page for the survey paper “A Survey of Large Language Models”.
- Mitchell Hashimoto on the disarming ease of using ChatGPT to write ChatGPT plugins
- Building A Virtual Machine inside ChatGPT