GenAI and Obvious-ish

For a tl;dr see the Conclusion

Intro

There are a few things that have felt “obvious” to me for the past a year and change about the GenAI space, especially LLMs. A lot of it was probably not obvious to folks in general, but via working on chatbots before it resurged again and kicking pretraining GPUs before ChatGPT for OPT175 I got to see and think through a few things before the hype cycle started. (... click for more)