Wow good for Washington University in St. Louis

We don't talk enough about magical instruction tuning is

How long from GPU shortage to GPU glut?

👀👀

USV loves conversations - our first website was a blog (I think built on typepad) and it still basically is a blog today (runs on wordpress now)

So something new for 2024: usually the best way to develop our thinking is to get our ideas out to the public

Yet so much happens

Do labs still benchmark base models vs instruction-tuned models like this? At what relative scale do base model outputs beat instruction-tuned ones?

Love a zine

Happy Passover!

Good Dwarkesh Patel interview

And nicely done Teddy Kim on the transcript 👀

dwarkeshpatel.com/p/mark-zuckerb…

This looks absolutely nuts - can’t wait

It’s nice seeing the kind things everyone has to say about Dennett

The little philosophical prologue to “unbearable lightness of being” is so good

More novels should do that

Cool to see this kind of update from DeepMind

Seems like there's an emerging consensus that SAEs are the most promising path to ex post interpretability?

👀

Well said

this was so fun