认知 L1 cache 对 agent 查询
00:01:00–00:05:00Insight
- 他承认自己会怀念手写指令,但不主张因此哀悼源代码本身。
- 写作和人际沟通被他当作仍需自己完成的工作,因为模型文章还不够让他信服。
主持人 Okay, Patrick. Thanks so much for being here. Welcome to Startup School. 好,Patrick。非常感谢你来到这里。欢迎来到 Startup School。
嘉宾 Great to be here. Harj and I first met 20 years ago and um uh he um we started a company together. I was going to give away the introduction. 很高兴来到这里。Harj 和我二十年前第一次见面,我们一起创办过一家公司。我是不是把开场介绍抢了。
主持人 Yeah, I I thought this was my interview, but keep going. You're doing a good job. 是啊,我还以为这是我来主持采访,不过你继续,你做得很好。
嘉宾 Well, we started a company together many years ago and uh I learned a huge amount from Harj. So it's a it's really fun to do this. 好吧,很多年前我们一起创办过一家公司,我从 Harj 那里学到非常多。所以这次对谈真的很有意思。
主持人 All right, let's um Well, actually I mean speaking of that. So when I think when I first met you 20 something years ago at the time your most impressive achievement I would argue was Chroma, your dialect of Lisp. 好,那我们其实说到这个。我第一次见到你大概二十多年前,当时你最让人佩服的成就,我会说是 Croma,你写的那个 Lisp 方言。
嘉宾 Any Lisp programmers here? Oh, wow. Okay, that was um I think I heard one whoop, which is more than I expected. Um but uh yeah, I I really liked Lisp when I was in high school. 这里有 Lisp 程序员吗?哦,哇。好,我好像听到一声欢呼,比我预期的还多。不过,是的,我高中时非常喜欢 Lisp。
主持人 Yeah, so what I was going to ask is um a prolific 16-year-old today could presumably just like prompt Claude to write their their Lisp dialect. Would you would you advise them to not do that and still still do it? Is there any value in such things? 对,所以我本来想问的是,今天一个高产的 16 岁少年,大概可以。直接让 Claude 写自己的 Lisp 方言。你会建议他们不要那样做,还是自己动手做吗?这类事情还有没有价值?
嘉宾 I don't know. I wonder a lot. Um Yeah, like I was saying on the one hand uh it used to be really fun to write all this assembly and machine code and to optimize your instructions and make layout in memory and everything and now we don't have to do that anymore. Compilers do it for us. We don't mourn it too much. And so maybe in the same way we shouldn't mourn source code. We should just transcend the plane of uh instructions to Claude at all, but um but emotionally I miss it. 我不知道。我想过很多次。一方面,以前自己写汇编和机器码、优化指令、安排内存布局,这些都很有乐趣,现在我们不必再做了。编译器替我们做。我们并没有太怀念。所以也许同样地,我们也不该怀念源代码。我们应该直接超越指令这一层,把事情交给 Claude 这类模型。但情感上,我还是会想念。
主持人 Um How about I you think just like as I've been hanging out here um with these students like they're so like maybe the question behind it is many of them are just wondering what should they be learning at college? Like what is sort of in this sort of AI world like how much should they be trying to learn and derive from first principles and how much should they just outsource to the AI? 那换个角度。我在这里和学生们相处,他们很多人其实在想:在大学里到底该学什么?在这个 AI 世界里,他们应该花多少力气去学并从第一性原理推导,又该把多少事情外包给 AI?
嘉宾 Right. Um, I mean, my model of this is, um, is cache. Um, you know, the c h not an s h, where Jeff Dean has this, uh, famous set of numbers that every programmer should know, uh, bandwidths and latencies and just kind of relevant constants you should have a reason about as you as you build systems. 对。我的模型是 cache,是 c-h 那个 cache,不是 cash。 Jeff Dean 有一套每个程序员都该知道的著名数字:带宽、延迟,以及构建系统时应当用来推理的相关常数。
And obviously, you know,thinking of building any system or distributed system or whatever, like, all lookups and all, you know, relevant bandwidths between different, um, components are are are very different, right? Uh, and you know, retrieving something from L1 cache is very different from retrieving from RAM is very different from retrieving across the network or whatever. And I think it's like that with knowledge. 显然,你在构建任何系统或分布式系统时,不同组件之间的查找和相关带宽差异非常大。从 L1 cache 取数据,和从 RAM 取数据,和跨网络取数据,完全不是一回事。
Well, fine, yes, you can ask the agent or something to compute something for you or to look something up for you or whatever. That's a hell of a lot slower than knowing it in cognitive L1 cache. And you can have way more round trips in your brain than you can, you know, muttering through, you know, super whisper or typing it out or whatever. 我认为知识也是这样。当然,你可以让 agent 替你计算或查找。但这比你自己知道它在认知 L1 cache 里要慢得多。你脑子里能做的往返次数,远多于对着 Superwhisper 嘀咕或打字。
And so, I think, even granting the full capabilities of the of the models, I feel I still think there's a a pretty, like, I think for for a long time to come, uh, neuronal lookups will be will be much faster. Um, and then, you look if you look in revealed preference, uh, at what uh, companies themselves are doing, whether they're companies like Stripe or the labs or what have you, um, there still seems to be an enormous premium on cognitive ability. 所以,即便承认模型已经具备全部能力,我仍然认为,在很长一段时间里,神经元查找都会快得多。然后,如果你看显示性偏好,看公司自己在做什么,无论是 Stripe 还是那些 lab,认知能力仍然有巨大溢价。
And so, I wouldn't I I I I think, um, renouncing that before there's evidence that we've saturated, uh, those benefits would be premature. 所以,在还没有证据表明这些收益已经饱和之前,就放弃这一点,我认为为时过早。
主持人 Um, I mean, are there are there specific things that maybe you personally, either personally or as uh, CEO of Stripe, um, you still you purposely choose to sort of do yourself and like retrieve from your own cache, um, even though like the agents would probably do a reasonably good job. Um I still I still write myself. Like I I um I don't I I both philosophically but also uh specifically, substantively, uh dislike the writing of the models. 那有没有?一些具体的事情,。无论是你个人,还是作为 Stripe 的 CEO,你仍然有意自己做、从自己的 cache 里取出来,即使 agent 大概也能做得不错?我仍然自己写。我既出于理念,也在具体内容上,不喜欢模型写出来的文字。
I mean, it's very interesting, right? Because these can prove the Jacobian conjecture, you know, whatever. Uh and so clearly they're capable of these monumental feats. Um but somehow I still haven't read the LLM essay that I found super compelling. Now, maybe it's just very hard to like RL limit that domain because the you know, the utility function or something is kind of hard to define. 这很有意思,对吧?因为它们能证明 Jacobian conjecture 之类的东西,显然有能力完成这些了不起的壮举。但不知为何,我还没读到过一篇让我觉得特别有说服力的 LLM 文章。也许只是很难用 RL 去约束那个领域,因为效用函数之类的东西很难定义。
Um but yeah. Um I I think writing is a pretty I interpersonal communication and writing I think are so very fundamental and so being able to reason sensibly in the multi-dimensional space of reality. And in some kind of indescribable way, I feel like the model is still kind of deficient at that. 不过,我认为写作是相当… …人际沟通和写作都非常根本,也就是能在现实的多维空间里合理推理。某种难以描述的意义上,我觉得模型在这方面仍然有欠缺。
And so I've never I've yet to send, you know, every tool is now trying to prompt me with, you know, pre-written uh suggestions, whether it's, you know, Gmail or uh apparently WhatsApp just rolled this out. Um and I think I've still sent zero of those in my life. No. 所以我还从未发出过——现在每个工具都在向我推预写好的建议,无论是 Gmail 还是显然 WhatsApp 刚推出这个功能。我想我这辈子发出去的条数仍然是零。没有。