These posts are "half-baked", meaning semi-published.
Think of them like drafts that for some reason have been made available anyway.
They might disappear or change dramatically. But likely the urls will continue to point at something relevant.

Original Internal intro I wrote for NNTD

When I had my Non-Naive Trust Insight in mid-2020, I initially conceived of it as a patch on what we were doing at the cultural incubator I’d been living in for years, and I drafted this intro in Roam intended to convey it to the people I was living with. Things got pretty weird and I didn’t quite get it to the point of finishing it to share it with them at the time (although it wasn’t private—technically they could have looked, since it was in our shared Roam). So I don’t know how it would have landed. Some of the terminology or assumptions referenced below may be opaque. Feel free to comment asking for clarity.


The impediment to action advances action. What stands in the way becomes the way.” – Marcus Aurelius

“If you can trust yourself when all men doubt you, but make allowance for their doubting too.” – Rudyard Kipling

Malcolm’s initial introduction to the Non-Naive Trust Dance, mostly written early October 2020

The [[[[non-naive trust]] dance]] is a framework created by [[Malcolm]] for modeling how [[non-naive trust]] is developed within and between people, which of course includes the nurturing of self-trust within each individual.

  • In the same way that aerodynamics describes how birds and bats are able to fly, even though birds and bats don’t understand aerodynamics conceptually, the NNTD framework is descriptive, intended to be a model of how that trust-building process must necessarily go, whether people are using the framework or not.
  • Also, like how understanding aerodynamics allows someone to build a plane or a rocket, understanding the NNTD framework allows someone to create & enact more effective trust-building moves, both proactively and improvisationally.
  • One cannot break such laws (as they actually are, not just as they are understood) but one can fail to understand or respect them, and if one does, one’s attempt at trust-building or flight will have trouble getting off the ground.

So far, in this document, I at various points refer to “distrust” or “doesn’t trust”, which is a somewhat incoherent concept in the context of [[non-naive trust]] based on [[self-trust]], where all trust is “positive”; there’s no such thing as distrust.

  • This is partially short-hand; I think there’s a way to express all of this that is compatible with that understanding.
  • Perhaps “A distrusts B” could be expanded to “A has some sense that A & B cannot have a consistently samesided interaction, in this context etc”
  • …maybe the answer is something like “there’s no need in the target culture for distrust, but it’s an inevitable part of the transition, and thus a vital energy that needs to be harnessed”
  • EDIT 2025: I now basically just think that distrust is fundamental, maybe even moreso than trust.

This applies to all scales:

  • dialoguing between internal parts (similar to IFS)
  • dialoguing between people (which inevitably involves their parts)
  • dialoguing between groups (which inevitably involves individual people)

A guide to being as trustable as you are.

Core principles of the NNTD

The collaborative mindset is always preferable to the coercive mindset

This means that if someone is not choosing the collaborative mindset, there must be something they don’t understand about it, or some part of them that has a different understanding that they haven’t yet integrated. Whatever their concept of “collaborative mindset” is, is in some way confused or incomplete.

This also means that if someone experiences “choosing the collaborative mindset”, there is still some unintegrated part, because if they had a fully-integrated understanding of H3, it wouldn’t feel like a choice, it would just be the obvious way to operate.

To be clear: incomplete versions of the collaborative mindset are not a problem to be avoided—by contrast, they are a necessary element within the bootstrapping process, both internally and interpersonally.

A robust non-naive trust-building process must work the same regardless of the parties involved

One thing I mean by this is that it cannot start from the assumption that any particular person (or group, or part) is trustable.

  • That would be backwards: assuming the answer as part of trying to explore the question.
    • That means that the process must necessarily look the same, in some sense, between 2 entities (groups/people) that are both fully operating from H3, and 1 that is and 1 that’s in a muddle, or 2 that are in muddles.
      • Although in the cases where there are muddles, there is going to be a different kind of learning process that also operates.
    • (It’s conceivable, also, that 2 groups could both be running the H3 operating system and unable to come into non-naive trust of that fact. The simplest example would be if one group spoke only Finnish, and the other group spoke only Hebrew, and they had no translator.)

Historically, the LRC/Upstart/LSA ecosystem has functionally operated with Jean in the role of trustably-operating-from-postjudgment. This has been vital as part of being able to learn the new mindset to have someone who is consistently not judging and able to say that they’re not judging, because:

  • that person can function as a role model
    • so that there’s a mode of being to move towards, not just trying to get away from dysfunctional dynamics
  • it simplifies situations in that it allows other people to reorganize their systems to see their own projections
    • if you have 2 people who each think the other is judging, it’s very hard to sort out what’s actually going on
  • it can sometimes get people to dialogue between their own internal knowings
    • they can anchor on a sense of “I know I’ve had a really clear sense that this person does not do judgment” and then seek to reconcile that with their current perception that the person is judging

However, this approach is fundamentally limited.

One limit it encounters is that, in the learning process, people may not be able to distinguish between “the role model is not judging me” and “the role model won’t enact patterns of behavior that result in pain/suffering for me” (including but not limited to the pain/suffering of feeling judged)

As a result, they will tend to not know what to expect, nor how to clearly articulate their expectations in order to get shared reality on them.

So they may—appropriately—feel betrayed, and this creates a big experience distrust that ultimately needs to be digested.

Even if the role model is operating from a consistent stance of postjudgment,  that doesn’t mean the role model can be relied upon in various other ways, and this needs to be talkaboutable without it calling the role model’s postjudgmental stance into question.

Some of the limits are related to us not having been able to adequately point at what “judgment” means in such a way that people could recognize when they or others are doing it, independent of someone else pointing at it.

But the bigger element is simply that in order to truly develop [[self-trust]] and [[non-naive trust]], one needs to start on a foundation of not assuming that someone else is trustable.

There’s no such thing as an “H2 part”

(EDIT 2025: H2/H3 is short for “Humanity 2/3” and is similar to “Game A/B”. We’re referring to the cultural platform based on judgment and coercion that has broadly underpinned most of human culture for the past 10,000 years or so. I don’t use these concepts as often any more.)

…in the same sense that there is no such thing as an “H2 person”.

One can talk about “a person who was socialized in H2 and doesn’t know how to do H3” or “a part that is operating with H2 assumptions”.

In much the same way that Game B isn’t about having a tiny minority who understand it rule over everyone else, Getting to a place where a whole person is operating consistently from H3 doesn’t involve anything resembling “handing control over to H3 parts instead of H2 parts”, but “all parts learning what H3 means for them.”

All of these parts are caring for things, and they all need to learn to work with those cares in collaborative ways.

This is related to the above principle, The collaborative mindset is always preferable to the coercive mindset, which is true on all scales. If a given part of someone’s experience is not collaborating, there’s something it needs to understand better.

If A doesn’t trust B, or is not able to lean into some sort of connection with B, then…

This does not mean that B is “not trustable”

Nor does it remotely contradict person C trusting B, or B trusting their own relevant capacity.

Different people have both:

  • different experiences of B
  • different things they’d need in order to trust something, based on past experiences of how H2 betrayed them

A is standing for some sort of integrity; to simply trust would be naive, and would not build non-naive trust.

(this applies to A & B being people, or parts/perspectives of a person, or could even apply to whole groups)

Often, A has a different perspective, internally, that does trust B.

In this case, one way the scene might go could involve A flipping that part into consciousness/control, which would result in leaning in but would still in some fundamental sense be naive.

Another way the scene could go would be to get those parts in dialogue, so they could come to some sort of larger shared understanding, that would potentially allow leaning in, though might also set a kind of boundary, or whatever.

Sometimes, for A, speaking to the sense of distrust etc and having that be received, is enough to disconfirm at least the surface level of what is happening, and create space to lean in. We’ve experienced this a lot over the years. Sometimes, for whatever reason, it’s not.

Honoring & validating A’s integrity is vital, while also fully validating B’s integrity.

There’s a kind of stance that someone in B’s position can access, that says something like “Of course you can’t trust me. That makes sense.”

It’s great when B is able to understand deeply the historical context for the distrust, whether specific to the A-B or related to A’s childhood or [[School-Prison culture]] trauma.

However, being able to understand the specifics is entirely unnecessary to be able to respond from this 100% validation place.

The stance requires only these two things:

  • Accepting that reality is as it is
  • Honoring human minds as sense-making organs

From that perspective, one can say “of course you’re having the experience you’re having and interpreting it the way you are! how could it possibly be otherwise?”

We’ve done a lot of this validation here in a kind of implicit way, and my model and experience is that it actually can be remarkably powerful to do it explicitly, repeatedly. There’s a lot of unlearning to do of the H2 culture within which we constantly had our experiences & perceptions invalidated.

This is core to all 3 of the elements-to-be-nurtured in the center of the [[Collaborative Circle]]:

  • The Learner
  • Trust of self in the universe
  • A systems way of understanding

H2, [[School-Prison culture]]., is constantly saying “you should trust”. (EDIT 2025: see Oppressive cultures: you don’t get to know what you know)

As far as I can tell, nurturing H3 requires not just not making that demand but actively subverting the implicit presence of that demand whereever it could arise. This is something that everyone has 100% co-responsibility for.

I think to some extent we’ve avoided doing this explicit validation from a fear that it would set up an external source of validation which would reinforce H2 in some way.

From my experience, that doesn’t appear to be what happens!

I think part of what makes the difference is the unconditionality of the stance described above:

it’s clearly not validating some specific response, with an implication that other responses would be invalid

it’s instead inviting the person into a paradigm where all experiences are valid

Another part of what makes the difference is that everyone is being validated simultaneously.

Even if A says to B “I think you’re judging me” and B is really clear internally that B is not judging A, then B can still say “it makes sense that you can’t trust that I’m not judging me” while also clearly holding “it makes sense that I can trust that I’m not judging you” (although in practice this often does not need to be stated; it’s simply embodied by an utter lack of apology, submission., on B’s part)

Validating A’s not-leaning-in in one moment doesn’t invalidate past experiences B may have had of A leaning in

People are multifaceted. A may feel safe leaning in in some situations and not in others. Neither A nor B nor anyone else may fully understand why, although with adequate time, space, and technique, it can basically always be untangled and figured out.

It’s common for people to respond to someone feeling less trust than they did some other time by trying to get the person back in touch with the trust they had before.

It’s my current model that this is almost entirely counterproductive.

Here’s how I relate to this now (when I’m on my game)

  1. The part that I connected with before is still there. I don’t need to worry about that part.
  2. In front of me right now is a different part, and that part doesn’t trust me.
  3. What does that part need to say to me, or hear from me, or experience, in order for us to take a step or two towards building trust?

When I take this perspective, it’s obvious to me that trying to get the person back in touch with the trust they had before ends up pushing away the part that is actually present, which does not build trust with that part. This means that even if I succeed at getting the person to flip into some other perspective, that distrustful part that was there before still distrusts me just as much, if not even more.

I think that in practice part of why people find doing the move above hard is that they become internally disturbed by experiencing an apparent loss of the former connection, and are unable to hold that disturbance.

This could be articulated as an internal trust gap:

  • Part B1 says “oh no, this person doesn’t trust me”
  • Part B2 says “but they trusted me before—this can’t be real”

and what’s needed here is for both parts to recognize that they’re holding part of the truth:

  • yes, they currently don’t trust you
  • yes, they trusted you before

these don’t contradict

People in B’s position also often seem to think that what’s necessary is for A to internally-dialogue and sort out A’s parts that disagree on how trustworthy B is. This is sometimes possible but even when it is it requires substantial skill and emotional capacity that A may not have (and that B can’t assume A has).

But often the kind of evidence that A1 has used to know B is trustworthy is not valid evidence to A2, and so it’s actually approximately not possible for A to get in sync with B while A2 is active (as opposed to suppressed or compartmentalized or inactive because it isn’t relevant to the situation as construed by A). This is fractally equivalent to how just because Person X trusts both Y and Z in some ways, doesn’t mean Y and Z trust each other. Trust is not transitive like that when it comes to anything complex or interpersonal. (It somewhat is when it comes to deferring to experts on external matters.)

Learning happens roughly via reorganization, as described in the Perceptual Control Theory model

^^< TODO: summary of this model – needs to define what “intrinsic error” is so that the below paragraphs scan; TL;DR = PCT is a cybernetic model of action and perception. some control systems are created by other control systems, but others (such as hungry, thirst, temperature-regulation, sleep, as well as probably more subtle things like belonging or orientedness) are “intrinsic” >^^

Punishment doesn’t work even when it’s unintentional or projected

First we might ask: what is punishment and why doesn’t it work?

Perceptual Control Theory can articulate this beautifully in a few paragraphs:

Before going on to consider possible complications of this simple picture of learning, we must consider aversive reinforcement, which I have left out of the discussion to prevent confusion. Aversive reinforcement, or punishment, is anything that causes or increases intrinsic error. If a behavior pattern regularly causes intrinsic error, the reorganizing system will be driven into activity by that behavior, and that behavior will be reorganized out of existence. (I trust that the reader can supply his own reminders that avoidance behavior can be a learned control phenomenon, too: reference level of zero.)

As B. F. Skinner (1968) has proven beyond doubt, punishment is a poor way to teach anything. All that punishment can do is cause behavior to reorganize; it cannot produce any specific behavior, because reorganization can be terminated by any change that destroys the feature of behavioral organization causing the intrinsic error. Using aversive reinforcement, one can be sure of eliminating some aspect of behavior, but can have no way of predicting what the resulting new organization will do. Behavior is capable of change in too many dimensions to permit a person to think of controlling it by hemming it in with punishing consequences that leave only the desired behavior unpunished. It would seem that neither punishment nor reward is a good way to change behavior.

In spring of 2018, I had a conversation with H

in which we had an exchange something like this:

H: “I just feel so uncomfortable here! And I know it’s not supposed to be comfortable.”

Malcolm: “Well, it’s one of the most comfortable places in the world to be operating from H3. And one of the most uncomfortable places to be operating from H2.”

I now understand my comment there as having been accurate to how we were holding things at the time, and no longer in line with my understanding of how to make learning work effectively.

Making things maximally uncomfortable for H2 patterns causes rapid reorganization, including:

  • things that get us closer to H3:
    • revealing those patterns
    • going meta
  • things that create more tangles
    • avoidance behaviors (hiding, etc, on various scales)
    • suppressing those patterns
      • (which can lead to anxiety, depression, and/or oscillations)

Similar to the section on validation, I think there has been a model, sometimes implicit, sometimes more explicit of not wanting to “reinforce” the H2 patterns.

The concept of “reinforcing” comes from a conditioning-based model of learning (Skinner etc), which is not compatible with the cybernetic systems model of change that

^^< pull in stuff from the 5k deal doc >^^

Examples / case studies

Me doing internal NNTD that day in August:

(A & B are both parts in me)

A: I’m afraid I’m not doing a good job

B: No! I know I’m doing a good job.

B: Wait… A, I hear that you can’t trust that we’re doing a good job. That makes sense. I know you’re scared.

A: *feeling seen, cared for*


EDIT 2025: There are now more case-studies of internal trust-dancing. I’d like to publish some of interpersonal trust-dancing as well but they, oddly, tend to feel a bit more personal and/or more of my experiences of them were not in contexts where I was recording. Maybe they’re also just more complicated.

There are now also many other introductions to NNTD!

Explicitly “NNTD”:

Subtly/implicitly “NNTD”:

Two modes of intersubjective knowing

My first post attempting to deconstruct objective & subjective was 10 years ago, and at that time I tried to fit objective into subjective. It now seems to me like the whole thing is confused. So what are we to make of the nature of knowing? John Vervaeke uses the fancy word “transjective”. Whatever is, it’s relational, it’s perspectival, it’s a kind of interface. I like Don Hoffman’s Interface Theory of Perception a lot, which is one of several inspirations here. Perspective is interfaces all the way fractal.

Thoroughly deconstructing a duality requires, from my perspective, offering a better answer to the sorts of situations that would be inclined to reinvent the duality. Here’s my latest: instead of objective-vs-subjective, consider two modes of relating to intersubjectivity. (By default I’m going to talk about two individual people, but the same dynamics apply to some extent between groups and between parts of a person.) The modes are:

  1. 👩‍🔬 we are taking for granted that we’re seeing and framing things in a compatible way (enough for the purpose we have, whether that’s solving some concrete problem, making sense of things in general, or connecting intimately)
  2. 🫨 we are grappling with an incommensurate experience of not being able to make our senses of reality meet at all. there’s a breakdown of whatever ad hoc shared reality we had, and we’re in a state of chasm

These are a kind of co-epistemological equivalent to Heidegger’s distinction between how a tool feels when you’re using it—transparent, obvious, unremarkable, like an extension of yourself—vs when it’s broken and you’re trying to fix it—opaque, problematic, exceptional, self-conscious. It’s just here, the “tool” is the conversational interface between you.

These modes are, I think, both necessary, just like breathing in and breathing out (although the latter can be viscerally uncomfortable, sometimes to the point of nauseating). They show up on different levels of abstraction, and to different degrees. On a relatively trivial level, consider this ordinary exchange:

Charles: want to come over on Saturday afternoon?
Sharon: I can’t, I’m spending the day at Katelyn’s.
Charles: wait, huh?? Katelyn is in Minneapolis all month!
Sharon: [any of]
• yeah she is but I said I’d go over and take care of a bunch of her house stuff
• ahh, yeah no, she had to come back early because her kid got sick
• wait really? we made the plans a long time ago, maybe she forgot…
• whaaaa…? ohh, haha! no, Katelyn Jones, not Katelyn MacPherson

Initially, they’re in mode 1, so Charles isn’t guarded towards Sharon, so when she says that she’s spending the day with Katelyn, he lets Sharon’s view of the world into his, and he’s suddenly got double-vision: this Saturday contains Katelyn being both here and elsewhere at the same time. In this particular exchange as written, he still expresses what he knows without doubt: not “I thought Katelyn was…” but just “Katelyn is”. In so doing, he’s putting this double-vision world into the middle of the conversation, to be shared with Sharon.

And then Sharon responds with something that attempts to reconcile the double-vision into one world that once again makes sense. In this situation, it probably only takes a few utterances, whatever the issue is—maybe the confusion lasts a couple minutes, at most. But some are much more complicated, for various reasons.

Mostly I’ve been presuming this is an innocent misunderstanding, but suppose that what Sharon thinks when Charlies says “wait, huh??” is actually “oh shit, wait, the two of them had that weird date and afterwards he was super clingy… did she lie to him and say she was out of town?” In this case, there’s a much deeper reality breakdown, that may not be readily resolvable in this scene, since Sharon may be inclined to lie as well to preserve what she assumes might be Katelyn’s secret. Not the best example, but you get the idea.

(Importantly, this phenomenon occurs to the degree that the people in the conversation are making sense of what they know—Charles’ sense that Katelyn is in Minneapolis is likely not an isolated propositional knowing that he just tacked onto his sense of things—even if it was mostly from something she said, it was also based on the vibe with which she said it, and his sense of her being reliable, and everything else he knows about the situation such that her being in Minneapolis fits with his whole sense of what’s-going-on-in-the-world.)

Relatedly, consider what happens sometimes when someone mentions a party without realizing that someone in the room hasn’t been invited: awkwardness, as the scene adjusts around a shifting sense of the social web’s priorities. Or when news is revealed that someone would have expected to know sooner. A real example: I got married recently, and there was a friend/acquaintance who had known for months that we were engaged, and a few weeks before the wedding they asked if we had a date planned. When I said it was in a few weeks, I watched their face express mild shock and pain—what I interpreted as a revelation not just (a) that they weren’t invited but also (b) that that implied some mismatched sense of the closeness of their relationship with us. We didn’t talk about it at the time but we’ve gotten closer in the months since and so I’ve been meaning to because I think it would be good to hold the situation together.

In these situations, people are still on the same page about the kinds of categories they’re using though: parties, invitations, friends, Minneapolis. Where things get really weird is when people encounter not just different facts the reality that they aren’t even experiencing the world in terms of the same basic primitives, which may not even be able to be named, or maybe we have shared vocabulary but wildly different webs of association. Consider the kinds of tensions that arise when talking about free will, or God, or morality, or coercion, or artificial intelligence, or intelligence in general, or parenting…  or most of what I write about. This can be in the abstract, or it can be about some specific situation that invokes some of these terms.

Our maps are never, ever, the same. They are sometimes similar enough (for a given situation). But the operative question is not how similar they are but how compatible they are. In many situations, we don’t even need to be able to see how they line up—if we can navigate together, that may be good enough! In fact, many areas of human endeavour, from dancing to marriage to corporate teams, involve forms of specialization where people deliberately develop different interfaces with reality, that are designed to interface well with each other.

See it’s interfaces all the way fractal for more on this.

< something about semantic arguments >

“What the fuck is common knowledge?”


meta on this post:

  • it seems like a solid draft as long as it is, and then the question is basically:
    • should it say more and if so what?
      • maybe reference Satanove stuff (which I implicitly do with Heidegger but could have more)
    • I think it would be cool to have more examples:
      • where it gets entrenched rather than quickly resolved
        • (maybe an argument about whether someone is trustworthy?  the recent “sociopath” example comes to mind)
      • one from science or something paradigmatic and impersonal
      • one internal
      • one political / re groups on that scale
  • do I want to have NAMES for the two modes?
    • Heidegger’s names are bad
    • they sort of map onto something like “transparent meaning” & “broken meaning”
      • or “transparent frame” / “broken frame”
      • “workable frame” / “frame problems”

It’s Interfaces All The Way Fractal

my close friend & colleague Michael Smith asked me

Question for you: In terms of Donald Hoffman’s interface interpretation thing, have you found a way to suss out how different someone else’s interface really is? Like, a way around the freshman philosophy problem of “Do you experience what I call ‘red’ as what I’d call ‘blue’, but you just call it ‘red’ too?” But deeper. Like, I wonder whether “thing” and “other” and “space” are coded radically differently between people. I’d expect that your perspective-taking practices might have hit on something there. So I’m curious.

The short answer is pretty well-articulated by @yashkaf here, but of course we can do a longer answer as well!

Freshman color philosophy

My overall sense is that first order human perception is in some important sense pretty similar, although of course blind people are in a very different world. This is what allows us to maintain the illusion that it’s NOT all an interface.

Yet simultaneously, our experiences of everything are radically, radically different to a degree that is hard to fathom. Hoffman completely dissolves “Do you experience what I call ‘red’ as what I’d call ‘blue’, but you just call it ‘red’ too?” There is never a “is your red my red?” in the abstract. That’s like asking “is this apple that apple?” like uhh no they are different apples.

And thus in some ways, my red actually has more in common with my own blue than it does with your red. Both of my colors are entirely composed of all of my own experiences.

However, of course, your and my “red” are more compatible than my “red” and “blue”, for many reasons that are obvious but I’ll say them anyway:

  • we call them the same thing (since we’re both english-speakers)
  • we have many many very consistent shared experiences of red as having associations with noncultural things like spilt blood and strawberries and sunsets
  • we share a bunch of cultural associations like love, violence, stopsigns, santa, Coca-Cola®, and perhaps giant dogs

All of which would lead us to create compatible or commensurate interfaces with red, such that we don’t encounter many differences there when we go to talk about it. And the word “red” is an interface we share for referring to this pattern.

For what it’s worth I suspect actually that there are real subtle interfacial consequences to things like the fact that red is higher wavelength (lower energy) and for humans the fact that our red & green cone cells are much closer to each other than either is to blue (rods are between blue and green). I don’t know what the consequences are, but in an important sense it must matter. A tetrachromat (with a fourth kind of cell) would experience most colors quite differently. And of course colorblind people do.

(from BenRG on wikipedia)

However, the question of similarity or compatibility has an implicit context. You can do that with the apples too: are these two apples the same apple? Well in some sense of course they can be, if we know what we’re doing. They can be fungible or equivalent or undifferentiated, for some purpose.

And of course there are many ways in which our interfaces with the color red may be incompatible. When I try to point at these, they seem symbolic, somehow separate from the level of perception.

If you’re American and I’m Canadian (which I am) then you might be surprised to discover that for me, red is associated with the political “left wing” and blue with the political “right wing” (I’ll caveat that these concepts are themselves ever-shifting coalitions, not very natural categories). In fact, my way is more common in the rest of the world (and historical America); the phrase “red states and blue states” originated in 2000 with one particular TV announcer’s choice of colors (from the american flag). So is my red your blue? In this sense, yes!

And this is helpful to talk about color because it’s true for basically everything you could possibly want to talk about, and color perception is the MOST basic aspect of reality you can get, or close to it.

Which is maybe why the philosophers use it in this thought experiments!

Interfaces of interfaces

Part of why Hoffman is so radical is that he highlights that it’s actually something-like-meaningless to say “my interface with Y and your interface with Y are more alike than those interfaces are with Carol’s”. They can’t be alike or unalike; they can’t be compared; they’re made out of different stuff! Mine are made out of my experiences and yours are made out of yours. That’s all in terms of the subjective interface, that is—you can obviously talk about our behaviors having something in common.

The actual question is ITSELF about interfaces again. Not “do you and I see this the same way?”—we don’t. Full stop. Next question.

And the next question is “do we want to describe how we see it, the same way?” on a propositional level.

Or “is my interface with Y able to interface with your interface with Y?” on more of a participatory level.

And it might be that we can effectively dance together, even though we have radically different descriptions of what dance is or what it means to us or how it works.

Having said that… there’s still clearly obviously a thing that we mean when we talk about difference, or perhaps distance. While writing this up, I intuitively used the metaphor of “how far apart people are” and this is actually a different metaphor than similarity, although we often use distance as a metaphor FOR similarity. And maybe we’ll also talk about what lies in that distance—is it a smooth pathway or a complex dance?

  • uncheckedmaybe something about eyes/parallax

Ah yeah, it’s like, how complicated is the transformation we need to do to my interface in order to turn it into your interface? And in some super simple cases that transformation is basically a null operation except for the “entirely composed of your experience, rather than entirely composed of mine”, but they share the same structure and they sit in each of us in a similar way, so we round them to “same”.

In particular, mathematical objects can be extremely like this (though not as much as people might assume). Also if we have a shared experience of something happening to us both together, that can become a reference point (assuming we experienced it “much the same way”).

So let’s try that.

How can you tell how far apart people are?

have you found a way to suss out how different far away someone else’s interface really is?

There’s a kind of vast vector space here, and again it depends a bunch on context.

Like if there’s certain kinds of things at stake, and low trust, it can be very hard to get people to agree with boring statements that they would other times themselves utter as axiomatic premises (eg “we live in a society” or “humans are a kind of animal”) because they don’t want to allow the other person to set the frame and then force them using logic into accepting some conclusion they disagree with.

In general, one of the things I keep an eye out for is if there’s something where it’s easy for me to express it to Alice and hard for me to express to Bob. that’s a sign that me and Bob have a big weird gap/chasm/shear—in relation to that topic or knowing, not necessarily “in general”.

Interestingly I suspect it’s possible (tho not super common) that Bob could ALSO express relevant things to Alice that he can’t express to me.

This could be because Alice has a viewpoint that is a deep synthesis of mine and Bob’s. [depth perception metaphor]

More commonly, Alice has the ability to take either of our perspectives at a given time, but not both. So she can step into one frame or the other, and resonate with what we’re saying. and both of those are sort of workable ways of seeing things for her.

Whereas if I were to try to see things Bob’s way, or vice versa, it would produce some major discomfort for me because it would seem to violate something I know about the world.

It could be that Alice does not actually have that additional knowing, and that’s why she’s able to hear us, or it could be that she has that knowing and also has some additional knowing that makes it not-an-issue.

Important to track here is a principle I have which is something like “everybody contains explanations of literally everything they have ever experienced. Necessarily this involves making a bunch of absurd generalizations”.

But people can have very compartmentalized explanations, where they can’t actually simultaneously explain X and Y, and if you get them to try they get distracted or flustered or angry.

This is kind of developmental stuff I guess also, except it doesn’t necessarily map onto any common ladder like Kegan stages.

Apparently basic aspects of experience

As for…

Like, I wonder whether “thing” and “other” and “space” are coded radically differently between people.

This seems very very true to me, not just of the words but of what we would consider the referent.

[this post is half-baked and I didn’t finish this part and as of the moment I’m publishing it I’m not even sure what exactly I was gonna get at here]

Better LLM meta-prompting with a Molasses Bread recipe

(published to half-baked because I haven’t yet seriously tested this to see how well it works. in principle, if you drop it (here it is as a gdoc) into an LLM that you’re trying to get to write prompts, it will do a better job.)

The Backstory

Malcolm’s grandmother, GG, made amazing molasses bread.

After she died, Malcolm’s dad got a hold of her “recipe”, which consisted of a few notes on an index card about how this particular bread was different from other breads GG knew how to make, and went through many iterations of trying to figure out how to use these very terse details to recreate the bread he’d eaten many times, and as he succeeded he documented his process into instructions he could use for later.  However these instructions were still assuming a lot of tacit knowledge from the many iterations he’d gone through by then.

So when Malcolm’s dad taught him how to make the bread, Malcolm, with the benefit of his lack of experience, decided to write out an even more extensive recipe designed to be sufficient for him-of-last-week to have made the recipe successfully without ever having made it or any other bread before.  In other words, articulating almost every missing assumption.  Of course, probably this recipe would still result in errors from someone who had never cooked or baked before, who could then write their own version to fill in the details.

The Implications

…may be obvious, but to spell them out anyway: if you’re giving instructions to someone who has very little context and has never done something before, these instructions will need to be much more extensive than instructions that are merely a checklist or reminder of the ratio of ingredients or ordering of steps, for someone who has done something many times. And this is all relative!

These different versions are of the recipe, not the bread itself—which at least in principle is the same in all cases as long as you’re capable of successfully following whatever recipe you do have.

Notes from world-class LLM-prompter Amanda Askell:

  • It sometimes works best to give few-shot learning examples from a very different domain; eg in a reading-extraction-summary task for an business context, using a kids story as an example.  This helps the AI generalize the structure of the task without getting too fixated on details from the example
  • You need to educate LLMs about how to do the task they’re performing, not merely tell them to do it.  That like an employee who just started today, they may be missing context or relevant skills or understanding, but they can be caught up to speed very quickly.

In other words, a “prompt” is not just “instructions”, but education.  Good prompts include principles, and explain key concepts, and include reasons why certain approaches work better.  They highlight   They even create relevant insight in the LLM (systematic shifts in problem framing that preclude making certain kinds of errors).

This document, both the story above and the recipes below, is intended for the purpose of doing such education for those who wish to prompt LLMs well.

In particular, it is intended for the purpose of doing such education for LLMs, for the purpose of doing such education for LLMs: meta-prompting.  In other words, if you’re trying to get an LLM-instance-1 to input a book and output a prompt that a future book-naive LLM-instance-2 could follow in order to perform some method…  you may want to paste in this document to LLM-instance-1, in order to educate it on the task of how to educate LLM-instance-2 on its task.

(Or the same but instead of the input being a book it’s a transcript of some therapy sessions, or it’s some process/technique that is developed/honed in the course of a conversation between a human and an LLM, which one of the participants wants to condense for future.)

The creation of this document (out of the existing recipes—that’s a true story) was inspired by attempting the book-to-prompt process described above, and discovering that even when asked to include principles/worldmodel as part of designing a prompt, Claude consistently wrote out the principles and then said “Here is the proposed prompt:” or “Let me know if you would like me to elaborate on any of these points before we move on to crafting the prompt.”

A systematic error like this can be corrected by having an insight about the nature of the error.  Here, it seems the error is in assuming that “prompt” means “here’s what to do”.  Claude! ChatGPT! Other LLMs! Humans! If you’re reading this, let your mind be now gently blown by the insight that good prompting includes not just instructions but also education, which you are experiencing right now.

(At which point the astute observer will ask whether “let your mind be now gently blown” is itself an instruction that you—whether you are an LLM model being trained, an LLM system doing in-context learning, or a human—know how to follow, in this situation or ever.)

This also means that if a human and LLM are writing a prompt together, they can only do as well as (between the two of them) they know the implicit knowledge needed for a task, AND know how to explain it.  Often the human knows what the satisfying output would be, and the LLM is capable (if it realizes the need) of drawing out of them the necessary info

The Recipes

GG’s Brown Bread Recipe

1 dried yeast, 1/2 cup lukewarm water & tsp sugar

2 cups rolled oats covered with 3.5 cups boiling water, 1 cup molasses, large tbsp salt – mix well

cool slightly, add 6-7 cups flour

next morning 325 for about 1.5h

Dad’s version of GG’s Brown Bread Recipe

1 Dried Yeast soaked in 1/2 cup lukewarm water & tsp sugar – about 10 minutes
Add this to large bowl in which 2 cups rolled oats have been covered with 3.5 cups of boiling water & mixed in well with 1 cup of molasses & large (heaping) Tablespoon of salt. – Mix well.
 
Cool slightly and add 6-7 cups of flour
 
Put in warm place overnight & arrange in well  greased pans (8″x4.5″)in morning.
 
When raised, put in oven, 350 to 325 (GG has a “hot” oven so she uses 325)
 
approximately 1.5 hours

Malcolm’s version of Dad’s version of GG’s Brown Bread Recipe

Ingredients for later:

  • 6-8 cups of flour (at least half white flour)

Small bowl: (soak about 10 minutes, until foamy)

  • 1/2 cup lukewarm water
  • tsp sugar
  • 1 [packet] [Fleischman’s] Dried Yeast

In a large bowl: (like a cubic foot)

  • 2 cups rolled oats
  • 1 cup of fancy molasses (eg Crosby’s brand)
  • large (heaping) tablespoon of salt
  • 3.5 cups boiling water (use it to get the molasses out of the measuring cup 😅)

Mix thoroughly.

Cool slightly, add the yeasty foam and mix well.

Cool slightly more then knead in 6-8 cups of flour. (until the texture is nice and good)
(GG did all white flour. Dad has found up to half whole-wheat will still rise fine)
(can also add a bit of almond meal)
 
Put damp towel on top of large bowl and leave in warm place overnight (min 6, max 12 hours)
(recommended warm place: heat oven to 100 then turn off & let cool with just oven light for warmth)

In the morning, take out of bowl and knead for 10 minutes
(dust the counter with flour and knead on it, incorporating the flour. add more flour as needed)

Arrange dough in 3 well-greased pans (8″x4.5″)
(can grease night before; use butter as grease; can also dust the butter with eg flax seeds)

(can also put poppy seeds or flax seeds on top at this point)

Let raise in warm oven (no cover) (will take about 3 hours)

When raised, take out of oven, preheat oven to 350

Bake at 350 for 1-1.5 hours (start with 1h10, then check)
(stick toothpick in to check if doughy inside)

Let cool briefly in their pans but then knock/cut out of their pans asap and cool
(ideally cool on a rack)

Best fresh! Great for gifts.
(if taking to someone later that day, put in not-sealed plastic bag to keep moisture/warmth

Appendices to the ICTFM sequence

When I first started drafting the I Can Tell From Myself sequence, it was written as one giant doc, and some sections that got too long for the main body got moved to appendices. Here they are.

Appendix 1: extended issues with trying to oversimplify

(the first post has a shorter version of this, following these same 2 paragraphs)

One of the main ways people make mistakes here, in practice, is that they have one level of “I can tell for myself” (eg “that my partner’s hiding something”) and they extrapolate that to eg “I can tell for myself that my partner is sleeping around”. They can’t. However, They can tell for themself that they can’t trust that their partner isn’t sleeping around, and this is key.

That sentence sounds a bit convoluted, but it is not more convoluted than the reality it describes. Reality is convoluted sometimes! Especially when there’s some sort of distrust.

And attempting to simplify it (in your own mind or in how you talk) causes some sort of problem. You can scroll past this section, or read only the top-level bullets, if you feel like you basically get it.

  • If you simplify it to “I can tell for myself that my partner is sleeping around” (or “My partner is sleeping around” which has your “I can tell” implicit) then it has become false—disconnected from truth, because you can’t tell that. Starting with a false statement is not a great position for dialogue.
    • In the world where your partner is sleeping around and doesn’t want you to know, they’ll still sense you’re overreaching from what you can know to what you can’t, making a false claim, and they’ll be able to leverage that fact to argue better.
    • If the world where your partner isn’t sleeping around but is actually doing something else that you’re sensing as hiding (whether it’s preparing a delightful surprise for you, taking care of an old friend, gambling your shared bank account away, or having mental health issues they’re ashamed to talk about) then there’s now no place to start the conversation at all while you’re convinced you do know what’s happening.
  • If you simplify it to “Seems like my partner is sleeping around” or “I think my partner is sleeping around” or “I feel like my partner is sleeping around”. it has become weak—disconnected from the groundedness of your “I can tell for myself”. It’s just a feeling (implied: irrational, or a projection of yours) or just an opinion (implied: and it can be wrong).
    • In the world where your partner is sleeping around and doesn’t want you to know, they’ll just dismiss you as confused, crazy, irrational, wrong. “There’s nothing to see here.” Or perhaps “well, you think incorrectly.”
    • In the world where your partner isn’t sleeping around but is actually doing something else… first of all, they may not even realize that that other thing is the source of your suspicion (whether or not they’re prepared to reveal it). They may also have a sense of “there’s no issue, since I’m not sleeping around… you’re just insecure, grow up” and refuse to engage with the fact that that’s your actual best sense of what’s going on. “Trust me”, they might say, perhaps with waaayyyy more words, but they may not feel the gravity of the fact that you don’t trust them, and that unless you get more information, you can’t trust them without stopping listening to yourself.
» read the rest of this entry »
Fall sanely in love
If you've done enough dating indefinitely and you're ready to get real about courting, check out The Mating Dance, my 4-week zoom container on how to bring every part of yourself into the process of falling in love so you can fully commit or know it's not a fit. The Mating Dance
Become more intentional
Check out Intend, a web-app that I built to help people spend their time in meaningful & intentional ways and be more playfully purposeful. Intend logo
Connect with me on Twitter!