Two associates in the same litigation group, given the same AI tool, get noticeably different results. We blame the model, blame the prompt, or blame ourselves; yet most of the time, the real culprit is that the AI model and the individual using it aren’t a good fit
Key points:
-
-
-
AI capability is jagged — Ethan Mollick’s frontier metaphor describes a coastline of strengths and weaknesses, in which a model that excels at contract analysis can fabricate a citation in the same conversation.
-
Human intelligence is jagged too — A century of psychology, from multiple intelligences to the Big Five, shows that each lawyer has their own coastline of strengths and weaknesses.
-
Person-AI fit is the next discipline — Firms that take this seriously will move from one-tool deployments to portfolios that match each lawyer to an AI partner whose jagged edges meet theirs.
-
-
Welcome back to The AI Law Professor. Last month, I examined how AI first drafts can blind us to other lines of reasoning and hijack our legal judgment. This month, I want to take up what determines whether an AI works for any given lawyer at all: Not which model is best, but which model is best for this lawyer, on this kind of work, at this point in their career
Professor and author Ethan Mollick gave us the metaphor that started this conversation — the jagged frontier of AI capability. Picture a coastline, irregular and unpredictable. On one side, the model is capable; on the other, it fails, sometimes catastrophically. The line itself does not run where you expect. Tasks that look hard turn out to be easy, and tasks that look easy turn out to be hard.
In terms of legal work, this means that a model that has just produced a useful contract analysis will confidently invent a citation. A model that has summarized a 90-page deposition with insight will fail at basic arithmetic. The capabilities of AI form a coastline, with bays and inlets and the occasional cliff. Mollick’s contribution was to give us a way to see this clearly. AI is not uniformly competent or uniformly incompetent — rather, it is jagged.
Humans are jagged too. Psychology has been telling us this for a century, although the message is uncomfortable enough that we keep flattening it back into a single number. The single-number version is IQ; yet the deeper issue with IQ is that it pretends intelligence is one-dimensional.
Developmental psychologist Howard Gardner’s theory of multiple intelligences, whatever its empirical limits, points us toward a more honest picture, one in which linguistic, logical-mathematical, spatial, musical, interpersonal, intrapersonal, and kinesthetic intelligences, are each largely independent. People are not equally strong across all these dimensions. So, it follows that a great trial lawyer and a great patent lawyer are drawing on different intelligences, and each could be lost in the other’s territory.
Human intelligence, like AI capability, is jagged, and each of us has an edge. The jaggedness is not a flaw to be smoothed; rather, it’s a feature of being a unique individual.
When two jagged edges meet
Place the two coastline maps — the human and the AI model — side by side. Press them together at random and they grind, with gaps where neither side fills the space and ridges where both claim the same territory. The lawyer’s strength overlaps with the AI model’s strength, so neither is amplified. The lawyer’s weakness overlaps with the model’s weakness, so neither is covered. The pair produces less than either party would produce alone.
However, align the same two surfaces with attention to their contours and something different happens. The peaks of one fit the valleys of the other. The lawyer’s weakness is met by the model’s strength; and the model’s weakness is met by the lawyer’s strength. The pair becomes more capable than either party alone.
A law firm that takes this seriously will not deploy a single AI tool across all of its lawyers and call the rollout complete. It will offer a portfolio of models and configurations and help each lawyer find the AI partner that works with their actual mind.
Every foundational model now ships with a model card, a document describing the model’s intended uses, training data, performance characteristics, and known limitations. The cards exist because models are not interchangeable. Read three of these cards side by side and the matching question becomes clear. A cautious generalist that hedges and flags uncertainty fits a lawyer who already holds strong views and wants a partner that will test them. A citation-anchored specialist that refuses to invent cases and stays grounded in retrieval fits a lawyer in heavily regulated practice areas in which errors are catastrophic.
The matchmaking discipline
Organizational psychology has worked on a version of this problem for 50 years under the person-environment fit. When a person’s strengths, values, and working style align with the demands and culture of their role, performance and well-being both rise. When they misalign, performance drops and burnout follows.
The same logic applies to person-AI fit. On the human side, cognitive style, domain expertise, personality profile, and the actual tasks performed in a typical week are key. On the AI side, behavior under different prompt styles, default tone, willingness to push back, hallucination patterns, and the shape of strengths and weaknesses across the practice areas in question may matter most. Yet, law firms are still treating AI procurement as a software decision rather than a partnership decision.
A law firm that takes this seriously will not deploy a single AI tool across all of its lawyers and call the rollout complete. It will offer a portfolio of models and configurations and help each lawyer find the AI partner that works with their actual mind. The first generation of legal AI has been dominated by the question of which model is best; however, the second generation will be dominated by a different question: Not which model, but which pairing works best. Not capability, but fit.
Those lawyers that flourish with AI will not necessarily be the most technical or the most enthusiastic users. Instead, they will be the ones that found, by luck or by design, an AI partner whose jagged edges meet theirs.
When two jagged intelligences fit well together, they can accomplish more than what either — human or AI — could do alone. Today, fit is the frontier.
Tom Martin is CEO & Founder of LawDroid, Adjunct Professor at Suffolk University Law School, and author of the forthcoming AI with Purpose: A Strategic Blueprint for Legal Transformation (Globe Law and Business)