A Theory of Preliminary Fact Investigation
by Peter Tillers & David Schum
****
The research reported in this Article was supported by National
Science Foundation Grants SES-8704377 and SES-9007693. The final
version of this article was published at 24 U.C. Davis L. Rev. 931
(1991).
Table of Contents
I. Outline of Theory
Introduction
A. The Place of Preliminary Fact Investigation in the Life Cycle of Litigation
B. General Structure of Theory
C. Basic Characteristics of Individual Marshalling Systems
1. Marshalling Details
2. Marshalling by Actors
3. Marshalling by Real Evidence
4. Marshalling for Credibility
5. Marshalling by Arranging and Combining Details
6. Marshalling Details for Interesting Issues, and Temporal Inventorying of Evidence
7. Event Chronologies and Scenarios
8. Possibilities Marshalling
9. Legal Marshalling
II. Granular Analysis of Marshalling Systems
A. Determining Possibilities and Framing Issues
B. Possibilities and Imaginative Reasoning
1. Possibilities and Abduction
2. Possibilities and Retroduction
C. Event Chronologies, Scenarios, and Possibilities
1. Marshalling by Time: Event Chronologies
2. Marshalling by Time: Scenarios
3. Legal Marshalling & Case Theories
Conclusion
A. Integration and Coordination of Marshalling Strategies
B. Parts and Wholes in Inference
C. Personal Meaning, Metaphorical Translation, and Theoretical
Validity
Introduction
Anon., "Just Imagine!" (date unknown)
How do human beings know? And how can human beings make sure that they know the truth? These are old questions. However, their their shape has changed, or so some people think. Until very recently--roughly until the middle of the twentieth century--many observers believed that the question of the foundations of human knowledge is an unanswerable philosophical riddle. Today, however, there are signs of a shift in attitude toward epistemological issues. A diverse group of theorists views the riddle of human knowledge as a practical problem that admits of answers. These epistemological optimists would reject the wry suggestion that "cognitive science" is an oxymoron; they believe that a science of the mind is possible. Indeed, some of these optimists are hyperoptimists. In recent years "neural networks" have become one of the "hottest" topics in the field of computer logic and artificial intelligence. Some students of cognitive science believe that "neurocomputational" logic may allow them to model and mimic the operations of the brain, and not just understand them.
We share the view that real progress in understanding human knowledge is now possible. In one respect, however, we part ways with the more enthusiastic advocates of artificial intelligence, neural networks, computational models of the mind, and the like. We believe that imagination plays an essential role in all human knowledge and we believe that no model of the mind, no matter how esoteric or subtle, can duplicate, much less replace, the imaginative activities of the human mind. Despite our skepticism about machine-minds, however, we think it is important to use logic to map the operations of the mind. Logic portrays human thought in an orderly way. Logical pictures of possible ways of thinking can facilitate orderly and imaginative reasoning about facts.
Fact investigation in litigation is hard to do well. One of the causes of investigative failure is conceptual failure; effective investigation requires good thinking. This Article describes describes a device for ordering thought during preliminary fact investigation: a network of twelve systems for marshalling evidence. Although this network is not a machine that somehow churns out good investigative decisions all by itself, it is a useful tool for the analysis of investigative problems. The network of evidence marshalling strategies described in this Article facilitates good thinking about problems of evidence in the early stages of fact investigation in litigation.
In Part I of the Article we provide a bird's eye view of our theory. We identify twelve separate systems or strategies for marshalling evidence; we provide a brief description of each these methods of marshalling evidence; and we suggest how these various marshalling strategies can influence each other. A diagram depicts the entire theory as a network of linked marshalling operations.
In Part II we describe several marshalling strategies in more detail. In particular, we discuss how factual hypotheses are constructed, refined, and also "coarsened." We pay close attention to the impact of evidentiary trifles and details on the formation of factual hypotheses and conjectures. Evidentiary details support and suggest various possibilities, and a detail combined with one or more other details may suggest and support yet further possibilities. Since different combinations of details suggest and support different possibilities, arranging and combining evidentiary trifles in various ways can be a useful heuristic exercise. However, even a small number of details can be combined in many different ways. Shuffling details in a random fashion to see what they suggest is inefficient. We describe several systematic procedures for combining details and for flushing out the possibilities that different combinations of details might suggest or support.
In Part II we also discuss strategies for eliminating hypotheses and possibilities, but strategies for generating factual hypotheses and conjectures remain our primary concern. Although shuffling combinations of details is a useful strategy for generating hypotheses, it is not always sufficient. Imagination and conjecture play an essential role in effective fact investigation. While almost of our methods for flushing possibilities out of details and combinations of details require the use of imagination, not all of these strategies involve fancy or conjecture. For example, we describe a strategy of marshalling evidence by "possibilities." This strategy involves imaginative reasoning but not conjecture because marshalling by possibilities supposes that every possibility must be directly supported by evidence. However, it is often useful--and it may be essential--to entertain possibilities and hypotheses that go beyond, or "outrun," the available evidence. Hence, some of the "abductive" marshalling strategies we describe generate hypotheses that are not directly supported by evidence. For example, we discuss of the role of "stories" in hypothesis formation. Stories, or "scenarios," combine elements of fact and fancy.
The Article concludes with some general observations about the nature of our theory. We argue that our network of evidence marshalling systems, though complex, is "user friendly," at least in principle. The intellectual processes and operations we describe do not have a "transcendental" character or origin, but are "natural" to ordinary thinking human beings. It is true that the workings of our network of marshalling systems can be very intricate: the twelve marshalling systems we describe can interact in complex ways and users of our network may be forced to pay attention to several marshalling operations simultaneously. However, the obstacles to the use of our marshalling systems are no greater than those presently faced by real-world investigators, who must already mentally walk and chew gum at the same time. The purpose of our theory is to facilitate the management of already complex tasks.
Our final observations concern the computer-generated
diagrams and devices we use to depict the network of evidence
marshalling operations. We argue that our computer-generated visual
representations serve a theoretical purpose as well as a practical
one. These representations are metaphors. The fact that they are
user-friendly--the fact that they make complex strategies for
organizing evidence more understandable and intelligible--is some
evidence of the validity of our theory. Our theory is a map of the
mind. If it is a good map, it should make our thinking more
clear.
Outline of Theory
A. The Place of Preliminary Fact Investigation in the Life Cycle of Litigation
The traditional centerpiece of American legal scholarship in Evidence is the trial. Wigmore's mammoth treatise on the law of evidence devoted little attention to the pre-trial process; as its title suggests, its focus was on the legal rules governing the admissibility and presentation of evidence at trial. The focus of Wigmore's contemporaries and successors was much the same; scholars such as Edmund Morgan, Charles McCormick, and John Maguire talked about the trial, and little if at all about evidentiary processes before trial.
Things are not much different today. Contemporary casebooks, legal treatises, and "hornbooks" on Evidence typically pay little attention to evidentiary processes before trial. The new evidence scholarship has not significantly diminished the traditional emphasis on the trial; although the new evidence scholarship focuses more on proof and less on the admissibility of evidence at trial, the work of the new evidence scholars focuses on the process of proof at trial, and only little is said about evidentiary processes before trial.
There are good practical reasons to bemoan this emphasis on the trial, but there are also theoretical disadvantages. When a case goes to trial--particularly when a case is submitted to the trier of fact--the factual issues in the case have been determined with a relative degree of specificity and the evidence to be considered by the decision maker is known. If theorists view the trial as the paradigmatic setting for problems of evidence, inference, and proof, they are likely to focus on a type of inferential analysis that we call "relational analysis." This is because in the sort of trial setting we have described the most obvious responsibility of the trier of fact is to determine how strongly known evidence supports the factual contentions that the parties and the court have identified and formulated. As this paper demonstrates, however, the process of proof in litigation involve forms of analysis other than relational analysis. For example, the process of proof involves the formation and differentiation of factual hypotheses and the acquisition of new evidence. Cognitive processes of this sort can and do take place during a trial but many of them are far more palpable in the pre-trial process than at the trial itself. Hence, fact investigation is a field of study that offers important insights into the nature of inference and proof in litigation.
When we began our research, we hoped to examine marshalling
processes throughout the life cycle of inferential problems in
litigation . Figure 1 is a representation of what we imagined a
full-scale life cycle might include.

This life cycle includes investigation, legal discovery and other pretrial preparation, the trial, and deliberation and choice by the trier of fact. Very soon after we began our work, we realized that the full life cycle of the process of judicial proof involves a far larger number of types of marshalling and inferential activity than Figure 1 shows. We therefore chose to limit the scope of our initial research project and we decided that a good place to begin a study of the process of proof was at the beginning. Hence, instead of trying to tackle the entire process of proof, we decided to examine only pretrial evidentiary processes and we decided to focus on the very initial stages of those processes. We refer to these initial phases of the process of proof as "preliminary fact investigation."
A theory describing strategies for marshalling evidence in preliminary investigation may be valuable for a variety of reasons. For example, if our theory holds any water, it ought to interest actors such as trial lawyers, who must marshal and analyze evidence. Moreover, a good theory of evidence marshalling during investigation may be beneficial for the society at large. A central function of litigation is the adjudication of factual disputes. The reliability of factual adjudication is a matter of considerable importance from the standpoint of almost any perspective on litigation, whether from a moral, social, ideological, or economic perspective, or from the point of view of fields of law such as the law of evidence and constitutional law. (There are dissenters, but they are few.) A theory about the logical and cognitive dimensions of fact investigation is germane to a concern about the reliability of adjudication because the manner in which actors in litigation marshal and analyze evidence affects litigation outcomes.
While the practical significance of a valid theory of fact investigation may be substantial, the theoretical significance of the topic of fact investigation is no less important. Although we have said that our paper is about preliminary fact investigation, we might as easily have said that it is about "investigative discovery." The function of proof is to provide an answer. Any answer, however, requires a question. Figuring out how to ask a good question is as important as figuring out how to answer a question. In studying preliminary fact investigation, we are essentially studying a process of questioning.
The asking of appropriate questions is partly an art; it requires imagination. However, just as imagination alone cannot produce a great work of art, imagination alone cannot generate useful questions; mental discipline is required to produce either a great symphony or a productive question during fact investigation. The network of evidence marshalling strategies described in this paper constitutes a theory of the economics of questioning. Our theory speaks to the efficiency of the questioning process; it speaks to the effective and disciplined deployment of cognitive resources during the process of inquiry.
The question of the nature of discovery processes, of course, arises in contexts other than forensic proof and investigation; the issue has engaged the attention of philosophers and other people for generations. It is therefore possible that a better understanding of the nature of investigative discovery in litigation has general implications. While it may be true that lawyers and judges use an "artificiall Reason" to interpret legal rules and principles, it probably is not true that lawyers, judges, and other participants in the process of litigation do use or should use entirely idiosyncratic mental and logical operations when addressing factual issues. Differences in methods of assessing evidence in legal contexts and in non-legal contexts such as medicine and science may stem from contextual and situational factors and from the characteristics of specialized bodies of knowledge about particular types of phenomena rather than from any fundamental differences in methods of analyzing problems of evidence and inference.
A. General Structure of Theory
Our theory consists of twelve linked systems for marshalling
evidence. This entire network of systems is represented in Figure
2.
Figure 2 resembles an influence diagram. This resemblance is
entirely deliberate. The concept of an influence diagram, first
introduced by Howard, is a useful method of describing the operations
of complex networks. The nodes in an influence diagram, which
typically appear either as boxes, circles, or ovals, refer to
operations or functions. The arcs (i.e., lines) represent linkages
between nodes. Hence, arcs that connect nodes show how different
types of operations are related. In our diagram, which appears in
Figure 2, the nodes refer to evidence marshalling operations and the
arcs indicate avenues of influence between separate evidence
marshalling systems. However, although the diagram in Figure 2
resembles an influence diagram, it is in fact not an influence
diagram. Hence, we will refer to the diagram in Figure 2 as the
"network diagram."
In addition to showing operations and linkages between operations, our network diagram has two important characteristics. First, the operations shown there can be performed in any order (providing that the movement from one set of operations to another set of operations does not take a path for which there is no arc). The spatial arrangement of nodes or arcs in the diagram conveys no suggestion of which marshalling operation must be the initial operation. More generally, the spatial relationships among the nodes in the network say nothing about the necessary or appropriate temporal order of the evidence marshalling operations symbolized by the nodes.
Second, our network diagram (unlike some influence diagrams) does not represent causal relationships. The arcs between the nodes, or evidence marshalling operations, only indicate avenues of influence; they indicate that marshalling schemes may influence other marshalling schemes. These avenues of influences express the possibility of subjective conceptual links, rather than of causal links, between different marshalling strategies.
These characteristics of our network diagram reflect several basic propositions about the characteristics of rational preliminary fact investigation. First, we believe that an investigation relating to matters of fact can rationally begin with any of the marshalling systems symbolized by the nodes; the choice of where analysis starts depends on the nature of the problem and the judgment of the investigator.
Second, we believe that the sequence of marshalling strategies is not objectively or causally determined and we therefore believe that analysis can move from any given marshalling strategy along any of the arcs leading to other marshalling strategies. Thus, the order in which marshalling strategies should be used depends on the investigator's view of the nature of the problem he faces.
Third, since the arcs in the network diagram represent only possible avenues of influence, the design and contents of the network diagram do not imply that an investigator must use all of the marshalling schemes represented in the diagram; we believe that a rational investigator may make little or no use of a variety of the marshalling operations that we have identified.
These three judgments taken together reflect our more global judgment that our theory is a device for mapping the mind rather than the world. Unlike the world, the mind is not determined by law-like principles.
The network diagram in Figure 2 also suggests how research on evidence marshalling strategies can combine theoretical analysis and technological considerations. While Figure 2 represents our analysis of marshalling strategies and the manner in which they may affect each other, it also reflects our attempt to use computer technology to facilitate the use of our theory in real-world settings. We have developed computer-implemented prototypes of each of the twelve evidence marshalling strategies in our theory and we have developed a computer-based method of exhibiting the linkages among these prototypes of evidence marshalling strategies. The resulting network of linked evidence marshalling systems emulates a complex system of evidence marshalling operations.
Our attempt to construct computer prototypes of evidence marshalling systems is more than a gimmick; there is an intimate relationship between our work on theoretical issues and our work on technological issues. We will more explain how and why this is so after we describe our theory in more detail. However, we will make two general claims now. The first is that our theoretical analysis determines which prototypes need to be constructed. In addition, however, our computer-based prototypes are metaphors that illuminate and illustrate elements of our theory of evidence marshalling. In particular, our computer prototypes of evidence marshalling strategies use the metaphor of a stack of cards. In our discussion of the marshalling of combinations of details, we illustrate how evidence marshalling strategies can be be captured with this metaphor.
C. Basic Characteristics of Individual Marshalling Systems
Our network of twelve marshalling systems can be broken down into subgroups. The first subgroup is comprised of four separate marshalling systems which together form a basic detail or information base. Two of the systems in this subgroup allow the marshalling of evidence from and about investigators and other sources such as witnesses. A third system concerns real or tangible evidence; it structures analysis of the authenticity of such evidence. The fourth system concerns marshalling of evidence about the competence and credibility of witnesses.
Three other systems allow marshalling of combinations of details. One of these systems facilitates the formation of event chronologies; another marshals thought and evidence about issues of interest that arise during investigation; and the third marshals evidence on the basis of the order in which events occur and evidence of those events appears.
The eighth system allows for the marshalling of evidence on the basis of hypotheses, or possibilities, at various levels of refinement, as these possibilities, or conjectures, emerge during investigation. The ninth system allows marshalling of evidence to eliminate possibilities in a systematic way. The tenth system facilitates the construction of stories and scenarios, which serve to suggest new evidence and possibilities.
The eleventh and twelfth systems facilitate marshalling of evidence on the basis of legal doctrine. One of these systems consists of a base of legal rules and principles. The other system allows for marshalling of evidence on the basis of the elements, or points, of these legal theories.
1. Marshalling Details
The first four marshalling systems concern details. Details, or small parcels of data, ordinarily accumulate very rapidly during an investigation. Since few investigators can match the ability of Sherlock Holmes to remember "trifles," the recording of details for later use is important.
There are practical and logistical difficulties in recording large quantities of information. The computer-based system we have constructed allows large numbers of trifles to be recorded and stored in a compact form. However, the storing of details also involves theoretical difficulties. The first difficulty is caused by the fact that the world is full of trifles. Even if we had the most powerful computer in the world we could not record all the trifles that come to our attention. Moreover, even if we could record every trifle, we would not want to do so. (For one thing, we would not want to expend the resources necessary to do so.) Hence, in any investigation it is necessary to decide which details are worth recording and preserving and which are not.
Determining the relevance of details during an investigation is difficult. Investigators face a dynamic environment and they lack clairvoyance. Consequently, a detail that seems irrelevant at Timex may become highly relevant at Timex + 1. We regret to say that we know of no method of recording that can guarantee that all significant details will be preserved and that irrelevant details will be discarded. However, there are methods of marshalling that may improve the chances that important details will be preserved. Moreover, there are methods of storing details on the basis of importance differences in their evidential character. We examine some of these methods next.
2. Marshalling by Actors
The first two systems in our detail base organize evidence in relationship to "actors." In our usage, actors are people who are sources of information. The domain of actor-based marshalling is wide because all details acquired during an investigation originate with or pass through people.
The first actor-based evidence marshalling system makes it possible to identify the actors who are the sources of specific items of information and to identify the details that originated or passed through particular actors. The second marshalling system makes it possible to identify the details that contain information about actors. In other words, one marshalling system records details from actors and the other records details about actors.
These two actor-based marshalling systems have a variety of advantages and uses. It may be of some theoretical as well practical significance that trial lawyers also routinely marshal evidence on the basis of people; they routinely record the the identities of people having information and the type of information that such individuals have. Lawyers are particularly likely to make this type of record when a trial is near. This is because they need to know which people should be called as witnesses. However, lawyers also make such records earlier in the life of a lawsuit. They do so, for example, because they need to know which people might have to be questioned again for further information about particular matters.
In making records about potential witnesses and about people who are potential sources of evidence, lawyers also routinely record details about these sources of information. Thus, matters such as age, occupation, employment history, and other matters will be recorded. Among the reasons for this sort of record-keeping, of course, is the lawyer's concern with the credibility of his potential witnesses. There are other reasons for this sort of record-keeping, some of which are mundane and some of which are not. Among the mundane, for example, is the lawyer's need to be able to locate people when he wishes to speak with them or subpoena them. But some of the reasons why lawyers preserve details about actors are less mundane. For example, as already noted, lawyers may think that information about actors is important because they may think that the credibility of actors is an important consideration even during investigation.
There may be another reason why the preservation of details about actors is an important method of marshalling evidence. The importance of stories during the trial process is well-documented. As we shall later show, stories, or scenarios, are also important during investigation. In almost every lawsuit the matter or matters in controversy involve actions by human beings. Consequently, the scenarios that investigators construct must also involve actions by human beings. As we shall later show, the construction of useful stories for investigative purposes is not an automatic act; story-telling involves imagination and, in a legal context where the truth of a story is a matter of considerable concern, effective story-telling, or scenario construction, may involve a considerable amount of intellectual labor. Consequently, a system that marshals evidence about "actors" may facilitate the process of scenario construction.
Actor-based marshalling can facilitate the construction of scenarios in several different ways. Most obviously, an efficient method for preserving and recalling information about actors involved in a scenario makes it easier to flesh out the scenario and the ability to retrieve details about people can speed and improve the initial decision of whether a person should be made an actor in a particular story. There are also other ways that actor-based detail base can aid in the construction of scenarios. For example, if we suppose that people are ordinarily very important for any scenario constructed in a forensic context, actor-based marshalling may facilitate the process of telling little stories centering about individuals and perhaps these relatively granular stories can be pieced together to form a larger story involving a variety of people and events.
3. Marshalling Real Evidence
Another method of marshalling evidence seems so natural that it may not seem to require comment. We are referring to the process of segregating evidence that has a tangible form. Lawyers and other investigators routinely separate evidence on this basis. Here again, the reasons for doing so are both logistical and conceptual. The conceptual reason is the assumption that real and testimonial evidence impart information in different ways and thus require different analytical treatment. This assumption, which plays an important role in the law of evidence, is well-founded. Although the assessment of real evidence does involve inference--it is not true that real evidence speaks entirely by or for itself--, it is also true that human sources and non-human sources of information are fundamentally different and the special characteristics of human sources require a different and special mode of inferential reasoning.
In the case of real evidence, the structure of the inferential process required is more simple than in the case of testimonial evidence. The use of real evidence generally involves the question of its authenticity; it must be determined whether the thing in question is what it appears to be or what its proponent says it is. However, attention will not focus on the question of whether the tangible thing in question is "sincere" or whether it is "biased." Consequently, it is useful to segregate evidence that does not involve these sorts of issues.
4. Marshalling for Credibility
In our discussion of actor-based marshalling we have noted
the importance of marshalling details about the credibility of human
sources of information. However, although one of the
actor-based marshalling systems is a technique for gathering details
about human sources of information, the resulting collection of
evidence is just a list of details. Such a list does not organize
details in a way that fully displays their significance for
credibility issues. One of the authors of this paper--David
Schum--has described a method for organizing evidence and thought
about questions of credibility. Although that analysis will not
be restated here, we do note that Schum's analysis of credibility has
many affinities with the way the law of evidence views problems of
credibility. For example, in both Schum's schema and the law's,
veracity, objectivity, and observational accuracy of a human source
are important factors bearing on the probative value of testimonial
evidence. It is clearly useful to organize details on the basis
of their potential bearing on matters such as sincerity, bias, and
memory.
5. Marshalling by Arranging and Combining Details
A major purpose of marshalling strategies in investigation--at least in the preliminary phases of investigation--is the stimulation of useful questions; marshalling schemes interest us to the extent they perform this heuristic function. On some occasions a single detail provokes or stimulates a question (i.e., it stimulates the formation of a hypothesis). For example X has died of a gunshot wound and one detail at the scene of the crime is a small quantity of a narcotic substance. This single datum will likely provoke the formation of the relatively diffuse hypothesis that X was killed by someone who was somehow involved with narcotics. However, details can also provoke the formation of relatively discrete hypotheses. For example, the information that X's body has a firearm wound and that Y's recently-fired revolver was found at the scene of the crime is likely to provoke the hypothesis that Y killed X with his revolver.
While single details can provoke the formation of hypotheses, so too can combinations of details. When details accumulate, however, there are both practical and conceptual difficulties. A practical difficulty is keeping track of the vast number of details that typically accumulate even during a brief investigation. For example, in the simulation on which this paper rests we accumulated thousands of details. In addition to the practical difficulty of preserving large numbers of details, there is the conceptual or analytical problem of how details should be combined in order to stimulate the formation of useful questions and hypotheses.
We have not solved all of the practical problems presented by the need to record important details for later use. However, a method based on the procedure used in our computer prototype might have substantial benefits. As noted earlier, the computer prototype uses a method of storage that resembles a stack of cards. The prototype permits a user to enter details on each card within each of the stacks for each of the four detail marshalling methods that we have just described. Questions and ideas can also be recorded on each of these cards. The underlying Hypercards system on which these stacks are built makes it easy for a user to navigate through and between these various stacks with relative ease. If there is merit to the theories of evidence marshalling on which these four types of stacks rest, a method of recording data based on the prototype computer-based marshalling system we have designed should enhance the ability of users to ask productive questions on the basis of the available details.
The ability to navigate among the four stacks, however, does not resolve the issue of how details should be combined in order to enhance the efficiency of the process of questioning. Even with the assistance of a computer, it is neither practicable nor enlightening to consider every possible combination of details. Even when the number of details is relatively small, it would take aeons to consider every possible combination. Moreover, long before anyone could finish considering all possible combinations of details, there would almost certainly be new details to consider. Hence, we need a more efficient method for arranging and combining details; we need a strategy for combining details that omits a variety of combinations, but does so without obliterating an excessive number of potentially useful combinations and arrangements. As shown immediately below, the arcs numbered 3 and 4 in Figure 2 lead us to methods of combining details that may be productive.
6. Marshalling Details for Interesting Issues & Temporal Inventorying of Evidence
Details may provoke the formulation of hypotheses and questions that we call "interesting issues." These issues are relatively granular hypotheses that are derivative of more general hypotheses. For example, the general hypothesis that a murder was committed in some fashion may and often does provoke a variety of more discrete hypotheses or questions that bear on the general question of the modus operandi. For example, the general hypothesis that a murder was committed in one way or another may provoke the "interesting issue" of why an attempt was made to remove blood stains from the scene of the crime and who attempted to do so. It is plainly useful to record these sorts of subsidiary queries.
It is also useful to "time-stamp" evidence. The exact time when evidence emerges can greatly affect its significance; it often makes a great deal of difference whether evidence of an event arose before, during, or after the event in issue. For example, in a murder case in which Mabel is charged with killing Abel, it makes a great deal of difference whether Mabel came to hate Abel before or after Abel's death.
Time-stamping evidence--organizing and arranging it on the basis of the order of its appearance in time in relation to possible events in the world--may be important because evidence is not just evidence. It is also an event in time; it appears at a particular point or interval of time. The temporal locus of evidence in time is a matter of some importance because, as an event in time, evidence stands in a causal relationship with other events in the world. Consequently, identification of the temporal locus of evidence--dating its appearance in the world--facilitates investigation of the the causal relationships between evidence, on the one hand, and hypotheses about events of legal significance, on the other. In some cases, time-stamping of evidence may promote a kind of reasoning known as retroduction. An investigator using this kind of reasoning will suppose, for example, that the murder whose commission is in issue in the case did in fact take place and then attempt to predict the evidence that would likely appear after such a murder. On this basis, she might predict in a particular case that the defendant would have referred to the murder in later conversations with his close friends. The major difference between the retroductive reasoning used in scenario analysis and the reasoning in this connection is that scenario analysis focuses on causal relations among events whereas time-stamping of evidence promotes retroductive reasoning about the causal relations between (possible) events and evidence.
It might be argued that temporal marshalling of evidence does not merit a separate node in the influence diagram. The node representing evidence marshalling with scenarios already describes a procedure for thinking about temporal and causal relationships among events. However, Wigmore's method of temporal marshalling differs from marshalling by scenarios because Wigmore's method of time-stamping evidence has an "eliminative" element. Wigmore argued that a complete temporal audit of evidence--which he called a "progress chart of indications"--can indicate when a case is "completely" prepared. In his view a case is completely prepared when all alternative possibilities are eliminated and only one remains. The basis for this process of elimination appears to be a form of causal reasoning about the relationship between evidence-events and issue-events. Hence, in Wigmore's view it is possible, at least on some occasions, to use this type of reasoning to establish conclusively that only one hypothesis is possible. Wigmore undoubtedly overstated his case when he said that it is possible to reach the conclusion that a case has been "completely prepared": causal reasoning can never conclusively exclude alternative causal explanations.
7. Event Chronologies and Scenarios
One way of arranging details is by the temporal order of the events they seem to indicate. This method of arranging and marshalling details is familiar to many lawyers; the practice of constructing "time lines" is a common method of pretrial preparation. This method of marshalling evidence is useful because it often does stimulate fruitful questions. For example, event chronologies may disclose "gaps"; by constructing time lines an investigator may discover the existence of time intervals about which there are no details and it may be apparent to the investigator that some events in that interval may be important. Similarly, an event chronology may reveal that although there is some information about an interval of time, but it is not enough or it is not the right kind.
While event chronologies, or time lines, are heuristically valuable, they also have limitations. A symptom of these limitations is "clutter." When numerous events are packed into an event chronology, the usual effect is that the event chronology appears cluttered. The primary reason for the cluttered appearance of event chronologies is that many of the events entered on a temporal axis have no apparent relationship with each other. In this situation, an event chronology may muddle as well as clarify the process of inquiry.
Our reason for the limitations of event chronologies also suggests the cure. If the simple temporal sequences are often unilluminating or confusing because of the lack of any apparent connections between the events recorded in an event chronology, one remedy for the cluttered appearance of time lines is the construction of scenarios, or "stories." Unlike a simple event chronology, a scenario describes a sequence of events that are causally related. This quality of this type of temporal marshalling gives scenarios a measure of intelligibility that time-lines do not have.
Powerful theoretical considerations speak in favor of story telling as an evidence marshalling technique. (The general thesis of the importance of story telling is far from novel.) For example, the thesis of the importance of stories is supported by the ontological argument in philosophy that states of the world are necessarily part of a spatio-temporal order. This view implies that all of the issues in every lawsuit concern causally-related events. Moreover, there is strong empirical evidence that stories are both a common natural information processing technique and an effective technique for storing and recalling large amounts of information. It is also noteworthy that trial lawyers often consciously tell stories in trials. Ç Some lawyers may view stories only as rhetorical devices, but some lawyers also realize that story telling makes evidence more intelligible to the trier of fact. Hence, the importance of stories in inferential contexts has been recognized in many different quarters. If we have something to add to the argument that storytelling is important, it is the claim that stories are important in investigative processes as well as in deliberative processes.
There are many different kinds of stories. The kinds of stories we have in mind--scenarios --contain a mixture of evidence and conjecture. In a forensic context stories ordinarily must incorporate evidentiary elements as well as a dose of fancy. In a forensic context stories are constructed because of an interest in actual states of the world; their purpose is to facilitate the accurate assessment of matters of fact. If a story has no evidentiary foundations, there is ordinarily little reason to think that the story is a plausible one. For present purposes we equate "stories" with "scenarios." Scenarios are very complex hypotheses about a temporal sequence of events in the "real world." These hypotheses are useful only if they have a basis in evidence. In the absence of evidentiary indicators and constraints, an infinite number of possible scenarios of equal dignity can be constructed; in the absence of all evidence, no story that describes a possible sequence of events can be deemed more or less plausible that any other story describing a possible sequence of events.
While useful scenarios rest on evidence, they are not limited to the possibilities directly disclosed by the evidence. Any scenario must have an element of fancy. A scenario is a hypothesis about connections between events; it contains a theory or explanation of how things are connected in time. When a scenario is constructed for forensic purposes, it serves as a gap-filler. Scenarios fill gaps precisely because they incorporate--or are--theories that specify relationships between events in time. Hence, stories are more than just another method of organizing details; story-telling is a method of marshalling that explicitly mixes evidence with the construction of theories about the behavior of sectors of the cosmos over time.
The conjectural dimension of a story serves a number of important purposes. The conjectural or hypothesized parts of a story serve as indicators of potentially relevant evidence; a story having conjectural components suggests the importance of evidence bearing on the conjectural portions of the story. For example, if an investigator conjectures that a suspect purchased a gun at a store before he shot the victim, an investigator would also have to guess that evidence showing such a purchase might be useful. In addition, a clearly-told story practically forces an investigator or decision maker to focus on the relative merits of competing visions and theories of the workings of natural processes and human beings. The construction of an intelligible scenario makes a story teller's causal theories explicit. Hence, a story, if clearly articulated, invites and facilitates rumination about the adequacy of the causal theory that underlies the story. For example, if an investigator conjectures that a suspect killed the victim to get revenge for the mistreatment of the suspect's dog, questions are likely to be raised about whether this is the way the mind of the suspect could have worked.
Although we believe that event chronologies may spur and
facilitate the formation of stories, we believe that the link between
event chronologies and stories is indirect rather than direct.
We believe that the interaction of time-lines and stories is mediated
by other marshalling strategies, including marshalling according to
"possibilities." The term "possibilities" refers to hypotheses that
are directly indicated or suggested by evidence. We believe
that stories can emerge out of "possibilities" but not out of
time-lines. We discuss the marshalling of possibilities
next.
8. Possibilities Marshalling
When taken at face value, evidence often seems to indicate a variety
of possibilities. A trace of cocaine is found at the scene of an
apparent murder. This evidence indicates the possibility that the
perpetrator of the murder (if there was a murder) was a user or
peddler of cocaine. A gun is also found near the dead body. This
evidence may indicate the possibility that the murderer (if there was
a murderer) used a gun to kill the victim and it may indicate the
alternative possibility that the dead person committed suicide by
shooting herself. However, as noted earlier, evidentiary
details can be combined in various ways. Examination of various
combinations of evidentiary details is a useful technique for
stimulating the formation of further possibilities and hypotheses.
For example, the evidence of the cocaine and the gun taken together
may suggest the possibility that the killer shot the victim to get
the victim's cocaine. The examination of such a possibility may in
turn suggest a scenario. For example, the possibility that the killer
shot the victim to get the victim's cocaine may induce an
investigator to conjecture that the killer and the victim had
dealings with each other in the past.
It is also important to assess the possibilities that the available evidence seems to suggest. A useful way of doing so is to imagine further possibilities that are compatible with the possibilities already recognized. When this is done, the extent to which existing evidence supports different sets of possibilities at various levels of refinement can be considered. Moreover, identification of possibilities having minimal evidentiary support can serve as a guide for additional investigation or inquiry. We describe this sort of possibilities analysis at some length in Part II of this Article. There we describe a possibilities "tree" and some other graphic representations that may facilitate both the formation and assessment of possibilities.
While orderly thinking about the relationship between possibilities and evidentiary details can clearly be useful and productive, the strategy of marshalling details and trifles on the basis of possibilities also has its limitations. As we suggested before, when details multiply, the number of possibilities increases rapidly. This fact alone places limits on a strategy that aims to "exhaust the possibilities." However, there is a further complication: a single possibilities "tree," supported by a relatively small collection of evidence, can contain a vast number of possibilities. Ordinarily it is neither feasible nor desirable to examine all the possibilities that a collection of details suggests. Hence, it is essential to prune some of the possibilities from the sort of "possibilities tree" that we describe at length in Section II(A).
There are at least two methods for pruning a possibilities tree. First, since combinations of possibilities tend to suggest possible scenarios, one way of pruning a possibility tree (as well of making it grow new branches) is to construct scenarios that incorporate some of the possibilities suggested by the evidence. Once such scenarios are constructed and their plausibility is assessed, they may be used to reconsider the possibilities that evidence suggests. In some situations, this reassessment will cause an investigator to jettison a variety of possibilities.
Another method of reducing possibilities is to engage in a process we call "elimination." This approach subjects possibilities to evidential tests. The use of evidential tests involves an analytical process known as retroductive reasoning. When an investigator uses "eliminative reasoning" to extinguish possibilities, he thinks retroductively because he makes predictions or guesses about the evidence that would have to exist if a particular possibility is in fact true. After making this prediction or guess, he then attempts to determine whether these items of evidence do in fact exist. The nature of this process of evidential testing is described in detail by Dr. L. Jonathan Cohen. He argues that the strength of a hypothesis (in our usage here, a "possibility") is a function of the number of evidential tests that it is able to pass; the greater the number of evidential tests that a hypothesis passes, the greater is our confidence in that hypothesis.
Of course, neither of these two methods for eliminating possibilities--scenario analysis and eliminative reasoning--guarantees that an investigator will be able to cope with a number of possibilities so large that as to cause mental stupefaction. If an investigator entertains so many possibilities that they cause only bewilderment, he or she will not be able to use marshalling methods such as story-telling and eliminative reasoning to reduce a cognitively unmanageable number of possibilities to manageable proportions. Nonetheless, methods such as scenario analysis and eliminative reasoning do have the capacity to make a relatively (but not wholly) unmanageable number of possibilities relatively more manageable. The fact that an investigator can make no headway if he entertains a stupefying number of possibilities only demonstrates that the network of marshalling strategies described does not capture all of the processes involved in investigation.
The importance of cognitive manageability is obvious. However, it is also important to note that although it is advantageous, all things being equal, to have fewer possibilities rather than more, this kind of simplicity is not the only important cognitive value. For example, marshalling by scenarios may expand as well as reduce the number of recognizable possibilities, but an investigator may rationally embrace story telling as a marshalling strategy even when it multiplies possibilities. Similarly, when an investigator suspects that possibilities having no present relevance may become significant later, he should hesitate to abandon them completely and irrevocably. Thus, intricacy and complexity in matters such as possibilities are only one factor in a theory of the economics of questioning; the benefits of entertaining, considering, and recording possibilities and details must be weighed against the costs of doing so. Thus, while cognitive parsimony is important, it does not follow that an efficient strategy for marshalling evidence is one that reduces possibilities and details to a small number.
9. Legal Marshalling
We claim that substantive legal rules are important heuristic devices. Our claim may sound odd; if asked to explain the importance of substantive law, people are more likely to refer to the impact of substantive law on conduct than to its impact on the process of inquiry and discovery. Nonetheless, substantive legal rules really are important heuristic devices. However, the reason for the heuristic importance of substantive law for investigative and evidentiary processes is special. The other evidence marshalling strategies considered in this Article have innate heuristic charm and power. The same cannot be said of the strategy of marshalling evidence on the basis of substantive law. Substantive legal rules have heuristic significance because they are authoritative. If substantive legal rules were not authoritative, participants in litigation would not necessarily want to use them to organize evidence. However, decision makers such as judges and jurors are required to follow the applicable substantive legal rules when making decisions in a lawsuit; substantive legal rules function as "decision rules" that specify the conditions under which a decision maker ought to grant or deny legal redress. The obligatory character of these rules lends them heuristic significance. For example, any person trying a lawsuit must take substantive legal rules into account when marshalling and presenting evidence; it is possible that judges and jurors will abide by the rules that law says they should use when reaching a decision in the case.
Although it is apparent that substantive legal rules about matters such as "battery," "nuisance," "larceny," and "manslaughter" have important implications for the marshalling of evidence in pre-trial investigation as well as at trial, the question of precisely how substantive law influences fact investigation remains to be answered. Unfortunately, we cannot give a full answer to ths question here. We are reasonably sure that the substantive legal framework of legal disputes dictates the use of a wide variety of evidence marshalling strategies and we have neither the time nor the know-how to examine all of these law-related marshalling strategies. However, we have given some thought to a strategy that involves the decomposition of legal concepts. This strategy requires that concepts such as "murder" and "battery" be broken down into their constituents or "elements." For example, "negligence" might be broken out into the elements "duty of care," "breach of duty of care," "foreseeability of risk of harm," "conduct actually causing harm," and "conduct proximately causing harm." In our network diagram the decomposition of legal rules and concepts into elements is symbolized by the node called "substantive legal rules."
The enumeration of the elements of a legal claim or defense may suggest various methods of organizing evidence. For example, the procedure of explicitly articulating the elements of a legal claim such as conspiracy may inspire the formation of possible scenarios which, if shown to be true, would support that claim. Similarly, an investigator, again proceeding in a retroductive mode, may ponder the elements of legal rules in the abstract and he may then speculate about the possible combinations of facts and events that would instantiate those generic, abstract elements. In that case, he might then examine the detail base to see whether the evidence already available supports the elements of the claims or defenses he is considering or he may engage in further investigation to see if evidence supporting those claims and defenses can be found.
These examples of the retroductive use of the elements of legal concepts have special pertinence to the initial stages of litigation and investigation. In pre-trial phases of litigation it is often very uncertain whether a possible legal basis for relief or for denial of relief will survive to the time of any trial or whether it will die an early death for lack of evidence. In the face of such uncertainty, an investigator might find it useful to imagine scenarios and possibilities that might substantiate the legal grounds for relief or defense that he can imagine asserting at some eventual trial. However, in some situations it might make sense for an investigator to work the other way around--to emphasize, not fine evidentiary details, but gross legal categories. For example, if an investigator has as yet few details and the meager evidence available to him does not point discretely or specifically to particular elements of substantive legal rules, an investigator may wish to rely on his "gut sense" of which legal rules are likely to be important "down the road" to guide his investigation of the case. In some circumstances, this approach may be an efficient strategy for hypothesizing interesting possibilities and for ruling out others.
The law-related marshalling strategies just mentioned center largely on problems that involve uncertainty about the future. However, there is another type of uncertainty associated with substantive legal rules and doctrines: to one degree or another, legal principles, rules, and doctrines are vague and fuzzy. The vagueness and imprecision of legal rules might be thought to pose only a problem of theories and strategies of legal argument and legal reasoning. In fact, however, the imprecision of legal rules has important implications for evidence marshalling strategies. In addition, the fuzziness of substantive legal doctrine has important implications for the way that investigators and lawyers must grapple with the uncertainties associated with the dynamic character of investigation and litigation: a lawyer's or investigator's appreciation of the fuzziness of substantive legal rules can have a profound impact on the nature and extent of her uncertainty about future developments in the case.
In assessing the impact of "doctrinal fuzziness" on investigation, it is important to e clear about the ways in which legal rules may be "fuzzy." In an earlier article we suggested that the concept of an "equivalence class" may be a useful device for describing the relationship between legal doctrines and factual hypotheses. Our use of this concept rests on a distinction between the elements of a legal rule, on the one hand, and factual hypotheses, on the other. Although it is sometimes said that a party having the burden of proving a claim or defense has the burden of proving the elements of "negligence," "waiver," and similar matters, this is a loose way of talking. Like a number of legal experts, we prefer to say that a party having the burden of proving the elements of a claim or defense has the burden of proving legally material facts.
There is a difference between the elements of a legal rule and the facts that establish those elements in a particular case. As noted directly above, the elements of a legal rule--e.g., "causation", "failure to warn"--have a generic character. The elements of legal concepts such as "negligence" do not require proof of a unique set of factual circumstances; elements such as "causation" can be satisfied by proof of a great many acts and events. Hence, it is appropriate to say that particular acts and events instantiate rather than constitute the elements of legal claims and defenses. When the relationship between the elements of a legal theory and facts is understood this way, it is possible to use the concept of an equivalence class to describe the relationship between legal doctrines and hypotheses about states of the world.
The concept of an equivalence class originates in mathematics. Formally stated, an equivalence class is the class of all outcomes that have the property that they correspond with the occurrence of some "event." The word "event" in this definition is a term of art; it refers, not to a unique event, but to set of general conditions or circumstances embodied in a "reference class." Hence, informally stated, an equivalence class is the collection of all particular instances that satisfy the requirements of a general rule. In the case of legal concepts the number of instances in an equivalence class is practically infinite; for example, the number of factual circumstances ("outcomes") that satisfy the requirements of a general concept ("reference class") such as "manslaughter" or "waiver" is enormous. The concept of an equivalence class is a useful device for describing the impact of uncertainty in legal doctrine on other evidence marshalling strategies and the concept of an equivalence class also brings into relief different possible strategies for reducing or coping with the uncertainty of legal rules.
One of the difficulties any investigator or lawyer faces before trial is the problem of marshalling evidence when legal doctrines are vague and uncertain. In the parlance of mathematics, such an investigator confronts fuzzy (legal) reference classes. When the definition of a reference class is fuzzy or vague, there is a measure of uncertainty about the membership of any particular entity in the reference class. Moreover, if the definition of a reference class is completely vague, it is impossible to determine whether any particular event falls within or without the reference class; i.e., if the definition of an "event" (taken in its probabilistic sense) is completely fuzzy, it is impossible to determine whether any particular state of the world makes that "event" occur.
Legal concepts--e.g., "murder"--are often vague. When
a legal concept is vague, there must also be uncertainty about
whether a particular act or situation is an example or instance of
the concept in question. This proposition may be rephrased in terms
of the equivalence class concept: if a legal reference class such as
"murder" is fuzzy there must be uncertainty about which "outcomes"
make an "event" such as "murder" occur. Stated otherwise, if the
event "murder" has an ambiguous definition, there will always be
uncertainty about whether any particular state of affairs does or
does not constitute, or instantiate, murder.
If we visualize the relationship between legal reasoning and
factual issues in litigation against this conceptual background, it
seems natural to think that when the ambiguity of a legal concept
(e.g., "undue influence") impedes or hinders an attempt to use a
legal concept to marshall evidence, the proper remedy is to clarify
the legal reference class. This way of grappling with the unsettling
effects of uncertainty in the law on the marshalling of evidence is a
top-down process; the uncertainty in the law is addressed before the
law is used to marshal evidence. However, once the relationship
between fuzzy legal concepts and particular instances is formulated
in these terms -- as a top-down process -- almost any lawyer trained
in the common law tradition will recognize that this is not the only
possible way that generic legal concepts and specific instances are
related. She will that legal reasoning involving fuzzy legal
doctrines may work in reverse. That is, instead of trying to clarify
a legal concept before applying it to particular situations, a judge
may examine particular situations (e.g., in prior cases) that
admittedly or apparently constitute instances of a legal concept,
such as "murder," and try to use those instances to formulate or
reformulate the definition of the concept.
In noting the differences between top-down and bottom-up
responses to legal uncertainty, we do not answer the question of
which of these two general approaches is the appropriate one or which
of them is more often used. Moreover, our distinction between two
types of responses to legal uncertainty is not intended to be an
exhaustive taxonomy of modes of reasoning that address uncertainty in
the law. Our objective is to describe an heuristic strategy
that people such as investigators and lawyers can use to organize
their thinking about a case. We have accomplished something important
if have shown that the concept of an equivalence class facilitates
analysis of the evidentiary and investigative implications of
top-down and bottom-up approaches to legal uncertainty. Moreover, our
analysis of the implications of two types of responses to legal
uncertainty ought to suggest that careful study of the relationship
between facts and other types of legal responses is warranted. The
question of the evidentiary implications of different modes of legal
reasoning is an important topic.
II. Granular Analysis of Marshalling Systems
In the last Part of the Article, we surveyed some of the heuristic functions of legal marshalling. However, we have not yet expressly considered a form of legal marshalling that involves a "case theory." A case theory is an unusually complex method of marshalling evidence because a case theory incorporates several distinct marshalling techniques. Before examining the notion of a case theory, we will first consider in more detail several marshalling strategies that are embedded in and intrinsic to case theories.
Our study concerns factual proof in litigation. Many general discussions of evidentiary processes in litigation focus on analysis of the impact of available and known evidence on an identifiable and identified factual hypotheses. This type of analysis, which we call "relational analysis," is not the primary focus here. In preliminary fact investigation the decision maker knows that he does not yet have all of the relevant evidence that he may later acquire and ordinarily he has not yet identified the factual issues to his satisfaction. Moreover, the task of assessing the force of evidence is relatively less prominent during investigation than at trial. Our detailed analysis of marshalling strategies begins with a discussion of the formation and specification of issues and hypotheses. The framing of hypotheses is particularly important in exploratory investigation.
A. Determining Possibilities and Framing Issues
When a lawyer or other actor in litigation first encounters information suggestive of a possible lawsuit, he may anticipate having problems of proof if litigation eventuates. If the lawyer does think ahead about such possible problems, he is likely to have only a fairly vague sense of what those problems may turn out to be; that is, the potential proof problems that he sees at this point are likely to be fuzzy and ill-defined.
The poor definition of the problems that an investigator faces at the outset of an investigation raises a variety of interesting and important issues. For example, how do and how should decision makers in litigation cope with fuzzy problems during investigation? Why is it important to make factual issues specific? And if it is important to frame problems of evidence, inference, and proof in a discrete and specific way by the time a trial eventuates, is it important to be specific long before trial, in the early stages of investigation? If so, how is that to be done in an efficient manner?
Imagine yourself a detective in a metropolitan police force in the United States. On December 8, 1987, you learn that the body of a white male has been found in a garage attached to a home in Falls Church, Virginia. You learn that the body was found lying on a floor between two cars and that the hood of one car was open. You have also been told that there were deep lacerations in the head of the deceased.
How might you think about this information?
If you are a police detective (and even if you are not), you might entertain the hypothesis that the deceased--who we shall call Mark Vincent--died as a result of someone's criminal act. However, given the limited and ambiguous nature of the information available to you, you might also entertain other hypotheses. You might, for example, entertain the hypotheses that Mark Vincent's death was accidental, that Mark Vincent died as a result of natural causes, or that he committed suicide.
These hypotheses are relatively diffuse, vague, coarse, or undifferentiated. For example, the evidence does not seem to suggest any hypotheses about the precise sort of criminal act that might have caused Mark Vincent's death. Alternatively, if the investigator is willing to speculate that a homicide took place, the evidence does not seem to support any guesses about the grade of any homicide that might have been committed. Similarly, if the evidence does suggest the possibility of a suicide, the evidence does not seem to suggest how Mark Vincent might have done himself in.
Glenn Shafer has suggested a way of thinking about conjectures and hypotheses that are suggested by evidence. He refers to different sets of possible hypotheses, or outcomes, as "frames of discernment." In Shafer's terminology, the set of conjectures we have ascribed to you--our hypothetical police detective--is a "frame of discernment." Your frame--the frame of our hypothetical police investigator--consists of all the hypotheses about Mark Vincent's death that you happen to entertain.
We shall refer to your first frame as F1 and we stipulate
that it consists of the possible outcomes (1) death by natural
causes, (2) death by accident, (3) suicide, and (4) death by criminal
act. This frame may be represented thus:
Now suppose that you, the detective, acquire some additional morsels of information. You have some evidence that Mark Vincent's sister, Marsha Vincent, was in the residence adjacent to the garage on the day of Mark Vincent's death. Under these circumstances you might entertain a slightly different set of tentative hypotheses, conjectures, or possibilities. (Expressed in terms of probability theory, you might now partition the sample space in a different way.) Your new list of possibilities, which constitute another frame of discernment F2, might now look like this:
This frame is somewhat more specific and somewhat more differentiated because the hypothesis of death by criminal act has been broken out into two hypotheses, one of which focuses on a particular person, Marsha Vincent.
It is of course possible that the police detective has a
different set of conjectures. He might rule out death by natural
causes. If so, his collection of hypotheses might look like this:
The possibilities in this frame are as coarse as in the first frame. However, the frame now contains fewer possibilities.
Shafer speaks of these sets of possible outcomes as frames of discernment because he maintains that differences in the possibilities or hypotheses a person entertains generate differences in the way that information and data are partitioned; that is, as different questions or hypotheses are asked or put, the available evidence sorts itself out, or is sorted out, in different ways.
Shafer's insight that there is a relationship between the structure of hypotheses and evidence is very important. The notion of a frame of discernment implies that the relevance of evidence depends on the nature of the hypotheses or conjectures "in the case"; it goes to the familiar and common sense point that the pertinence and relevance of information is in part a function of the question or questions that one asks or wishes to answer. This basic insight is crucial. Unlike most probabilistic perspectives on evidence and inference, Shafer's theory speaks to the process of inquiry. This is because Shafer examines the formation of factual hypotheses, not just the question of how existing factual issues are to be resolved.
Shafer makes a variety of useful observations about the influence of evidence on the formation of factual hypotheses. Shafer observes that hypotheses, conjectures, and "possibilities" vary in their degree of differentiation; some hypotheses are relatively coarse or diffuse and other hypotheses are relatively differentiated and specific. The fact that the specificity of hypotheses can vary has two important implications. First, since the relevance of evidence is a function of the nature of the hypotheses or conjectures posited, the relevance of evidence varies as the specificity of the hypotheses varies. Second, the relative specificity of a frame of possibilities is a function of the available evidence. Shafer maintains that as evidence accumulates, a frame of and the possibilities within it tend to become more specific. Shafer illustrates this point with "The Case of the Missing Cookie."
Sally and Billy are two children. One morning their mother
notices that there is only one cookie left in the cookie jar. Later
that morning she notices that the cookie is no longer there. She
shouts, "Who took the last cookie?" Billy answers, "I saw Sally take
it." The mother rushes to Sally's room and finds cookie crumbs there.
This evidence does suggest that Sally was the miscreant, but it does
not yet convince the mother of Sally's guilt. Hence, Sally's mother
entertains two possibilities, "Sally Did It" and "Sally Didn't Do
It." In Shafer's terminology these two possibilities make out a
"frame" and they may be represented in the following way:
As the mother ponders these alternative possibilities, it seems to her that two separate pieces of evidence support the possibility "Sally Did It"; Billy's accusation does so, but so does the cookie crumb evidence. Hence, even if Billy is being untruthfull and did not see Sally take the cookie, the cookie crumb evidence still supports the hypothesis that Sally took the cookie. However, as the mother ponders further, it occurs to her that it is possible that Billy ate the cookie and planted the cookie crumbs in Sally's room.
Shafer argues that in this situation the way the mother has
framed the possibilities is no longer satisfactory. The mother
originally believed that two pieces of evidence point to Sally as the
miscreant. However, if it is possible that Billy planted the cookie
crumbs, the possibility that Billy was being untruthfull affects the
probative value of the cookie crumb evidence as well as the probative
value of Billy's accusation. Given this relationship between
the two pieces of evidence, it is necessary for the mother to
reformulate or restructure the problem of the missing cookie; if she
wants to think about the problem clearly, Shafer argues, she must
construct a new and more refined frame that takes into account the
possibility that Billy planted the cookie crumbs. Figure 3
describes the possibilities she now sees.

The new frame Fb is more refined, less coarse, more differentiated than frame Fa. However, Frame Fa can be differentiated in different ways. Moreover, it may be differentiated to a greater degree. For example, Sally's and Billy's mother notices that there are other children in the house--friends of Billy and Sally have come over to play--she may wish to consider a variety of new hypotheses about the reason for the missing cookie. For example, she may decide that it is possible that neither Sally nor Billy took the missing cookie, it is possible that Sally joined with one (or more) of the visiting children in taking the missing cookie, and it is possible that Billy and a visitor (or visitors) acted in concert. It may now also occur to the other that Billy and Sally might have acted in concert and she might entertain this possibility, together with the possibility that Sally acted alone and the possibility acted alone. This new set of possibilities, greater in number and more differentiated than those in Fb, is represented in Figure 4.
Notice that FB^, like Fb, is consistent with Fa. Moreover, FB^ and Fb, we have supposed, were formed after Fa was formed. However, the process can also work in reverse; a relatively richer frame such as Fb can be abandoned (because, for example, it is discovered that Billy was not in a position to plant cookies in Sally's room), thus restoring the primacy of a more general frame such as Fa.
There are multiple messages in "The Case of the Missing Cookie." First, the specificity of frames varies. Second, the specificity of a frame is related to the nature of the available evidence. Third, frames can be refined and made more specific. Fourth, The frames can be made more specific in different ways. Another possible lesson is that frames can be coarsened as well as refined. These propositions shed a great deal of light on investigative strategy.
Shafer's argument about how the mother in the cookie case refines her possibilities suggests that extremely coarse hypotheses are generally of little value to an investigator. For example, suppose that the frame concerning Mark Vincent's death consists of the possibilities (1) Mark Vincent died unfairly and (2) Mark Vincent did not die unfairly. The possibilities in this frame are not sharp; they are relatively undifferentiated. They are also of little value to an investigator. They have little value because they do not serve to sort out potentially interesting items of evidence in any very specific or discrete way. Indeed, the possibilities in the frame are so coarse that they give little if any indication of what sort of evidence might serve to confirm or disconfirm them. We might say that this frame does not serve to partition any evidence we might happen to acquire. Hence, this frame of coarse possibilities provides almost no guidance or instruction for an investigator.
Specific hypotheses, by contrast, are excellent indicators of important evidence. Specific hypotheses focus attention on particular types and items of evidence. Their specificity is suggestive of the specific items of evidence that are relevant to the assessment of the hypotheses under consideration. For example, suppose that you--the police detective--seriously entertain the hypothesis that Marsha Vincent deliberately stabbed Mark Vincent in the head with a screwdriver at 3:01 a.m. in the garage because she became angry about his animosity toward Harriet Jones. This hypothesis or possibility is highly differentiated or particularized. It is also suggestive of the types of evidence that might be of interest to you. For example, it suggests that an interview with Harriet Jones might produce highly significant evidence, it suggests that you might wish to ask Marsha about her feelings toward Harriet, and it suggests that you should attempt to establish that Marsha was home before 3:01 a.m., and so on.
The highly specific hypothesis that we have just attributed to the police detective also imparts a very different lesson. It demonstrates that specificity in conjectures and hypotheses is not always a virtue. Assume that highly differentiated and specific hypotheses do indicate more precisely how they may be verified or disconfirmed. This being granted, it does not follow that investigators should always formulate highly differentiated hypotheses. As the Mark Vincent problem suggests, highly differentiated hypotheses may be of little value if they "outrun" the available evidence. For example, there is little if anything in the evidence recited earlier that supports the conjecture that (if any homicide took place) the homicide was committed at 3:01 a.m. rather than at 3:02 a.m. The precision of this conjecture outruns the evidence. A rational investigator will sometimes decide, not to refine his hypotheses, but to make them more coarse and diffuse.
The difficulty with constructing differentiated hypotheses that outstrip the evidence is partly economic. It would be much, much too expensive and time-consuming to give equal dignity to all of the discrete hypotheses that could be imagined by an investigator who feels free to invent possibilities without any reference to the available evidence. The costs associated with simply inventing and recording such possibilities--not to speak of the costs associated with actually gathering evidence about all of them--would very quickly exceed the gross world product.
The difficulty posed by rampant multiplication of distinct homicide hypotheses, however, is not entirely economic; it also violates the virtue of cognitive parsimony. One objective of formulating conjectures and hypotheses is to facilitate analysis of possible courses of investigation (and, ultimately, possible courses of proof activity at trial). In the investigative situation we have just hypothesized, one can imagine little reason for the particular method used to generate specific hypotheses. For example, there is no apparent reason to distinguish homicide conjectures on the basis of the exact minute they might have been committed. For all that appears, distinctions on the basis of hours or days would have served equally well. Hence, there is no particular reason to think that differentiating homicide hypotheses on the basis of the minute of the killing or on the basis of the identity of the killer will produce any cognitive benefits; ruder distinctions, it appears, would do as well. Indeed, given the available evidence, the variable of the identity of the killer might well be omitted altogether. In short, the precision of the possibilities is excessive and spurious and the frame it generates is cognitively unparsimonious.
If it is true that one cause of waste of cognitive resources is the absence of evidential support for possibilities, what is an investigator to do when the evidence available to him fails to suggest any possibilities except hopelessly coarse ones? It is safe to say that the concept of frames of discernment offers little if any help to an investigator in this situation. This does not mean that the refinement of possibilities is of no value during exploratory investigation. Even small collections of details may suggest relatively differentiated possibilities and Shafer's procedure has considerable heuristic value when some possibilities begin to emerge from the evidence at hand.
The Case of the Missing Cookie illustrates Shafer's thesis that evidence serves to refine hypotheses. By this he means that evidence itself suggests various possibilities and evidence gets incorporated in hypotheses. This is why we say that Shafer refuses to permit possibilities to outrun the evidence. Shafer describes a procedure for incorporating evidence into hypotheses. To illustrate how Shafer's technique works we will now add a few details to the detective's information base.
Suppose, first, that the detective searched Mark's body,
the garage, and the adjacent house and he did not find Mark Vincent's
wallet. Suppose, further, that evidence suggests that Mark Vincent
and Marsha Vincent stopped to cash a check for $200 shortly before
Mark and Marsha went home the night before Mark's death. This new
information suggests a new possibility--the possibility that Mark's
death occurred in the course of a robbery. If we take F3 as the basic
frame, this new possibility of robbery generates a new frame, which
we shall call F3.1. Figure 5 shows the relationship of this new frame
to the basic frame F3.
Now add some more information to the pot. Specifically, after
a further search Mark's wallet is found in a bush directly adjacent
to the garage in which Mark's body was found. However, there is no
money in it and, even though it is known that Mark usually carried
credit cards, there are also no credit cards in the wallet. Moreover,
the search uncovers an anacin box in the vicinity of Mark's body. The
anacin box may contain traces of cocaine. Furthermore, the
investigator discovers that Mark Vincent had been seeing a woman
called Monica Carlson, the wife of Richard Carlson, and that Richard
Carlson's van had been seen in the vicinity of Mark's house the night
of Mark's death. Finally, the investigator discovers that Mark and
Marsha, who were brother and sister, were joint owners of a computer
company.
This new information again suggests the possibility of a
robbery, but this time it may also suggest the possibility that the
robbery was ancillary to an assault, motivated either by Carlson's
possible jealousy, by a sour narcotics deal, or by the desire of
Marsha to harm Mark to get his share of the computer company for
herself. If we add these possibilities to the pot, we get this sort
of picture:
However, the facts recited suggest another possible variation on
Frame F3 It is possible there was an assault on Mark Vincent, but no
robbery. If so, the new frame now may look like this:
It is now becoming apparent, we trust, that the process
of refining frames of possibilities may generate disadvantages as
well as advantages. We have already described why disadvantages may
accrue if an investigator allows his hypotheses to outstrip the
available evidence. However, the tactic of refining possibilities can
cause difficulty even if all of the possibilities are suggested by
the available evidence.
The illustrations we have given of the process of
refinement show that possibilities are extracted by a branching,
tree-like procedure. Figure 8 shows one abstraction of the refinement
process.
The initial frame G shows two possibilities, {A,Ac}. (Read Ac as "not-A.") These possibilities are embellished in frame G1 because the occurrence or non-occurrence of B is now considered. Thus, one possibility now is ABc, A happened and B did not happen. In Frame G2 the possibilities are further embellished by consideration of the occurrence C.
There is an entailment relationship among these three levels of refinement. For example, ABC ---> AB ---> A. (Read "--->" as "implies.") That is to say, if A and B and C happened, then A and B necessarily happened, and if A and B happened, then A necessarily happened. This logical point is quite important for present purposes because it means that all of the possibilities in the lower frames are compatible with the possibilities in the higher frames; there is no contradiction between the possibilities in the different frames.
The compatibility of lower frames with frames higher up
means that possibilities can easily be expanded without limit and
without fear of producing any contradiction with the initial frame.
The refinement process shown in Figure 8 is just a special case of
the process of producing compatible refinements. If S is the universe
of all possibilities, frame G is simply a partition of all of these
possibilities in terms of {A,Ac}; frame G1 is just another partition
of S when {B,Bc} are considered; and frame G2 results when {C,Cc} are
considered. However, new frames can be generated at will, and to any
level, simply by increasing the number of single events in joint
events (i.e., A & B & C & D & ... N), together with
the complements of those single events. Moreover, different sets of
compatible refinements can be generated by selecting joint events
consisting of different single events. For example, Figure 9 shows
another set of refinements, different from those in Figure 8, but
also compatible with frame G.
We need not describe this tree-like refinement process any further. It is evident that the refinement strategy can generate a vast number of possibilities and that it can do so even if the possibilities do not outstrip the evidence. While it is possible that a real-world investigator who is attempting to make sense of the information available to him might make conscious use of only a possibilities strategy, it is very unlikely that the possibilities marshalling strategy can fully explain how any real-world investigator conducts a real-world investigation. Since the possibilities strategy is a tree-like hierarchical process, the number of possibilities directly indicated by evidence can multiply rapidly. For example, if the possibilities branch out symmetrically, the number of possibilities increases exponentially at each additional level of branches. Consequently, if the tree metaphor correctly describes the manner in which evidence generates possibilities, the strategy of refining possibilities can generate millions or billions of possibilities even if there has been only little investigation and the number of details collected is small.
Ordinarily it is not useful to formulate millions or billions of possibilities. There are, of course, considerable logistical problems and resource allocation problems associated with any investigative process that generates this many possibilities for serious consideration and investigation. However, another kind of cost may be associated with numerous possibilities. Even if an investigator has all the time and resources in the world at his command, he will not wish to scan all refined possibilities that the evidence suggests. It is not cognitively fruitful to consider all the possibilities suggested by the evidence.
It is fair to infer that any real-world investigator--particularly a mortal investigator having limited resources--must and will prune the possibilities tree of many of its limbs and branches. It is also safe to say that any rational investigator will ordinarily do the same thing. However, if an investigator prunes branches from a possibility tree, while leaving others intact, it is clear that some sort of cognitive process apart from possibilities analysis is at work in his brain, telling him in some way that some possibilities should be eliminated and others retained; something is telling the investigator that some possibilities are interesting while others are not. If this process of selective pruning of possibilities is effable rather than ineffable, it follows that the investigator who prunes possibilities trees is using one or more marshalling strategies that, although making an imprint on Shaferean marshalling, are not captured, or portrayed, by Shaferean formalizations.
In the remaining sections of this part of the paper we will examine in detail several of the other marshalling strategies that may interact with the Shaferean possibilities marshalling strategy that we have just described. (The basic characteristics of these supplemental strategies have already been described in Part II.) However, instead of emphasizing how various marshalling strategies can reduce the number of possibilities, we will generally emphasize how marshalling strategies can expand the number of possibilities to be considered.
A marshalling system based on Shaferean possibilities tends to emphasize the importance of framing hypotheses that incorporate the possibilities disclosed and supported by available evidence. In the next section of this paper we view the relationship between hypotheses and evidence in a rather different way; there we stress the importance of having hypotheses, conjectures, and possibilities that outstrip and outrun the available evidence. The Shaferean perspective is rooted in common sense; there are clearly risks in forming hypotheses that outstrip the available evidence. However, there are also grave dangers if possibilities analysis is the only strategy used to marshall evidence. The Shaferean perspective on hypothesis formation, by stressing the isomorphism between evidence and hypothesis, understates the importance of invention in hypothesis formation.
B. Possibilities and Imaginative Reasoning
1. Possibilities and Abduction
Among the most important contributions of the cantankerous
American theorist Charles Saunders Peirce were his discussions of the
nature of imaginative and creative processes. In Peirce's day
it was fashionable to say that scientific investigation involves two
types of reasoning processes, deduction and induction. Peirce's
contemporaries--many of whom were steeped in Mill's theory of
scientific method--generally portrayed both deductive and inductive
reasoning as rule-based processes. While Peirce did not deny that
rule-based inductive reasoning is important in scientific
investigation, he did insist that imaginative reasoning--a type of
reasoning that produces outcomes that are not determined by
pre-existing rules--also plays a crucial role. According to Peirce,
imaginative reasoning cannot be subsumed under deduction or
induction; it is a third category of reasoning, distinct from both
deduction and induction. He called this third form of reasoning
abduction.
The concept of abduction is a useful device for thinking
about the relationship between possibilities and scenarios, and it
also helps to explain why possibilities analysis cannot always stand
alone. Return to the Mark Vincent hypothetical. Recall that one
collection of the evidence in the case supports the possibilities
captured in Frame 3.3, which look like this:
In verbal terms, the possibilities portrayed in the above diagram are the following:
1. Mark Vincent was killed as a result of an assault that was incidental to a robbery. The evidence of Vincent's empty wallet supports this possibility.
2. Mark Vincent was killed incidental to an assault that was made to look like a robbery. The evidence that a person was at the scene of the crime after the ambulance removed the body and that the wallet was not found before the ambulance removed the body supports this possibility.
3. Mark Vincent was killed during an assault. Mark Vincent lost the empty wallet at some other time or was robbed at another time by another person.
Now consider Figure 10.
The diagram in Figure 10 captures one crucial ingredient of
Shaferean possibilities analysis. The terms "pro" and "con" represent
evidence that bears on each possibility suggested by the evidence.
For each possibility, however, there is always "pro" evidence. This
is because in Shafer's scheme a possibility is always embedded in the
evidence; the only possibilities he recognizes are those that the
evidence discloses. In reality, however, people attempting to assess
the significance of evidence frequently construct or invent
possibilities that the evidence itself does not suggest or manifest.
The possibility Pn in the square below the question mark in Figure 11
represents such a possibility.
The extraction of the new possibility Pn is an example of abduction. Figure 11 arrays all the evidence that favors and disfavors the possibilities in frames of discernment such as Frame 3.3. However, as Figure 11 illustrates, after the evidence is arrayed pro and con on identified possibilities, it often happens that there is left over a body of evidence or details that neither favors or disfavors any of the possibilities that have been previously identified. In Figure 11 this "unconnected" body of evidence is represented by the symbol E. In the face of E an investigator may well invent a new possibility, Pn. E is evidence in search of an hypothesis. The invention of a hypothesis Pn to explain E is a form of abduction. Since possibility Pn is not directly shown by the evidence E, we can say that the investigator manufactures hypothesis Pn.
2. Possibilities and Retroduction
We have just seen that abductive reasoning may be applied to possibilities. However, possibilities may also figure in another type of reasoning that Peirce called "retroduction." There is a close relationship between abductive and retroductive reasoning.When an investigator thinks abductively, she invents possibilities. When an investigator thinks about possibilities retroductively, she reverses the process. Instead of hypothesizing possibilities to explain otherwise mystifying evidence, she imagines the evidence that a possibility might generate; instead of asking what possibilities are suggested by the evidence, she asks what evidence is suggested by the possibilities. When thinking retroductively the investigator would ask the following type of question: "If a given possibility (hypothesis) is true, what sort of evidence should I expect to find?"
Retroductive thinking about the relationship between
evidence and possibilities is hypothesis-driven. Abductive reasoning,
by contrast, is evidence-driven. Figure 12 represents the basic
nature of abduction.
The arrow in Figure 12 indicates the direction in which reasoning
moves. It moves from evidence E to hypothesis H; that is, H is
inferred from E. However, the direction of the reasoning process can
be reversed. Whereas in abduction a body of evidence supports an
inference about a hypothesis, when the direction of the reasoning
process is reversed, H, a hypothesis, is the basis for an inference
about E, evidence. Figure 13 represents this reverse reasoning.
While abduction is bottom-up reasoning, retroduction is top-down
reasoning. In abduction we have evidence in search of a hypothesis
and in retroduction we have a hypothesis searching for evidence.
Retroduction, properly so-called, results when top-down reasoning
follows on bottom-up reasoning. We have pictured this reasoning
process as one that involves the steps shown in Figure 14.
In this schema, we suppose that an investigator (1) begins with a given set of hypotheses H1 through Hn, (2) discovers that there is an body of evidence E that cannot be arrayed against these existing hypotheses, (3) infers a new hypothesis that may explain Hn+1, and (4) infers new evidence (in addition to E) from Hn+1.
When retroductive reasoning is applied to evidence and possibilities, one or more hypotheses--"possibilities," in Shafer's terminology--are taken as true and additional hypotheses, or possibilities, are extracted, or "deduced" from the possibilities that are assumed to be true. The derivative hypotheses or possibilities become indicators of potentially relevant evidence; they indicate, or point to, the potential significance of evidence that either favors or disfavors the deduced possibilities. For example, consider possibility P3.2.1, the possibility that Mark Vincent was assaulted by Richard Carlson, the jealous husband of Monica Carlson. If retroductive reasoning is employed, the investigator might ask, "If P3.2.1 is true, what other possibilities and evidence would we expect to have?" If he asks this question, the investigator might conclude that there may be witnesses who will say that they saw Mark and Monica together in circumstances consistent with the possibility of a romantic interest between Mark and Monica.
The concepts of abduction and retroduction serve to clarify our thesis that possibilities analysis does not stand alone and that it is subject to the influence of other evidence marshalling techniques. Indeed, the illustrations we have given of the potential impact of abduction and retroduction on possibilities analysis understate the potential impact of abductive and retroductive reasoning. For example, in our discussion of abduction we assumed that abduction only enters the picture when a portion of the available evidence cannot be arrayed (pro and con) against existing possibilities. Hence, we assumed that existing possibilities are simply present or given. However, it is of course possible that the existing possibilities were themselves obtained by abduction. Indeed, it might be said that no possibility exists in the absence of abduction. For example, the formation of the hypothesis that Mark Vincent was killed as a result of a robbery is a possibility manufactured by the investigator; although this possibility is supported by the evidence, it is nevertheless a hypothesis that the investigator formulates and invents.
Our earlier illustrations also understated the potential impact of retroductive reasoning on possibilities analysis. Any assessment of the force of evidence on known possibilities inescapably involves retroduction. Even if a body of evidence can be arrayed pro and con against existing possibilities, it is always possible to invent a new possibility having evidential implications and consequences. Hence, whether or not existing possibilities are satisfactory cannot be determined without a determination of whether there are yet other plausible possibilities that can also explain the available evidence. For example, if all the available evidence could be arrayed pro and con against the hypothesis that Mark Vincent was killed as a result of a robbery, it might still be necessary to consider the additional possibility that Mark Vincent was killed as a result of a drug deal gone sour. It might turn out that the sour drug deal hypothesis is superior to the robbery hypothesis even though all of the available evidence is pertinent to the robbery hypothesis.
These considerations are a partial vindication of our general thesis that it cannot be assumed that any single evidence marshalling system operates without being influenced by any other scheme of evidence marshalling. However, if this general point is granted, the exact nature of the connection between possibilities analysis and other evidence marshalling strategies remains to be determined and described. Hence, we now focus on the possible relationships between possibilities analysis and several other forms of evidence marshalling.
C. Event Chronologies, Scenarios, Possibilities
1. Marshalling by Time: Event Chronologies
The construction of a hierarchy of possibilities takes into
account the order in which evidence was discovered. However, the
order in which events are believed to have occurred is also a matter
of considerable importance. An investigator who acquires details may
feel a need not only to record the time at which the evidence was
received (which is not, by the by, the same as time-stamping the
order in which possibilities were imagined), but also to time-stamp
the events that the evidence may show. One reason for the importance
of the effort to order temporally the events possibly shown by the
evidence is plain: one of the ultimate objectives of the investigator
may be to demonstrate that certain events or acts in time took place
or that a certain sequence of events or acts took place.
Consequently, as we mentioned in Part I, one step an investigator may
take is to construct a "time-line." We refer to a time-line as an
"event chronology." Figure 15 is an example of a simple event
chronology.
An event chronology can serve various useful functions. One of
its functions hinges on the inconclusive character of evidence. Since
evidence is always inconclusive, it is never certain that the
reported order of events conforms to the actual order of events. An
event chronology is a useful device for marshalling various items of
evidence that bear on the question of the temporal locus of a
particular event. The evidence suggesting a particular temporal locus
of an event can be arrayed against a point or an interval on a
time-line.
Assuming that an investigator has some confidence that the reported order of events conforms with the actual order of events, an event chronology also serves the obvious function of arranging significant events in a temporal order. As noted earlier, one obvious reason for arranging events temporally is the expectation that at any trial someone--judge or jury--have to make decisions about events and acts that took place--of course--in time. Moreover, the order in which events and acts occur may be of enormous significance. In a murder case, for example, it may make all the difference whether the accused purchased a gun before or after the victim was shot and in a conspiracy case it may make a difference whether the alleged conspirators became acquainted with each other before or after the alleged conspiracy.
Although a time-line of events can be useful, it is not always simple to assemble a useful one. In the course of an investigation an investigator may receive reports of a great many events. The multitude of such reports can generate two kinds of difficulties. The first difficulty is of a practical and logistical kind. The sheer number of reported events and acts may make it difficult to display them clearly. For example, a great many events and acts may have taken place in one relatively short interval of time (e.g., 20 seconds). The result may be great "event density" in one interval of time, while relatively few events and acts are reported as having occurred in other comparable intervals in the event chronology. It is not easy to display events clearly clearly when they are distributed unevenly over time.
Event density is not the only cause of clutter in an event chronology. The intrinsic nature of an event chronology is another source of clutter. If an investigator receives reports of numerous events and attempts to record every such event, the resulting event chronology will appear cluttered even in the absence of event density because many of the events recorded by the investigator will have no apparent connection with each other and many of the recorded acts and events will have no apparent significance. The consequence is that such an event chronology may impede rather than improve comprehension.
The existence of this second type of clutter reflects the fact that an event chronology is not a scenario. An event chronology merely lists the order of events and acts; it establishes no links or connections between the acts and events shown in the chronology. The absence of links between events may produce clutter and impede comprehension even if all the events recorded are significant ones. For example, Event A, a significant event, may be connected with Events F and J, but not with Events B, C, D, and E, which fall between A and F, or with Events G, H, and I, which fall between F and J. The importance of being able to see connections between events suggests that one of the purposes of an event chronology is the development of a scenario. A scenario, unlike an event chronology, purveys a theory about events and acts in time; a theory that explains events establishes connections among them. Hence, a scenario lends a measure of intelligibility and coherence to temporally-ordered events and, by doing that, it also makes it easier for an observer to grasp, store, and recall the events in question.
If it is granted that an event chronology facilitates the development of scenarios and that scenarios make an event chronology more intelligible to an observer, it remains to be established how an event chronology should be constructed in order to facilitate the construction of scenarios. This, like every similar question about the relationship between marshalling strategies, presents something of a chicken and egg problem: without knowing what the probable scenario is, we cannot be sure how to construct an event chronology, and without some type of an event chronology, we may find it hard to construct a scenario.
Part of the answer to this dilemma must be simply that the
investigator must rely on his intuitions in deciding which events are
likely to be significant. However, we have more substantial and
useful advice to give about the design of event chronologies. One
piece of advice is that investigators consider constructing event
chronologies around actors. Figure 16 shows how such an event
chronology might look.
While our advice to construct event chronologies around actors also partially begs the question--the question being how an investigator is to decide whether an actor is or is not a significant player--, our advice does not beg the somewhat different question of the appropriate design of an event chronology when an investigator's ignorance is great but not complete. An investigator may always surmise that the issues in any eventual trial will implicate hypotheses about human actions; lawsuits always involve hypotheses about the conduct of human beings. Consequently, an investigator may reasonably surmise that regardless of the nature of the central issues in a case, a party involved in a trial will have to construct and present a coherent and plausible story about the activities of one or more people. Hence, lacking any particular reason to use any particular marshalling strategy or to use a particular marshalling strategy in a particular way, an investigator may be well-advised to begin the project of constructing an overall scenario by assembling mini-scenarios about particular individuals, with the expectation that he may later be able to piece together those mini-scenarios to make out the larger story that he or someone else will eventually want to tell if a trial eventuates. One additional reason to take this course is that most investigators already have a reservoir of background information about the behavior of human beings. This reservoir of information allows them to make plausible guesses, even when little specific information is available, about how actors might have acted and interacted.
In the discussion of scenarios found immediately below we offer more advice about the design and uses of event chronologies. The reason we can do so--the reason why the chicken-and-egg problem does not stop us--is that it is not sensible to assume that an investigator cannot have a sense of the possible uses and purposes of an event chronology before another marshalling strategy has been consciously used. Not all knowledge is explicit; some is tacit. The marshalling systems that we describe are heuristic devices. Any users of these systems must and will capitalize on the knowledge they already have, including their tacit knowledge. Indeed, it may be permissible to think of the network described here as a device that has the capacity to bring to consciousness and make explicit the methods and procedures that people already tacitly and naturally use when they engage in fact investigation.
2. Marshalling by Time: Scenarios
We have already explained that a scenario constitutes an explanation of a sequence of events in time. We also noted that a scenario also serves as a "gap filler." A scenario performs this service precisely because a scenario is an explanation or a theory. That is, there is more to a scenario than the events it explains; there is also the explanation or theory that it contains. This theory or explanation is a theory of how things and events are related in time and a theory of this sort--a scenario--allows the person constructing a scenario to posit events and acts for which there is no evidence. It is this conjectural or fanciful ingredient that legitimates use of the loose phrase "story telling" to refer to the process of scenario construction. However, as we explained in Part II, a story used for forensic purposes cannot be entirely fanciful; we are, ultimately, concerned about the truth of a matter or matters of fact. Hence, if a scenario has elements of fancy, it must be a mixture of fact and fancy; we are interested only in plausible stories.
Figure 17 represents a scenario containing a mixture of
fact and fancy.
The partially shaded squares in Figure 17 represent "gap fillers."
For example, if an investigator has good evidence that Able intended
to go to Stop & Shop (a supermarket) but there is no other
evidence whether he actually did so, we may "fill the gap" in our
story by guessing that he did go to the supermarket. Hence, gap
fillers are hypothesized events; they represent the fanciful or
conjectural components of a scenario. By contrast, the black
circles in Figure 17 represent "benchmark events." Benchmark events
are the stable components of the scenario; they are the scaffolding
on which the conjectural parts of the scenario can be hung.
Although some events may be treated as benchmarks, brief reflection makes it plain that the question of whether an event is or is not a benchmark does not always (if ever) have a secure answer. Thus, the initial decision of whether an event as or is not a benchmark may be in doubt. Moreover, if benchmarks events are "stable," they are only relatively so. Furthermore, an event that was taken to be a benchmark may later seem less (or more) "solid"; thus, the initial judgment that an event is a benchmark may be questioned and revised later. Hence, the question of whether an event is a benchmark may be the subject of conscious deliberation; an investigator may wonder which events should serve as the basis for additional conjectures.
The strength of the evidence pointing to the existence of an event is one factor that influences the decision whether or not to treat an event as a benchmark. The reason for this is plain: since our ultimate interest is in the truth of some matter of fact, we do not want to build the fanciful parts of our stories on rungs that may fall out from under our feet; we want to choose rungs that we think will hold up. The importance of identifying benchmarks for possible scenarios suggests that one of the functions of an event chronology is to facilitate assessments of the strength of the evidence supporting an event recorded on the event chronology. We have already noted that an event chronology permits an investigator to juxtapose events and the evidence that points to the occurrence of those events. This juxtaposition improves an investigator's ability to determine how strongly evidence supports the hypothesis that an event occurred and it aids the investigator in making the decision whether to accord a hypothesized event benchmark status. In short, an event chronology stimulates the formation of scenarios not only by the manner in which it displays the temporal order of possible events, but also by the way it displays the probability that the events recorded conform to actual events.
It follows that a well-supported event in an event
chronology may become a benchmark event in a scenario. The manner in
which this transposition might take place is illustrated by the
diagrams in Figure 18.
3. Legal Marshalling & Case Theories
The use of a case theory as an evidence marshalling strategy is closely related to the use of elements of substantive legal rules to marshal evidence. Like marshalling by legal rules, a case theory implicates substantive legal doctrines. However, a case theory is more than a method for marshalling thought about legal doctrines. A case theory is a method of relating legal doctrines to evidence and hypotheses about facts.
A lawyer might say that a theory of the case relates factual issues to the elements of the legal claims and defenses that are (thought to be) "in" the case. Indeed, our imaginary lawyer might go one step further by saying that a case theory describes the relationship between the material factual issues in the case and the evidence that is relevant to each material factual issue. When viewed in these terms, a case theory collapses several distinct marshalling strategies into one: the imaginary lawyer's formulation refers to the elements of legal rules, to material factual hypotheses, and, in our terms, to "details," "possibilities," or other matters of this sort. While we use rather different language to explain what a case theory is, our account of a case theory is very much like our imaginary lawyer's. Moreover, our formulation of a case theory also suggests that a case theory combines, or integrates, several distinct methods of marshalling. It is as if several different methods of marshalling are drawn up into a case theory.
In our terms--i.e., in terms of the equivalence class concept--, a case theory incorporates those substantive legal rules whose joint satisfaction through a scenario constitutes instantiation of a case theory; stated otherwise, a case theory prescribes a theoretical equivalence class consisting of scenarios in which all of the substantive legal rules in the theory are instantiated by the evidential foundations of those scenarios. This interpretation of the notion of a "case theory" involves several methods of marshalling evidence. First, since a case theory is a theory about the relationship between legal doctrines and evidence, a case theory involves the decomposition of legal doctrines into elements. Second, since a case theory is a theory of how facts establish or satisfy the elements of legal doctrines, a case theory incorporates a hypothesis that specifies the particular states of the world (factual situations) that instantiate the elements of legal rules. (We might think of this as reasoning that addresses the relationship between abstract legal principles and concrete factual situations.) Third, since a case theory posits instantiation of elements of legal rules by particular facts whose existence is uncertain, a case theory necessarily incorporates factual hypotheses, and since a factual hypothesis is always embedded in a scenario, a case theory inevitably incorporates a scenario. Finally, since a case theory has value only if there is evidential support for the theory, a case theory incorporates or reflects methods of marshalling such as the marshalling of details, marshalling by possibilities, marshalling for credibility, and the marshalling of real evidence.
Conclusion
A. Integration and Coordination of Marshalling Strategies
We have shown that marshalling strategies taken individually have the capacity to generate very complex webs of arguments and extremely intricate arrangements of details. In view of this, one may question whether any natural person has the capacity to use a single marshalling strategy effectively. The use of a case theory to organize investigation makes this question more acute because at least several different methods of marshalling are embedded in any case theory. Hence, if it is true that the use of a case theory to marshal and organize evidence "works," this fact has important implications for the feasibility of coordinating marshalling strategies.
We have devoted a substantial amount of discussion to several marshalling strategies. In some of those discussions, we have alluded to the problem of coordinating marshalling strategies. For example, our discussion of the relationship between scenarios and event chronologies suggests that an intelligent investigator may want to skip back and forth between different marshalling strategies. Thus, when an investigator attempts to construct a scenario, she may also want to think -- at the same time -- of an event chronology. Moreover, to make good use of the event chronology, she may also want to think, again roughly at the same time, about the evidence that is arrayed against the events shown in the event chronology. The job of coordinating and integrating marshalling strategies forces an investigator to do more than merely walk and chew gum at the same time. Indeed, the mental operations required for such coordination are extraordinarily complex. Their complexity raises the question whether it is possible to use a network of marshalling strategies such as ours to any practical advantage.
Our answer to this question is by way of confession and avoidance. The confession is that it is true that the mental processes described by our network of marshalling strategies are extraordinarily complex and it is true that it may be impossible for any human being to keep all of these systems and all of their details and refinements in his head at the same time. The plea by way of avoidance is twofold. First, it is likely that human beings, unaided by our theory, are also required to keep different kinds of mental processes in their heads at the same time. The question, therefore, is not whether anyone can keep everything in one's head at the same time; the question is how one can better keep in one's head the various things that one would like to keep in his head. Second, one of the purposes of our computer system is precisely to improve the ability of people to keep many things in their heads. It is a fact that people's ability to recall all pertinent details and to think of everything pertinent is limited. We cannot promise and we do not promise that our scheme for marshalling evidence will enable people to recall everything and think of every argument and consideration simultaneously. To the extent that our work addresses the marshalling of evidence in real-world contexts, our aim is only to improve people's ability to remember and think about various things at the same time.
The problem of coordinating and integrating marshalling strategies is nothing more than the problem of juxtaposing ideas; the making of arguments about evidence is nothing more than a process of juxtaposing ideas in an orderly and meaningful way. There are several good reasons for believing that natural persons do have the capacity to coordinate and integrate contrived marshalling strategies. First, people already have an enormous capacity to juxtapose ideas. It is noteworthy that many of the marshalling strategies we describe are ones that at least some lawyers already use. Second, our theory is itself a system or procedure for juxtaposing ideas; that is, our theory is a tool or device that can be used, and is meant to be used, to juxtapose diverse ideas. Third, there is good reason to think that the orderly and meaningful juxtaposition of ideas greatly increases the capacity of human beings to remember details while keeping them in order. Hence, if our method of sorting evidence and organizing thought about evidence is orderly and meaningful, there is reason to think it can improve the ability of people to keep their thinking about details straight.
Consider the schematic representation in Figure 19 of how a
lawyer might visualize a particular case theory.
It seems to us that a case theory such as the one depicted in Figure 19 "works"; that is, we think that this way of structuring thought about a case may be an effective and intelligible way of keeping in mind a variety of matters and details at the same time. Moreover, it seems to us that when a case theory such as the one schematized in Figure 19 does work, it does so because a case theory is an orderly and meaningful way of arranging evidence; both the overall structure and the lattices within the structure make sense.
Intuition suggests that meaningful arrangements of information, as opposed to random arrangements, improve memory and retrieval. For example, people can apparently can better remember sequences of letters or numbers when those letters or numbers are meaningfully arranged than when they are randomly arranged. Moreover, empirical research by Pennington, Hastie, and Penrod strongly suggests that a "story model" allows people to retrieve details with great efficiency. A similar principle is at work here.
B. Parts and Wholes in Inference
One of the lessons we re-learned from our work on computer prototypes is that people need to be able both to recall details and to see the "whole picture"; effective marshalling of evidence requires both a local and a global juxtaposition of ideas. The importance of both of these perspectives, however, raises a basic logical problem. We can refer to this problem as the problem of the relationship between parts and wholes.
The problem of parts and wholes--the problem of the relationship between synthetic and granular perspectives on evidence--assumes various guises. One example of this problem also illustrates why a synthetic perspective on problems of investigation and proof is essential. As we noted earlier, the task of coordinating marshalling strategies has an affinity with the project of making effective use of a single marshalling strategy. When a marshalling strategy is actually applied, it can produce an intricate network of arguments. In graphic form a complex of arguments based on a marshalling system takes the form of a network of arcs and nodes. This network can resemble a spider web. A person who is attempting to assess the significance of a collection of evidence may sense that the importance of the details in a spider web of arguments he has constructed but he may have a hard time keeping all of those details them in mind when he is trying to assess the the overall impact of his fine-grained analyses.
We have discussed various strategies that may enhance the ability of people to remember and retrieve details. While those strategies seem sensible and effective, the premise that any one of them can work is not free of difficulty. A chicken-and-egg problem inheres in the use of any particular strategy that we recommend. We have said that uninhibited use of any marshalling strategy can produce excessive complexity and we have suggested that an investigator should refer to other marshalling strategies to prune away such excessive noise and complexity. The chicken-and-egg difficulty is that those other marshalling strategies are themselves intricate and an investigator's ability to use them as shearing devices depends on his ability to remember their details. But how is he supposed to do that without resorting to yet some other marshalling strategy, which then again presents him with the same problem?
We believe that a global perspective is necessary to to make this otherwise inexplicable process work. The workings of any network of marshalling systems are inexplicable without the supposition that people have the capacity to regulate the detailed workings of individual marshalling strategies by some sort of global, synthetic perspective. In an earlier work one of the authors of this paper wrote,
It is tempting to think that what happens (and should happen) [in fact finding] is that a trier of fact--any trier of fact--engages in a sequential process in which there is a repeated reciprocal interaction between a general vision of the evidence as a whole and a general vision of its parts, a process in which each vision is progressively revised and checked by the other but in which neither can be supposed, in principle, to be entirely independent of the other.
We still think that the general sentiment expressed here is correct. However, from a logical point of view, the ability of people to shift back and forth between local and global perspectives does not solve the chicken-and-egg problem. While local perspectives may have to rest on global ones, global perspectives must rest on granular details. We end where we began.
The logical intractability of question of the the temporal relationship between local and global perspectives leaves us alternative except the supposition that the logical problem is answered by psychology. On another occasion one of the authors said,
While, as a logical matter, it seems, at least to us, that the interaction of parts and wholes, and their interdependence, are inescapable, it is not true, physically considered, that this logical interdependence continues indefinitely.
The same kind of answer must be given to the question of the temporal relationship between wholes and parts during the beginnings of the process of inference and proof. Logically speaking, neither global analysis nor granular analysis can start first, but "physically considered"--psychologically speaking--one or the other must have some sort of priority at any given moment in time. By the same token, --despite the fact that it is hard to keep a granular and a global perspective in mind at the same time, and despite the fact that one or another must have some kind of priority at any particular time--, it must also be true that both perspectives are somehow at work at the same time, no matter how mysterious this proposition may seem. This proposition, however, is not really all that mysterious. We only need to posit that marshalling processes--even artificial ones such as ours--are partly psychological. When any marshalling process is explicitly at work, tacit marshalling processes are also work; those tacit processes remain in the background but they are working nevertheless.
C. Personal Meaning, Metaphorical Translation, and Theoretical Validity
We have often been asked whether our theory of evidence marshalling is a descriptive or a prescriptive theory. Our answer is that it is neither. Our theory is of a third kind: it is an heuristic theory. We reject the thesis that a theory about evidence and inference must be either descriptive or prescriptive. This has been and this remains our answer to questions about the character and purpose of our theory of evidence marshalling. However, we also recognize that this answer is incomplete. There must be a link between any heuristic theory and natural mental processes; without such a link, an heuristic theory cannot serve as a device that illuminates natural thought.
Our work on computer prototypes of evidence marshalling systems suggests the nature of the link between our theory and natural mental processes. We have said that our computer prototypes and our diagrams serve as metaphors. If we are right in thinking that our prototypes and diagrams are effective metaphors, our diagrammatic devices appeal to the natural imagination. By doing so they translate our theoretical constructs into natural and familiar ways of thinking. Hence, our computer prototypes and diagrams are far more than gimmicks or mere rhetorical devices. The link between heuristic theory and natural thought is by way of metaphor.
Heuristic theory occupies precarious ground. Although it cannot simply describe existing thinking, it must be able to shape natural thinking. The link between heuristic theory and natural thinking is by way of metaphor. Metaphors serve to translate our theory into natural language and thought. If we are unable to find metaphors that translate our theory into received ways of thinking and imagining, our theory must suffer the fate of being either a descriptive theory or a prescriptive theory. This fate would not be a happy one since neither one of these theories serves to help people in their investigation of real-world factual problems.
If it is true that metaphor is the link between heuristic theory and natural imagination and thought, we have obviated certain objections to our theory but new questions about the validity of our theory emerge. For example, suppose our metaphors are not popular. Must we admit the invalidity of our theory if the intended consumers of our theory do not find our theory user-friendly? Are we required to take the inability or unwillingness of our audience to make any sense or use of our theory as evidence that our theory is defective?
Although we have not yet attempted to formulate comprehensive responses to these questions, we see a good possibility that the answer might be "no." This possibility occurred to the authors as they reflected on the way that they initially tackled the project of investigating investigation. One of the authors is something of an expert on probability theory. This author is also adept at figuring the probabilities of various outcomes in card games. By contrast, the other author is singularly inept both in card games and at calculating probabilities. It is probably not a matter of chance that the author who is familiar with card games was drawn to computer prototypes that are based on the metaphor of a stack of cards. This author saw a card game metaphor as the appropriate metaphor for describing both the underlying structure of all evidence marshalling systems and the nature of the relationships between evidence marshalling systems. It is probably also not fortuitous that this same author has devoted a great deal of attention to combinations of "possibilities," shuffling them in various ways, like a pack of cards. The other author, by contrast, entertained no hypotheses or images that even remotely resembled the structure of a card game when he first tackled the topic of investigation. He thought about matters such as stories and the fuzziness of legal language, but in no event about card games.
This difference in the way that the authors initially
tackled the problem of investigation shows that different metaphors
have different appeal for different people. Does this suggest that
the epistemological validity of different techniques of marshalling
evidence varies with the person? Although we do not yet have an exact
or full answer to this question either, the mere asking of the
question does not answer it. Furthermore, although the authors of
this paper tend to approach problems in strikingly different ways,
they have been able to understand each other and each other's
metaphors, analogies, and similes. This demonstrates that that
metaphors that are initially unfamiliar and unappealing may, in time,
become appealing and powerful. Hence, it is possible that our
metaphors and images will prove to have general appeal. If they do,
this may be some evidence that our heuristic theory of evidence
marshalling has interpersonal force and theoretical validity.