Complexity Economics Engineering Medicine Society

Modeling Risk and Model-Induced Risk

Models are simplified representations or emulators of reality. They are typically based on empirical data collected conducting experiments. There exist numerous techniques for establishing models based on data. An example of a linear model, built based on 2-dimensional data is illustrated below.

The model in this simple case is a straight line.  It may be used, for example, to compute the value of one variable when the other is given. This is particularly useful for values which fall in between the original data used to build the model.

A more interesting case is illustrated below. Here too the data lie on a straight line. However, there is a void between the two groups of data points. This poses a problem. In cases such as this one a single model is built, passing through both groups of points. In other words, a most dangerous assumption is made: that of continuity. This is a very common mistake. The mere fact that all the points in question lie on a straight line does not guarantee that in the void between the two groups the line still constitutes a valid model.

The mistake proves often fatal, and more so when the domain one wishes the model to embrace is more articulated. In the above case, there should be two local models, not one.

Models should be used with caution and ONLY in the domains where they have been validated. Extending the usage of a model beyond such a domain has consequences which grow with the model’s complexity. Moreover, when a model’s applicability is stretched, very seldom the effects are actually measured. The equations might still work but that does not guarantee that the model isn’t violating some basic laws or rules.

The bottom line:

  1. Models should be used only in the domain where they have been validated.
  2. More complex models require more assumptions and therefore induce more uncertainty into the original problem than simpler models.
  3. The more complex a domain (in topological sense) that a model has to embrace, the easier it is to violate some basic laws with it. And it is more difficult to spot them.
  4. The most frequent and deadly malpractice when models are involved is the assumption of continuity. Nature is not “smooth and differentiable”.
  5. The risk deriving from the fact that a surrogate of reality is used is rarely measured. So, if one is using a model to “model risk”, the fact that a particular model is used adds another layer of risk: model-induced risk. Handle with care!

One more rule: the most important things in a model are those it doesn’t contain.

Established originally in 2005 in the USA, Ontonix is a technology company headquartered in Como, Italy. The unusual technology and solutions developed by Ontonix focus on countering what most threatens safety, advanced products, critical infrastructures, or IT network security - the rapid growth of complexity. In 2007 the company received recognition by being selected as Gartner's Cool Vendor. What makes Ontonix different from all those companies and research centers who claim to manage complexity is that we have a complexity metric. This means that we MEASURE complexity. We detect anomalies in complex defense systems without using Machine Learning for one very good reason: our clients don’t have the luxury of multiple examples of failures necessary to teach software to recognize them. We identify anomalies without having seen them before. Sometimes, you must get it right the first and only time!

0 comments on “Modeling Risk and Model-Induced Risk

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: