What the Courts are Saying
About the Use of Monte Carlo Simulation
QuickRead’s Technical Editor, Roberto Castro, explains that Monte Carlo is another tool valuation and litigation support professionals should embrace since courts have signaled its approval.
[su_pullquote align=”right”]Resources:
Advanced Concepts in Risk Analysis
Valuing Complex Financial Instruments—Monte Carlo Simulation and Lattice Models
Value Uncertainty and Risk Measurement in Business Valuation
[/su_pullquote]
Over the past year, a number of our colleagues have released updated valuation and damages guidebooks.  These releases signal that a number of unsettled issues remain. Despite these newer versions, none of these guidebooks discuss the use of statistics, modeling of time series, ARIMA[1], or Monte Carlo simulation. Is that telling us the latter is not commonly accepted in the courts; that the use of Monte Carlo simulation is risky? To the contrary, Monte Carlo simulation is gaining acceptance.  The challenge for practitioners is to further develop their skill in using Monte Carlo simulation, the ability to explain what it is, and invest in software that enables the practitioner to model business damages, IP, and business values.
One of the first published cases to discuss the use of Monte Carlo simulation is Lyondell Chemical Co. v. Occident Chemical Corp, 668 F.3d 284 (5th Circ. 2010). This is not a valuation or damages case, but it is significant considering who wrote the opinion and the circuit it came from. The author of the decision is the Hon. Patrick E. Higginbotham, Circuit Judge. The case involved a disposal company named French Limited that in the 1960s and 1970s hauled waste from petrochemical facilities on the Houston Ship Channel.  The hauling company found a location known as Turtle Bayou to dump the waste. In the early 1980s, the EPA and State of Texas began an investigation into contamination at Turtle Bayou.  The investigation centered on waste generated by several French Limited customers, including Lyondell Chemical Company, El Paso Tennessee Pipeline Company, and Occident Chemical Company.
Most of the parties under investigation agreed to remediate the contamination found at Turtle Bayou. Â These companies began to meet regularly to fairly divide responsibility for the waste and associated clean-up costs, but the group dissolved before finalizing a plan.
The United States responded by suing Lyondell in 1994. Lyondell entered into a consent decree with the United States in 1998 requiring it to “address the contamination and perform all requested response actions at four areas of the site.” During the course of its remediation efforts, Lyondell discovered additional contamination at Turtle Bayou west of Lyondell’s West Road Area.  The United States sued El Paso, this time in 2002.
The district court appointed an expert in environmental engineering to assist in allocating cleanup costs among the parties.  This expert was Dr. Charles Newell. Dr. Newell was tasked with running a statistical analysis to determine disposable volumes for each liable company. The disposable volumes, together with chemical analyses of those volumes, would then enable the court to allocate remediation costs. Although Dr. Newell ran actual calculations, the court determined the inputs he would use. To calculate the amount of Occidental’s waste dumped at Turtle Bayou, for example, the court instructed Dr. Newell to use three input values: a minimum, an intermediate estimate, and a maximum.  These inputs were at the center of the dispute in this case.
Occidental challenged Dr. Newell’s expert testimony; specifically his use of the Monte Carlo statistical methodology to calculate the volume of Occidental’s waste dumped at Turtle Bayou. Occidental contended that the methodology failed Daubert. Judge Higginbotham, along with Judges Prado and Garza heard the appeal. With respect to the use of Monte Carlo, the court opined that:
Monte Carlo measures the probability of various outcomes within the bounds of input variables; to calculate Occidental’s waste volume, for example, Dr. Newell used the district court’s three volume estimates as inputs. Instead of simply averaging the input values, Monte Carlo analysis uses randomly generated data points to increase accuracy, and then looks to the results those data points generate.  This methodology is particularly useful when reaching an exact numerical result is impossible or infeasible and the data provide a known range (a minimum and a maximum, for example) but leaves the exact answer uncertain. Seventy years after its discovery by physicists involved in nuclear weapons research, Monte Carlo analysis is now at home not only in the physical sciences, but in a wide variety of fields including for instance, the world of high finance.
In short, the court dismissed Occidental’s Daubert challenges, calling one of the criticisms “similarly meritless.” The court added:
[a]s for the testability and potential rate of error prongs of Daubert, the cited cases at most stand for the proposition that Monte Carlo analysis is unreliable when injected with faulty inputs, but nothing more. Â Monte Carlo simulation is not inherently untestable: courts routinely admit statistical evidence, and we can gauge reliability by examining the input values and requiring transparency from testifying experts. Â Similarly, just because a Monte Carlo simulation produces a range of outcomes, rather than one single numerical value, does not mean it is speculative. Â If anything, Monte Carlo analysis provides greater certainty than the basic alternatives: using one of the three data points or using the arithmetic average of all three.
Years earlier, in July 2002, NorthPoint Communications, Inc. v. Verizon Communications settled a lawsuit in the County of San Francisco.  In this case, NorthPoint Communication sued Verizon in December 2000 for damages stemming from an aborted M&A transaction. Multiple actions ensued, including a bankruptcy, where the trustee of the bankruptcy estate alleged a ninety-day preference had occurred. In that case, Monte Carlo simulation was used to advance the position that NorthPoint was solvent prior to the bankruptcy filing; its assets (IP) exceeded its liabilities by $115 million.  Here, the valuation experts used Monte Carlo and Decision Tree Analysis to arrive at the value of the lawsuit against Verizon Communications.
In re Tronox, Case No. 09-10156 (ALG) (U.S. Bankruptcy Court SDNY 2013) is another case where Monte Carlo was used to estimate damages; these included contingent assets or liabilities.  As for the merits of Monte Carlo vis-à -vis DCF or the Binomial Model, some have expressed the view, “[g]iven the limitations of the DCF and BOPM[2] methodologies, the Monte Carlo Method often is considered to provide the maximum level of flexibility required to address the significant degree of uncertainty inherent in many contingent assets and liabilities.  As a result, a Monte Carlo analysis is often applied in lieu of, or as a supplement to, the more traditional income-based approaches, including the DCF Method…The Monte Carlo simulation ultimately returns an expected value based on the outcomes for the numerous scenarios and, in this regard, it provides a more comprehensive and robust analysis.  Thus, the valuation professional should have experience with statistical modeling in general and Mote Carlo analyses in particular.”[3]
In Vernon v. Cuomo[4], Case No. 06CVS8416, State of North Carolina, Wake County, the Court appointed a valuation expert to determine the fair value of Plaintiffs’ Tribo Film Research, Inc. shares. (This case pitted a well-known IP valuation professional [court-appointed] and a statistics professor at North Carolina State University.
With regard to the approach taken, the court observed that:
P&A used statistical stochastic modeling[5] “to account for unforeseen events and circumstance that influence value.” When building its valuation models, P&A considered a number of factors: market acceptance, any previous license agreements with similar technologies, working capital, operating budgets, capital equipment requirements, revenue recognition policies, income tax rate, regulatory environment, product warranty returns and allowances, currency and country risks, discount rates, workforce considerations, and relative size, growth, and trends in target markets…
The Valuation Report embraced a number of methodologies. To establish fair value, P&A used the Income Approach.  Specifically, it employed the discounted future economic income method. This approach enjoys “wide use and acceptance” in IP valuations.  To capture “complex model interactions in face of uncertain estimating assumptions,” P&A prepared value calculations using Latin Hypercube simulation algorithms, these algorithms allowed P&A to generate meaningful estimates despite the complexity and uncertainty of TriboFilms’ situation.  P&A also used a Fischer-Pry model to project a market adoption rate for TriboFilm technologies and Monte Carlo simulation methods to consider the uncertainty in TriboFilms’ underlying earnings potential.
The Court has considered the parties’ criticisms and finds no fault with P&A’s methodologies.  Its approach was appropriate for this type of business and clearly in the mainstream of IP valuation methodologies.
While the body of case law is limited, this is not due to lack of acceptance; rather, it probably reflects the limited adoption rate among valuation and litigation support professionals. Uncertainty is more often than not the norm, and Monte Carlo is another tool practioners should embrace since courts have signaled its approval.
This article was previously published in the Business Appraisal Practice, 2016 Second Quarter.
[1] In statistics and econometrics, and in particular, in time series analysis, an autoregressive integrated moving average (ARIMA) model is a generalization of an autoregressive moving average (ARMA) model.
[2] Binomial Option Pricing Model.
[3] http://www.srr.com/assets/pdf/lessons-tronox-bankruptcy.pdf, See also Ratner, I, Edwards, J., Wallison, J.J., & Weitnauer, J.C., (May 2014), “Valuing Contingent or Disputed Assets and Liabilities in Solvency Opinions,” The Review of Banking & Financial Services, Vol. 30, No. 5. The authors note that In re Tronox, the plaintiff’s expert used Monte Carlo analysis to determine that approximately 68,000 future claims would be filed and that the total costs of these future claims would be approximately $308 million.
[4] http://www.ncbusinesslitigationreport.com/uploads/file/2009NCBC006.pdf
[5] i.e., Monte Carlo simulation.
Roberto H Castro, JD, MST, MBA, CVA, CPVA, CMEA, BCMHV is an appraiser of businesses, machinery and equipment, and Managing Member of Central Washington Appraisal, Economics & Forensics, LLC. Mr. Castro is an attorney with a focus on business growth and succession planning with offices in Wenatchee and Chelan, WA. In addition, he is Technical Editor of QuickRead.
Mr. Castro can be reached at (509) 679-3668 or by e-mail to either rcastro@cwa-appraisal.com or rcastro@rcastrolaw.com.