This file is an addendum to the NOTES file in the ASA code, containing references to some difficult problems optimized using ASA or its precursor VFSR.
A search on the use in patents of its precursor VFSR can be found from patent searches on
"very fast simulated re-annealing"
http://www.google.com/patents?q=%22very+fast+simulated+re-annealing%22&btnG=Search+Patents
and "very fast simulated reannealing"
http://www.google.com/patents?q=%22very+fast+simulated+reannealing%22&btnG=Search+Patents
http://www.freepatentsonline.com/result.html?query_txt=%22very%20fast%20simulated%20reannealing%22
Some additional use in patents can be found from patent searches on
"lester ingber"
http://www.google.com/patents?q=%22lester+ingber%22&btnG=Search+Patents
http://www.freepatentsonline.com/result.html?query_txt=%22lester%20ingber%22
Ideas by Statistical Mechanics (ISM) is a generic program to model evolution and propagation of ideas/patterns throughout populations subjected to endogenous and exogenous interactions. The program is based on the author's work in Statistical Mechanics of Neocortical Interactions (SMNI), and uses the author's Adaptive Simulated Annealing (ASA) code for optimizations of training sets, as well as for importance-sampling to apply the author's copula financial risk-management codes, Trading in Risk Dimensions (TRD), for assessments of risk and uncertainty. This product can be used for decision support for projects ranging from diplomatic, information, military, and economic (DIME) factors of propagation/evolution of ideas, to commercial sales, trading indicators across sectors of financial markets, advertising and political campaigns, etc.
It seems appropriate to base an approach for propagation of ideas on the only system so far demonstrated to develop and nurture ideas, i.e., the neocortical brain. A statistical mechanical model of neocortical interactions, developed by the author and tested successfully in describing short-term memory and EEG indicators, is the proposed model. ISM develops subsets of macrocolumnar activity of multivariate stochastic descriptions of defined populations, with macrocolumns defined by their local parameters within specific regions and with parameterized endogenous inter-regional and exogenous external connectivities. Parameters with a given subset of macrocolumns will be fit using ASA to patterns representing ideas. Parameters of external and inter-regional interactions will be determined that promote or inhibit the spread of these ideas. Tools of financial risk management, developed by the author to process correlated multivariate systems with differing non-Gaussian distributions using modern copula analysis, importance-sampled using ASA, will enable bona fide correlations and uncertainties of success and failure to be calculated. Marginal distributions will be evolved to determine their expected duration and stability using algorithms developed by the author, i.e., PATHTREE and PATHINT codes.
There are several kinds of non-invasive imaging methods that are used to collect data from the brain, e.g., EEG, MEG, PET, SPECT, fMRI, etc. It is difficult to get resolution of information processing using any one of these methods. Approaches to integrate data sources may help to get better resolution of data and better correlations to behavioral phenomena ranging from attention to diagnoses of disease. The approach taken here is to use algorithms developed for the author's Trading in Risk Dimensions (TRD) code using modern methods of copula portfolio risk management, with joint probability distributions derived from the author's model of statistical mechanics of neocortical interactions (SMNI). The author's Adaptive Simulated Annealing (ASA) code is for optimizations of training sets, as well as for importance-sampling. Marginal distributions will be evolved to determine their expected duration and stability using algorithms developed by the author, i.e., PATHTREE and PATHINT codes.
Reinforcement learning is a hard problem and the majority of the existing algorithms suffer from poor convergence properties for difficult problems. In this paper we propose a new reinforcement learning method, that utilizes the power of global optimization methods such as simulated annealing. Specifically, we use a particularly powerful version of simulated annealing called Adaptive Simulated Annealing (ASA). Towards this end we consider a batch formulation for the reinforcement learning problem, unlike the online formulation almost always used. The advantage of the batch formulation is that it allows state-of-the-art optimization procedures to be employed, and thus can lead to further improvements in algorithmic convergence properties. The proposed algorithm is applied to a decision making test problem, and it is shown to obtain better results than the conventional Q-learning algorithm.
This study used ASA to select parameters for sequence similar region search in their autonomous AutoSimS model of general pairwise sequence similarity analysis. Their artificial intelligence approach involves more advanced features than commonly used BLAST and FASTA tools. Contact Jianping Zhou <jzhou@cs.uml.edu> for more information.
These papers use ASA in quantisation scheme optimisation in three dimensional image compression.
This paper provides a supplementary algorithm for adaptive quenching to make ASA more efficient for many systems. You can obtain a copy from the author Hime Junior <hime@engineer.com> at http://www.optimization-online.org/DB_FILE/2003/11/779.pdf.
ABSTRACT: We describe an end-to-end real-time S&P futures trading system. Inner-shell stochastic nonlinear dynamic models are developed, and Canonical Momenta Indicators (CMI) are derived from a fitted Lagrangian used by outer-shell trading models dependent on these indicators. Recursive and adaptive optimization using Adaptive Simulated Annealing (ASA) is used for fitting parameters shared across these shells of dynamic and trading models.
ABSTRACT: The Black-Scholes theory of option pricing has been considered for many years as an important but very approximate zeroth-order description of actual market behavior. We generalize the functional form of the diffusion of these systems and also consider multi-factor models including stochastic volatility. We use a previous development of a statistical mechanics of financial markets to model these issues. Daily Eurodollar futures prices and implied volatilities are fit to determine exponents of functional behavior of diffusions using methods of global optimization, Adaptive Simulated Annealing (ASA), to generate tight fits across moving time windows of Eurodollar contracts. These short-time fitted distributions are then developed into long-time distributions using a robust non-Monte Carlo path-integral algorithm, PATHINT, to generate prices and derivatives commonly used by option traders. The results of our study show that there is only a very small change in at-the money option prices for different probability distributions, both for the one-factor and two-factor models. There still are significant differences in risk parameters, partial derivatives, using more sophisticated models, especially for out-of-the-money options.
This paper continues the thesis of Shinichi Sakata, referenced below, studying estimation methods for conditional location and dispersion models, with an application to estimating the conditional volatility of the S&P 500 cash index. Contact Shinichi Sakata <ssakata@econ.lsa.umich.edu> for more information.
This paper emphasizes the generic use of ASA in a wide class of multivariate nonlinear stochastic systems, together with other codes and a stochastic calculus, to datamine large data sets and to extract knowledge from fitted patterns of information.
ABSTRACT: A modern calculus of multivariate nonlinear multiplicative Gaussian-Markovian systems provides models of many complex systems faithful to their nature, e.g., by not prematurely applying quasi-linear approximations for the sole purpose of easing analysis. To handle these complex algebraic constructs, sophisticated numerical tools have been developed, e.g., methods of adaptive simulated annealing (ASA) global optimization and of path integration (PATHINT). In-depth application to three quite different complex systems have yielded some insights into the benefits to be obtained by application of these algorithms and tools, in statistical mechanical descriptions of neocortex (short-term memory and electroencephalography), financial markets (interest-rate and trading models), and combat analysis (baselining simulations to exercise data).
This paper follows their 1994 paper below, using ASA to solve some very difficult imaging problems that did not yield to other global optimization techniques. Contact Kenong Wu <wu@cim.mcgill.ca> for further information.
This paper uses ASA to fit combat simulation data, illustrating how to develop measures of effectiveness of systems as they synergistically contribute to nonlinear combat contexts. Canonical Momenta Indicators (CMI) offer graphical decision aids faithful to the underlying multivariate nonlinear stochastic model.
Available methods for the optimization of agricultural systems vary widely, in terms of derivation, applicability and performance. A whole-farm dairying model with 16 separate, interacting managerial options was subjected to optimisation by the hill-climbing (quasi-Newton), direct search (simplex), genetic algorithm (GENESIS) and simulated annealing (VFSR) techniques. The latter two clearly out-performed the former, with simulated annealing always identifying the global optimum.
Optimization procedures are required for the fitting of nonlinear regression models to data. Whilst generally smooth in nature, the objective function can contain multiple local optima or sub-optimal plateaus, creating difficulties for the optimization routine. Hill-climbing techniques are used in the majority of statistical packages. We investigate their performance on difficult parameterizations of a climbing techniques are used in the majority of statistical packages. We investigate their performance on difficult parameterizations of a conception rates model, for two data sets. We also evaluate a simulated annealing algorithm, and demonstrate its superior performance on this type of problem.
Available optimization techniques vary widely in terms of derivation, application, and efficiency. A complex dairy farm model was used to benchmark those which have been used previously in the model optimisation field. The more traditional methods, including random search, hill-climbing and direct search, were notably inferior in identifying the economic optimum of this agricultural system. Genetic algorithms proved quite efficient, but overall results were marginally down on those from the simulated annealing methods. Initially, these proved to be quite slow, but a retuned simulated annealing algorithm was found to be more efficient, thorough and safe. It's extension to simulated quenching proved best for this problem, safely identifying the optimum at a good rate of convergence. As this program is freely available and relatively easy to use, it is strongly recommended. Also, initial investigations with the tabu search strategy are reported, which show it to have potential.
Contact David G. Mayer <davidm@ysun73.ari.dpi.qld.gov.au> for further information.
This paper develops a parametrized model of ion-coupled transporters fit to GABA transporter GAT1, which is then extrapolated to describe other experimental data. Contact Henry Lester <lester@caltech.edu> for more information.
While I disagree with the authors that SALO is a true annealing algorithm, even as a new quenching algorithm it represents a useful contribution to an analyst's toolbox. Contact Rutvick Desai <rudesai@indiana.edu> for more information.
A brief introduction to canonical momenta is included in ingber_projects.html.
This is a special issue on Simulated Annealing Applied to Combinatorial Optimization, prepared by the Polish Academy of Sciences Systems Research Institute. The listing of other contributors to this special issue is in asa96_vidal_nahorski.txt
This paper gives relatively non-technical descriptions of ASA and canonical momenta, and their applications to markets and EEG. The paper was solicited by AI in Finance prior to cessation of publication.
This thesis used ASA to minimize the one-step-ahead forecasting error of a neural network, incorporating differential equations as a priori knowledge. Contact Rico Cozzio <cozzio@ln.active.ch> for more information.
This paper studied estimation methods for conditional location and dispersion models, with an application to estimating the conditional volatility of the S&P 500 cash index. Contact Shinichi Sakata <ssakata@econ.lsa.umich.edu> for more information.
One of the major goals of geophysical inversion is to find earth models that explain the geophysical observations. Both local and global optimization methods are used in the estimation of material properties from geophysical data. Contact Mrinal Sen <mrinal@utig2.ig.utexas.edu> for more information.
This paper addresses the optimization of magnetic-field gradient (MFG) coils, one of the fundamental problems in designing magnetic resonance imaging systems. Contact Marian Buszko <marian@micro.ifas.ufl.edu> for more information.
This paper presents an investigation of fitting dynamical systems models to observed data, by comparing the resultant symbolic dynamics transition probabilities of iterated model and observed data. Contact Xianzhu Tang <tang@perceval.apne.columbia.edu> for further information.
These two papers used ASA to fit nonlinear forms to data as part of a project examining the effects of additive noise and drift on chaotic synchronization. Contact Nicholes Tufillaro <nbt@reed.edu> for further information.
This thesis used ASA to optimize both synaptic-delay parameters and weights of neural networks. The addition of (realistic) nonlinear complexity of delayed recurrent activity permits using fewer parameters in several tasks. Contact Barak Cohen <goman@netvision.net.il> for further information.
This paper used ASA to solve some very difficult imaging problems that did not yield to other global optimization techniques. Contact Kenong Wu <wu@cim.mcgill.ca> for further information.
This paper illustrates the use of the QUENCHing and REANNEALing OPTIONS in ASA, and contains an expanded section describing the use of simulated annealing across many disciplines.
This paper used ASA to solve some very difficult imaging problems that did not yield to other global optimization techniques. Contact Gerard Blais <gblais@bnr.ca> for further information.
This article in The Wall Street Journal described the wide-spread use of ASA.
This paper is an application of ASA to neural networks. You can contact Giacomo Indiveri <giacomo@dibe.unige.it> for further information.
This is the most recent of a series of papers using VFSR on a 1988 project baselining the JANUS(T) combat simulation to exercise data from the National Training Center (NTC).
This paper compared standard Boltzmann annealing with "fast" Cauchy annealing with VFSR, and concluded that VFSR was superior in both efficiency and accuracy.
This Rapid Communications presented an algorithm generalizing ASA by a confluence of features from ASA, modern calculus of multivariate nonlinear stochastic systems, statistical mechanics of neocortical interactions (SMNI), and parallel processing.
This paper showed VFSR to be superior to a standard genetic algorithm (GA) simulation on a suite of standard GA test problems.
These two papers used VFSR to fit a current economic model of coupled short-term and long-term interest rates to bond data.
This paper fit EEG data from a clinical study to a model of large-scale neuronal activity in the human brain.
This was the first VFSR paper.
Lester Ingber <ingber@ingber.com> Copyright © 1994-2008 Lester Ingber. All Rights Reserved.
$Id: asa_papers.html,v 10.109 2008/05/10 17:42:43 ingber Exp ingber $