Self Regularity

Author: Jiming Peng
Publisher: Princeton University Press
ISBN: 140082513X
Release Date: 2009-01-10
Genre: Mathematics

Research on interior-point methods (IPMs) has dominated the field of mathematical programming for the last two decades. Two contrasting approaches in the analysis and implementation of IPMs are the so-called small-update and large-update methods, although, until now, there has been a notorious gap between the theory and practical performance of these two strategies. This book comes close to bridging that gap, presenting a new framework for the theory of primal-dual IPMs based on the notion of the self-regularity of a function. The authors deal with linear optimization, nonlinear complementarity problems, semidefinite optimization, and second-order conic optimization problems. The framework also covers large classes of linear complementarity problems and convex optimization. The algorithm considered can be interpreted as a path-following method or a potential reduction method. Starting from a primal-dual strictly feasible point, the algorithm chooses a search direction defined by some Newton-type system derived from the self-regular proximity. The iterate is then updated, with the iterates staying in a certain neighborhood of the central path until an approximate solution to the problem is found. By extensively exploring some intriguing properties of self-regular functions, the authors establish that the complexity of large-update IPMs can come arbitrarily close to the best known iteration bounds of IPMs. Researchers and postgraduate students in all areas of linear and nonlinear optimization will find this book an important and invaluable aid to their work.

Distributed Control of Robotic Networks

Author: Francesco Bullo
Publisher: Princeton University Press
ISBN: 1400831474
Release Date: 2009-07-06
Genre: Technology & Engineering

This self-contained introduction to the distributed control of robotic networks offers a distinctive blend of computer science and control theory. The book presents a broad set of tools for understanding coordination algorithms, determining their correctness, and assessing their complexity; and it analyzes various cooperative strategies for tasks such as consensus, rendezvous, connectivity maintenance, deployment, and boundary estimation. The unifying theme is a formal model for robotic networks that explicitly incorporates their communication, sensing, control, and processing capabilities--a model that in turn leads to a common formal language to describe and analyze coordination algorithms. Written for first- and second-year graduate students in control and robotics, the book will also be useful to researchers in control theory, robotics, distributed algorithms, and automata theory. The book provides explanations of the basic concepts and main results, as well as numerous examples and exercises. Self-contained exposition of graph-theoretic concepts, distributed algorithms, and complexity measures for processor networks with fixed interconnection topology and for robotic networks with position-dependent interconnection topology Detailed treatment of averaging and consensus algorithms interpreted as linear iterations on synchronous networks Introduction of geometric notions such as partitions, proximity graphs, and multicenter functions Detailed treatment of motion coordination algorithms for deployment, rendezvous, connectivity maintenance, and boundary estimation

Entropy

Author: Andreas Greven
Publisher: Princeton University Press
ISBN: 0691113386
Release Date: 2003
Genre: Mathematics

The concept of entropy arose in the physical sciences during the nineteenth century, particularly in thermodynamics and statistical physics, as a measure of the equilibria and evolution of thermodynamic systems. Two main views developed: the macroscopic view formulated originally by Carnot, Clausius, Gibbs, Planck, and Caratheodory and the microscopic approach associated with Boltzmann and Maxwell. Since then both approaches have made possible deep insights into the nature and behavior of thermodynamic and other microscopically unpredictable processes. However, the mathematical tools used have later developed independently of their original physical background and have led to a plethora of methods and differing conventions. The aim of this book is to identify the unifying threads by providing surveys of the uses and concepts of entropy in diverse areas of mathematics and the physical sciences. Two major threads, emphasized throughout the book, are variational principles and Ljapunov functionals. The book starts by providing basic concepts and terminology, illustrated by examples from both the macroscopic and microscopic lines of thought. In-depth surveys covering the macroscopic, microscopic and probabilistic approaches follow. Part I gives a basic introduction from the views of thermodynamics and probability theory. Part II collects surveys that look at the macroscopic approach of continuum mechanics and physics. Part III deals with the microscopic approach exposing the role of entropy as a concept in probability theory, namely in the analysis of the large time behavior of stochastic processes and in the study of qualitative properties of models in statistical physics. Finally in Part IV applications in dynamical systems, ergodic and information theory are presented. The chapters were written to provide as cohesive an account as possible, making the book accessible to a wide range of graduate students and researchers. Any scientist dealing with systems that exhibit entropy will find the book an invaluable aid to their understanding.

Robust Optimization

Author: Aharon Ben-Tal
Publisher: Princeton University Press
ISBN: 1400831059
Release Date: 2009-08-10
Genre: Mathematics

Robust optimization is still a relatively new approach to optimization problems affected by uncertainty, but it has already proved so useful in real applications that it is difficult to tackle such problems today without considering this powerful methodology. Written by the principal developers of robust optimization, and describing the main achievements of a decade of research, this is the first book to provide a comprehensive and up-to-date account of the subject. Robust optimization is designed to meet some major challenges associated with uncertainty-affected optimization problems: to operate under lack of full information on the nature of uncertainty; to model the problem in a form that can be solved efficiently; and to provide guarantees about the performance of the solution. The book starts with a relatively simple treatment of uncertain linear programming, proceeding with a deep analysis of the interconnections between the construction of appropriate uncertainty sets and the classical chance constraints (probabilistic) approach. It then develops the robust optimization theory for uncertain conic quadratic and semidefinite optimization problems and dynamic (multistage) problems. The theory is supported by numerous examples and computational illustrations. An essential book for anyone working on optimization and decision making under uncertainty, Robust Optimization also makes an ideal graduate textbook on the subject.

Matrix Completions Moments and Sums of Hermitian Squares

Author: Mihály Bakonyi
Publisher: Princeton University Press
ISBN: 1400840597
Release Date: 2011-07-18
Genre: Mathematics

Intensive research in matrix completions, moments, and sums of Hermitian squares has yielded a multitude of results in recent decades. This book provides a comprehensive account of this quickly developing area of mathematics and applications and gives complete proofs of many recently solved problems. With MATLAB codes and more than 200 exercises, the book is ideal for a special topics course for graduate or advanced undergraduate students in mathematics or engineering, and will also be a valuable resource for researchers. Often driven by questions from signal processing, control theory, and quantum information, the subject of this book has inspired mathematicians from many subdisciplines, including linear algebra, operator theory, measure theory, and complex function theory. In turn, the applications are being pursued by researchers in areas such as electrical engineering, computer science, and physics. The book is self-contained, has many examples, and for the most part requires only a basic background in undergraduate mathematics, primarily linear algebra and some complex analysis. The book also includes an extensive discussion of the literature, with close to 600 references from books and journals from a wide variety of disciplines.

Modern Anti windup Synthesis

Author: Luca Zaccarian
Publisher: Princeton University Press
ISBN: 1400839025
Release Date: 2011-07-11
Genre: Mathematics

This book provides a wide variety of state-space--based numerical algorithms for the synthesis of feedback algorithms for linear systems with input saturation. Specifically, it addresses and solves the anti-windup problem, presenting the objectives and terminology of the problem, the mathematical tools behind anti-windup algorithms, and more than twenty algorithms for anti-windup synthesis, illustrated with examples. Luca Zaccarian and Andrew Teel's modern method--combining a state-space approach with algorithms generated by solving linear matrix inequalities--treats MIMO and SISO systems with equal ease. The book, aimed at control engineers as well as graduate students, ranges from very simple anti-windup construction to sophisticated anti-windup algorithms for nonlinear systems. Describes the fundamental objectives and principles behind anti-windup synthesis for control systems with actuator saturation Takes a modern, state-space approach to synthesis that applies to both SISO and MIMO systems Presents algorithms as linear matrix inequalities that can be readily solved with widely available software Explains mathematical concepts that motivate synthesis algorithms Uses nonlinear performance curves to quantify performance relative to disturbances of varying magnitudes Includes anti-windup algorithms for a class of Euler-Lagrange nonlinear systems Traces the history of anti-windup research through an extensive annotated bibliography

Topics in Quaternion Linear Algebra

Author: Leiba Rodman
Publisher: Princeton University Press
ISBN: 9781400852741
Release Date: 2014-08-24
Genre: Mathematics

Quaternions are a number system that has become increasingly useful for representing the rotations of objects in three-dimensional space and has important applications in theoretical and applied mathematics, physics, computer science, and engineering. This is the first book to provide a systematic, accessible, and self-contained exposition of quaternion linear algebra. It features previously unpublished research results with complete proofs and many open problems at various levels, as well as more than 200 exercises to facilitate use by students and instructors. Applications presented in the book include numerical ranges, invariant semidefinite subspaces, differential equations with symmetries, and matrix equations. Designed for researchers and students across a variety of disciplines, the book can be read by anyone with a background in linear algebra, rudimentary complex analysis, and some multivariable calculus. Instructors will find it useful as a complementary text for undergraduate linear algebra courses or as a basis for a graduate course in linear algebra. The open problems can serve as research projects for undergraduates, topics for graduate students, or problems to be tackled by professional research mathematicians. The book is also an invaluable reference tool for researchers in fields where techniques based on quaternion analysis are used.

Optimization

Author: Jan Brinkhuis
Publisher: Princeton University Press
ISBN: 1400829364
Release Date: 2011-02-11
Genre: Mathematics

This self-contained textbook is an informal introduction to optimization through the use of numerous illustrations and applications. The focus is on analytically solving optimization problems with a finite number of continuous variables. In addition, the authors provide introductions to classical and modern numerical methods of optimization and to dynamic optimization. The book's overarching point is that most problems may be solved by the direct application of the theorems of Fermat, Lagrange, and Weierstrass. The authors show how the intuition for each of the theoretical results can be supported by simple geometric figures. They include numerous applications through the use of varied classical and practical problems. Even experts may find some of these applications truly surprising. A basic mathematical knowledge is sufficient to understand the topics covered in this book. More advanced readers, even experts, will be surprised to see how all main results can be grounded on the Fermat-Lagrange theorem. The book can be used for courses on continuous optimization, from introductory to advanced, for any field for which optimization is relevant.

Interior Point Algorithms

Author: Yinyu Ye
Publisher: John Wiley & Sons
ISBN: 9781118030950
Release Date: 2011-10-11
Genre: Mathematics

The first comprehensive review of the theory and practice of one of today's most powerful optimization techniques. The explosive growth of research into and development of interior point algorithms over the past two decades has significantly improved the complexity of linear programming and yielded some of today's most sophisticated computing techniques. This book offers a comprehensive and thorough treatment of the theory, analysis, and implementation of this powerful computational tool. Interior Point Algorithms provides detailed coverage of all basic and advanced aspects of the subject. Beginning with an overview of fundamental mathematical procedures, Professor Yinyu Ye moves swiftly on to in-depth explorations of numerous computational problems and the algorithms that have been developed to solve them. An indispensable text/reference for students and researchers in applied mathematics, computer science, operations research, management science, and engineering, Interior Point Algorithms: * Derives various complexity results for linear and convex programming * Emphasizes interior point geometry and potential theory * Covers state-of-the-art results for extension, implementation, and other cutting-edge computational techniques * Explores the hottest new research topics, including nonlinear programming and nonconvex optimization.

Introductory Operations Research

Author: Harvir Singh Kasana
Publisher: Springer Science & Business Media
ISBN: 9783662080115
Release Date: 2013-03-14
Genre: Business & Economics

Each concept is discussed from the basics and supported by sufficient mathematical background and worked examples. Suitable for individual or group learning, the book offers numerous end-of-chapter problems for study and review.

Fixed Point Algorithms for Inverse Problems in Science and Engineering

Author: Heinz H. Bauschke
Publisher: Springer Science & Business Media
ISBN: 1441995692
Release Date: 2011-05-27
Genre: Mathematics

"Fixed-Point Algorithms for Inverse Problems in Science and Engineering" presents some of the most recent work from top-notch researchers studying projection and other first-order fixed-point algorithms in several areas of mathematics and the applied sciences. The material presented provides a survey of the state-of-the-art theory and practice in fixed-point algorithms, identifying emerging problems driven by applications, and discussing new approaches for solving these problems. This book incorporates diverse perspectives from broad-ranging areas of research including, variational analysis, numerical linear algebra, biotechnology, materials science, computational solid-state physics, and chemistry. Topics presented include: Theory of Fixed-point algorithms: convex analysis, convex optimization, subdifferential calculus, nonsmooth analysis, proximal point methods, projection methods, resolvent and related fixed-point theoretic methods, and monotone operator theory. Numerical analysis of fixed-point algorithms: choice of step lengths, of weights, of blocks for block-iterative and parallel methods, and of relaxation parameters; regularization of ill-posed problems; numerical comparison of various methods. Areas of Applications: engineering (image and signal reconstruction and decompression problems), computer tomography and radiation treatment planning (convex feasibility problems), astronomy (adaptive optics), crystallography (molecular structure reconstruction), computational chemistry (molecular structure simulation) and other areas. Because of the variety of applications presented, this book can easily serve as a basis for new and innovated research and collaboration.

Convex Optimization

Author: Sébastien Bubeck
Publisher:
ISBN: 1601988605
Release Date: 2015-10-28
Genre: Convex domains

This monograph presents the main complexity theorems in convex optimization and their corresponding algorithms. It begins with the fundamental theory of black-box optimization and proceeds to guide the reader through recent advances in structural optimization and stochastic optimization. The presentation of black-box optimization, strongly influenced by the seminal book by Nesterov, includes the analysis of cutting plane methods, as well as (accelerated) gradient descent schemes. Special attention is also given to non-Euclidean settings (relevant algorithms include Frank-Wolfe, mirror descent, and dual averaging), and discussing their relevance in machine learning. The text provides a gentle introduction to structural optimization with FISTA (to optimize a sum of a smooth and a simple non-smooth term), saddle-point mirror prox (Nemirovski's alternative to Nesterov's smoothing), and a concise description of interior point methods. In stochastic optimization it discusses stochastic gradient descent, mini-batches, random coordinate descent, and sublinear algorithms. It also briefly touches upon convex relaxation of combinatorial problems and the use of randomness to round solutions, as well as random walks based methods.

Approximation Algorithms and Semidefinite Programming

Author: Bernd Gärtner
Publisher: Springer Science & Business Media
ISBN: 9783642220159
Release Date: 2012-01-10
Genre: Mathematics

Semidefinite programs constitute one of the largest classes of optimization problems that can be solved with reasonable efficiency - both in theory and practice. They play a key role in a variety of research areas, such as combinatorial optimization, approximation algorithms, computational complexity, graph theory, geometry, real algebraic geometry and quantum computing. This book is an introduction to selected aspects of semidefinite programming and its use in approximation algorithms. It covers the basics but also a significant amount of recent and more advanced material. There are many computational problems, such as MAXCUT, for which one cannot reasonably expect to obtain an exact solution efficiently, and in such case, one has to settle for approximate solutions. For MAXCUT and its relatives, exciting recent results suggest that semidefinite programming is probably the ultimate tool. Indeed, assuming the Unique Games Conjecture, a plausible but as yet unproven hypothesis, it was shown that for these problems, known algorithms based on semidefinite programming deliver the best possible approximation ratios among all polynomial-time algorithms. This book follows the “semidefinite side” of these developments, presenting some of the main ideas behind approximation algorithms based on semidefinite programming. It develops the basic theory of semidefinite programming, presents one of the known efficient algorithms in detail, and describes the principles of some others. It also includes applications, focusing on approximation algorithms.

Geometric Discrepancy

Author: Jiri Matousek
Publisher: Springer Science & Business Media
ISBN: 9783642039423
Release Date: 2009-12-02
Genre: Mathematics

What is the "most uniform" way of distributing n points in the unit square? How big is the "irregularity" necessarily present in any such distribution? This book is an accessible and lively introduction to the area of geometric discrepancy theory, with numerous exercises and illustrations. In separate, more specialized parts, it also provides a comprehensive guide to recent research.