IEEE.org | IEEE Xplore Digital Library | IEEE Standards | IEEE Spectrum | More Sites
Call for Award Nominations
More Info
Pursuit phenomena in nature have a vital role in survival of species. In addition to prey-capture and mating behavior, pursuit phenomena appear to underlie territorial battles in certain species of insects. In this talk we discuss the geometric patterns in certain pursuit and prey capture phenomena in nature, and suggest sensorimotor feedback laws that explain such patterns. Our interest in this problem first arose from the study of a motion camouflage (stealth) hypothesis due to Srinivasan and his collaborators, and an investigation of insect capture behavior in the FM bat Eptesicus fuscus, initiated by Cynthia Moss. Models of interacting particles, developed in collaboration with Eric Justh, prove effective in formulating and deriving biologically plausible steering laws that lead to observed patterns.
The echolocating bat E. fuscus perceives the world around it in the dark, primarily through the information it gathers rapidly and dependably by probing the environment through controlled streams of pulses of frequency modulated ultrasound. The returning echoes from scatterers such as obstacles (cave walls, trees), predators (barn owls) and prey (insects), are captured and transduced into neuronal spike trains by the highly sensitive auditory system of the bat, and processed in the sensorimotor pathways of the brain to steer the bat’s flight in purposeful behavior. In joint work with Kaushik Ghose, Timothy Horiuchi, Eric Justh, Cynthia Moss, and Viswanadha Reddy, we have begun to understand the control systems guiding the flight. The effectiveness of the bat in coping with, attenuation and noise, uncertainty of the environment, and sensorimotor delay, makes it a most interesting model system for engineers concerned with goal-directed and resource-constrained information processing in robotics. The bat’s neural realizations of auditory-motor feedback loops may serve as models for implementations of algorithms in robot designs. While the primary focus of this talk is on pursuit, the results suggest ways to synthesize interaction laws that yield cohesion in collections of particles, treating pursuit as a building block in mechanisms for flocking in nature and in engineered systems.
Over the past decade, game theorists have made substantial progress in identifying simple learning heuristics that lead to equilibrium behavior without making unrealistic demands on agents information or computational abilities, as is the case in the perfect rationality approach to game theory. Recent research shows that very complex, interactive systems can equilibrate even when agents have virtually no knowledge of the environment in which they are embedded. This talk will survey different approaches to the problem of learning in games, show the various senses in which learning rules converge to equilibrium, and sketch the theoretical limits to what is achievable.
The analysis of signals into constituent harmonics and the estimation of their power distribution are considered fundamental to systems engineering. Due to its significance in modeling and identification, spectral analysis is in fact a "hidden technology" in a wide range of application areas, and a variety of sensor technologies, ranging from radar to medical imaging, rely critically upon efficient ways to estimate the power distribution from recorded signals. Robustness and accuracy are of at most importance, yet there is no universal agreement on how these are to be quantified. Thus, in this talk, we will motivate the need for ways to compare power spectral distributions.
Metrics, in any field of scientific endeavor, must relate to physically meaningful properties of the objects under consideration. In this spirit, we will discuss certain natural notions of distance between power spectral densities. These will be motivated by problems in prediction theory and related properties of time-series. Analogies will be drawn with an old subject of a similar vein, that of quantifying distances between probability distributions, which has given rise to information geometry. The contrast and similarities between metrics will be highlighted by analyzing mechanical vibrations, speech, and visual tracking.
Fifty years ago, when control was emerging as a scientific discipline fueled by developments in dynamic, recursive decision making, dynamical systems and stability theory, a separate discipline, differential games, was being born in response to the need to develop a framework and associated solution tools for strategic dynamic decision making in adversarial environments, as an outgrowth of game theory. The evolution of the two disciplines-control theory, and particularly optimal control, and the theory of differential games-initially followed somewhat different paths, but soon a healthy interaction between the two developed. Differential games, in both zero-sum and nonzero-sum settings, enabled the embedding of control into a broader picture and framework, and enriched the set of conceptual tools available to it. One of its essential ingredients-information structures (who knows what and when)-became a mainstay in control research, particularly in the context of large-scale systems. In the other direction, the rich set of mathematical tools developed for control, such as viscosity solutions, directly impacted progress in solvability of differential games. Such interactions between the two disciplines reached a climax when robustness became a prevalent issue in control, leading among others to a comprehensive treatment of H¥ control of both linear and nonlinear uncertain systems.
This Bode Lecture will dwell on the parallel developments in the two fields to the extent they influenced each other over the past half century, talk about the present, and embark on a journey into the future.
The input to state stability (ISS) paradigm is motivated as a generalization of classical linear systems concepts under coordinate changes. A summary is provided of the main theoretical results concerning ISS and related notions of input/output stability and detectability. A bibliography is also included, listing extensions, applications, and other current work.
More information provided here.
Modern controller design packages often fall short of offering what is truly practical: low order controllers, discrete-time controllers operating in a sampled-data loop, and finite word length realizations of controllers with the FWL property minimally impacting closed-loop performance. The lecture describes how to achieve these objectives.
An understanding of fundamental limitations is an essential element in all engineering. Shannon’s early results on channel capacity have always had center court in signal processing. Strangely, the early results of Bode were not accorded the same attention in control. It was therefore highly appropriate that the IEEE Control Systems Society created the Bode Lecture Award, an honor which also came with the duty of delivering a lecture. Gunter Stein gave the first Hendrik W. Bode Lecture at the IEEE Conference on Decision and Control in Tampa, Florida, in December 1989. In his lecture he focused on Bode’s important observation that there are fundamental limitations on the achievable sensitivity function expressed by Bode’s integral. Gunter has a unique position in the controls community because he combines the insight derived from a large number of industrial applications at Honeywell with long experience as an influential adjunct professor at the Massachusetts Institute of Technology from 1977 to 1996. In his lecture, Gunter also emphasized the importance of the interaction between instability and saturating actuators and the consequences of the fact that control is becoming increasingly mission critical. After more than 13 years I still remember Gunter’s superb lecture. I also remember comments from young control scientists who had been brought up on state-space theory who said: “I believed that controllability and observability were the only things that mattered.” At Lund University we made Gunter’s lecture a key part of all courses in control system design. Gunter was brought into the classroom via videotapes published by the IEEE Control Systems Society and the written lecture notes. It was a real drawback that the lecture was not available in more archival form. I am therefore delighted that IEEE Control Systems Magazine is publishing this article. I sincerely hope that this will be followed by a DVD version of the videotape. The lecture is like really good wine; it ages superbly.
—Karl J Åström, Professor Emeritus, Lund University, Lund, Sweden (2003) Support Files: An article based on Gunter Stein’s Bode Lecture was published in Control Systems Magazine in August 2003 and is available on IEEE Xplore at http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=1213600&isnumber=27285.
(This introduction is from the article cited above.)
As humans look to explore the solar system beyond low Earth orbit, the technology advancements required point heavily towards autonomy. The operation of complex human spacecraft has thus far been solved with heavy human involvement- full ground control rooms and nearly constantly inhabited spacecraft. As the goal of space exploration moves to beyond the International Space Station, the physical and budgetary constraints of business as usual become overwhelming. A new paradigm of delivering spacecraft and other assets capable of self-maintenance and self-operation prior to launching crew solves many problems- and at the same time, it opens up an array of interesting control problems. This talk will focus on robotic and autonomous vehicle system
Since 1987 I have highlighted how attempts to deploy autonomous capabilities into complex, risky worlds of practice have been hampered by brittleness — descriptively, a sudden collapse in performance when events challenge system boundaries. This constraint has been downplayed on the grounds that the next advance in AI, algorithms, or control theory will lead to the deployment of systems that escape from brittle limits. However, the world keeps providing examples of brittle collapse such as the 2003 Columbia Space Shuttle accident or this years’ Texas energy collapse. Resilience Engineering, drawing on multiple sources including safety of complex systems, biological systems, & joint human-autonomy systems, discovered that (a) brittleness is a fundamental risk and (b) all adaptive systems develop means to mitigate that risk through sources for resilient performance.
The fundamental discovery, covering biological, cognitive, and human systems, is that all adaptive systems at all scales have to possess the capacity for graceful extensibility. Viability of a system, in the long run, requires the ability to gracefully extend or stretch at the boundaries as challenges occur. To put the constraint simply, viability requires extensibility, because all systems have limits and regularly experience surprise at those boundaries due to finite resources and continuous change (Woods, 2015; 2018; 2019).
The problem is that development of automata consistently ignores this constraint. As a result, we see repeated demonstrations of the empirical finding: systems-as-designed are more brittle than stakeholders realize, but fail less often as people in various roles adapt to fill shortfalls and stretch system performance in the face of smaller & larger surprises. (Some) people in some roles are the ad hoc source of the necessary graceful extensibility.
The promise comes from the science behind Resilience Engineering which highlights paths to build systems with graceful extensibility, especially systems that utilize new autonomous capabilities. Even better, designing systems with graceful extensibility draws on basic concepts in control engineering, though these are reframed substantially when combined with findings on adaptive systems from biology, cognitive work, organized complexity, and sociology.
In this talk, I will discuss the problem of interactive learning by discussing how we can actively learn objective functions from human feedback capturing their preferences. I will then talk about how the value alignment and reward design problem can have solutions beyond active preference-based learning by tapping into the rich context available from large language models. In the second section of the talk, I will more generally talk about the role of large pretrained models in today’s robotics and control systems. Specifically, I will present two viewpoints: 1) pretraining large models for downstream robotics tasks, and 2) finding creative ways of tapping into the rich context of large models to enable more aligned embodied AI agents. For pretraining, I will introduce Voltron, a language-informed visual representation learning approach that leverages language to ground pretrained visual representations for robotics. For leveraging large models, I will talk about a few vignettes about how we can leverage LLMs and VLMs to learn human preferences, allow for grounded social reasoning, or enable teaching humans using corrective feedback. Finally, I will conclude the talk by discussing some preliminary results on how large models can be effective pattern machines that can identify patterns in a token invariant fashion and enable pattern transformation, extrapolation, and even show some evidence of pattern optimization for solving control problems.
