Reunion Workshop

Venue

California Institute of Technology
1200 E California Blvd, Pasadena, CA 91125, USA
Beckman Behavioral Biology Labs, Room B180
Campus map | Google Maps

*Breakfast and breaks are right outside Room B180
*Lunch is in the Schlinger Patio next to Beckman Behavioral Biology Labs

Speaker Highlight

• John Doyle, California Institute of Technology
• Harvey Newman, California Institute of Technology
• Fernando Paganini, Universidad ORT Uruguay
• Rayadurgam Srikant, University of Illinois at Urbana Champaign
• Adam Wierman, California Institute of Technology

Talk Highlight

Learning and Control in Countable State Spaces
Speaker: R. Srikant, UIUC
Abstract: We will consider policy optimization methods in reinforcement learning where the state space is countably infinite. The motivation arises from control problems in communication networks and matching markets. We consider an algorithm called Natural Policy Gradient (NPG), which is perhaps the most popular algorithm for finite state spaces, and show three results in the context of countable state spaces: (i) in the case where perfect policy evaluation is possible, we show that standard NPG converges with a small modification; (ii) if the error is policy evaluation is within a factor of the true value function, we show that one can obtain bounds on the performance of the NPG algorithms; and (iii) we will discuss the ability of neural network-based function approximations to satisfy the condition in (ii) above.

Analyzing spatially distributed EV charging dynamics with optimization and duality (Steven’s way)
Speaker: F. Paganini, Universidad ORT Uruguay
Abstract: Optimization and control have an old and fruitful interaction, across multiple application domains. For large distributed networks, convex optimization has provided the most powerful tools for designing local controllers with global guarantees; also, to reverse engineer existing control laws. Steven Low has taught us how to do this, in the broad domains of the Internet and the power grid.

In this talk we consider a spatially distributed infrastructure for electrical vehicle recharging, under continuous demand and selfish station assignment. The global dynamics are reverse engineered in terms of a suitable convex optimization problem, characterizing the equilibrium and its global convergence. Results differ from the classical literature on selfish routing, in the model for station sojourn times. The appropriate model uses (Steven´s way) a fluid queue, and proofs require extensive application of convex duality.

Global Networks for Data Intensive Sciences The Innovations and Key Roles of Steven Low
Speaker: Harvey Newman, Caltech
Abstract: It has been a pleasure to collaborate with Steven starting in 2002, with the shared goal of addressing the challenges facing the largest data intensive science programs who rely on global networks, as well as benefiting society at-large through advances in network performance and reliability. Steven’s key understanding and innovations in network protocols and stability, the resulting ability to transfer data at unprecedented rates across national and transoceanic boundaries, and his optical network experience and advances in Netlab on campus, have since helped trigger two decades of further progress across several technology generations, up to the present.

The Global Network Advancement Group (GNA-G), a worldwide collaboration bringing together major science programs, research and education networks, and advanced network R&D projects spanning the U.S, Europe, Asia, Latin America and Oceania, was founded in 2019 to carry forward the work. I founded the GNA-G Data Intensive Sciences Working Group as its chair in 2020, working with many partners in academia and industry to develop a next generation network-integrated system to meet the challenges of exabyte data volumes and terabit/sec workflows supporting thousands of scientists located throughout the world, and to clear the path to the next round of discoveries in high energy and astrophysics, bioinformatics and many other fields of data intensive science. To reach these goals, the teams are developing a dynamic and adaptive programmable system which coordinates worldwide networks as a first class resource along with computing and storage, across multiple domains. We are following a systems design approach to create a global fabric that flexibly allocates, balances and conserves the available network resources, while negotiating and working with the site-resident systems that aim to accelerate science workflow. Reinforcement and other machine learning techniques are also being developed to optimize system operations, while taking priority, policy, network- and site-state changes, workflow objectives and other constraints into account.

A Decade of Sustainable Data Centers
Speaker: Adam Wierman, Caltech
Abstract: When I arrived at Caltech, Steven’s mentorship played a huge role in shaping my research directions and style. One consequence was an increasing desire to understand the societal impact of computation, which led to a focus on developing sustainable algorithms for data centers and distributed systems. It was a long hard road in the early days, when industry was not open to the idea that energy and carbon were important measures, but a decade on, both integration renewable energy into data centers and integration of data centers into the grid to ease the challenges associated with renewable energy are beginning to happen. It is essential that these techniques become mainstream given the massive growth of data centers projected in the coming years as a result of the AI training and deployment. In this talk, I’ll give a brief historical recollection of how our work at Caltech has helped to enable this transition, moving all the way from theory to production deployment.

Lodging