- Table View
- List View
Reinforcement Learning Algorithms: Analysis and Applications (Studies in Computational Intelligence #883)
by Boris Belousov Hany Abdulsamad Pascal Klink Simone Parisi Jan PetersThis book reviews research developments in diverse areas of reinforcement learning such as model-free actor-critic methods, model-based learning and control, information geometry of policy searches, reward design, and exploration in biology and the behavioral sciences. Special emphasis is placed on advanced ideas, algorithms, methods, and applications. The contributed papers gathered here grew out of a lecture course on reinforcement learning held by Prof. Jan Peters in the winter semester 2018/2019 at Technische Universität Darmstadt. The book is intended for reinforcement learning students and researchers with a firm grasp of linear algebra, statistics, and optimization. Nevertheless, all key concepts are introduced in each chapter, making the content self-contained and accessible to a broader audience.
Reinforcement Learning and Approximate Dynamic Programming for Feedback Control (IEEE Press Series on Computational Intelligence #17)
by Frank L. Lewis Derong LiuReinforcement learning (RL) and adaptive dynamic programming (ADP) has been one of the most critical research fields in science and engineering for modern complex systems. This book describes the latest RL and ADP techniques for decision and control in human engineered systems, covering both single player decision and control and multi-player games. Edited by the pioneers of RL and ADP research, the book brings together ideas and methods from many fields and provides an important and timely guidance on controlling a wide variety of systems, such as robots, industrial processes, and economic decision-making.
Reinforcement Learning and Dynamic Programming Using Function Approximators (Automation and Control Engineering)
by Lucian Busoniu Robert Babuska Damien Ernst Bart De SchutterFrom household appliances to applications in robotics, engineered systems involving complex dynamics can only be as effective as the algorithms that control them. While Dynamic Programming (DP) has provided researchers with a way to optimally solve decision and control problems involving complex dynamic systems, its practical value was limited by algorithms that lacked the capacity to scale up to realistic problems. However, in recent years, dramatic developments in Reinforcement Learning (RL), the model-free counterpart of DP, changed our understanding of what is possible. Those developments led to the creation of reliable methods that can be applied even when a mathematical model of the system is unavailable, allowing researchers to solve challenging control problems in engineering, as well as in a variety of other disciplines, including economics, medicine, and artificial intelligence. Reinforcement Learning and Dynamic Programming Using Function Approximators provides a comprehensive and unparalleled exploration of the field of RL and DP. With a focus on continuous-variable problems, this seminal text details essential developments that have substantially altered the field over the past decade. In its pages, pioneering experts provide a concise introduction to classical RL and DP, followed by an extensive presentation of the state-of-the-art and novel methods in RL and DP with approximation. Combining algorithm development with theoretical guarantees, they elaborate on their work with illustrative examples and insightful comparisons. Three individual chapters are dedicated to representative algorithms from each of the major classes of techniques: value iteration, policy iteration, and policy search. The features and performance of these algorithms are highlighted in extensive experimental studies on a range of control applications. The recent development of applications involving complex systems has led to a surge of interest in RL and DP methods and the subsequent need for a quality resource on the subject. For graduate students and others new to the field, this book offers a thorough introduction to both the basics and emerging methods. And for those researchers and practitioners working in the fields of optimal and adaptive control, machine learning, artificial intelligence, and operations research, this resource offers a combination of practical algorithms, theoretical analysis, and comprehensive examples that they will be able to adapt and apply to their own work. Access the authors' website at www.dcsc.tudelft.nl/rlbook/ for additional material, including computer code used in the studies and information concerning new developments.
Reinforcement Learning for Maritime Communications (Wireless Networks)
by Liang Xiao Helin Yang Weihua Zhuang Minghui MinThis book demonstrates that the reliable and secure communication performance of maritime communications can be significantly improved by using intelligent reflecting surface (IRS) aided communication, privacy-aware Internet of Things (IoT) communications, intelligent resource management and location privacy protection. In the IRS aided maritime communication system, the reflecting elements of IRS can be intelligently controlled to change the phase of signal, and finally enhance the received signal strength of maritime ships (or sensors) or jam maritime eavesdroppers illustrated in this book.The power and spectrum resource in maritime communications can be jointly optimized to guarantee the quality of service (i.e., security and reliability requirements), and reinforcement leaning is adopted to smartly choose the resource allocation strategy. Moreover, learning based privacy-aware offloading and location privacy protection are proposed to intelligently guarantee the privacy-preserving requirements of maritime ships or (sensors). Therefore, these communication schemes based on reinforcement learning algorithms can help maritime communication systems to improve the information security, especially in dynamic and complex maritime environments.This timely book also provides broad coverage of the maritime wireless communication issues, such as reliability, security, resource management, and privacy protection. Reinforcement learning based methods are applied to solve these issues. This book includes four rigorously refereed chapters from prominent international researchers working in this subject area. The material serves as a useful reference for researchers, graduate students. Practitioners seeking solutions to maritime wireless communication and security related issues will benefit from this book as well.
Reinforcement Learning for Optimal Feedback Control: A Lyapunov-based Approach (Communications and Control Engineering)
by Warren Dixon Joel Rosenfeld Patrick Walters Rushikesh KamalapurkarReinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution. To yield an approximate optimal controller, the authors focus on theories and methods that fall under the umbrella of actor–critic methods for machine learning. They concentrate on establishing stability during the learning phase and the execution phase, and adaptive model-based and data-driven reinforcement learning, to assist readers in the learning process, which typically relies on instantaneous input-output measurements. This monograph provides academic researchers with backgrounds in diverse disciplines from aerospace engineering to computer science, who are interested in optimal reinforcement learning functional analysis and functional approximation theory, with a good introduction to the use of model-based methods. The thorough treatment of an advanced treatment to control will also interest practitioners working in the chemical-process and power-supply industry.
Reinforcement Learning for Reconfigurable Intelligent Surfaces: Assisted Wireless Communication Systems (SpringerBriefs in Computer Science)
by Alice Faisal Ibrahim Al-Nahhal Octavia A. Dobre Telex M. NgatchedThis book presents the intersection of two dynamic fields: Reinforcement Learning (RL) and RIS- Assisted Wireless Communications. With an emphasis on both discrete and continuous problems, it introduces a comprehensive overview of RL techniques and their applications in the evolving world of RIS-assisted wireless communications. Chapter 1 introduces the fundamentals of RL and deep RL (DRL), providing a solid foundation for understanding subsequent chapters. It also presents the Q-learning, deep Q-learning, and deep deterministic policy gradient algorithms. Chapter 2 provides a holistic overview of RIS-assisted systems and details several use cases in wireless communications. Then, Chapters 3 and 4 present various applications of the discrete and continuous DRL to RIS-assisted wireless communications. From maximizing the sum-rate to minimizing, the system resources and maximizing the energy efficiency. These chapters showcase the versatility of the DRL algorithms in tackling arange of challenges. This book concludes with Chapter 5, which introduces the challenges and future directions in this field. It explores the particulars of hyperparameter tuning, problem design, and complexity analysis, while also highlighting the potential of hybrid DRL, multi-agent DRL, and transfer learning techniques for advancing wireless communication systems. Optimizing RIS-Assisted Wireless Systems requires powerful algorithms to cope with the dynamic propagation environment. DRL is envisioned as one of the key enabling techniques to exploit the full potential of RIS-Assisted Wireless Communication Systems. It empowers these systems to intelligently adapt to dynamic wireless environments, maximize performance metrics, and adjusts their configurations to accommodate diverse use cases efficiently. This book serves as a valuable resource, shedding light on the potential of DRL to optimize RIS-Assisted Wireless Communication, enabling researchers, engineers, advanced level students in computer science and electrical engineering and enthusiasts to grasp the intricacies of this topic. It offers a comprehensive understanding of the principles, applications, and challenges, making it a reference to recognize the full potential of the RIS technology in modern wireless communication systems.
Reinforcement Learning of Bimanual Robot Skills (Springer Tracts in Advanced Robotics #134)
by Adrià Colomé Carme TorrasThis book tackles all the stages and mechanisms involved in the learning of manipulation tasks by bimanual robots in unstructured settings, as it can be the task of folding clothes. The first part describes how to build an integrated system, capable of properly handling the kinematics and dynamics of the robot along the learning process. It proposes practical enhancements to closed-loop inverse kinematics for redundant robots, a procedure to position the two arms to maximize workspace manipulability, and a dynamic model together with a disturbance observer to achieve compliant control and safe robot behavior. In the second part, methods for robot motion learning based on movement primitives and direct policy search algorithms are presented. To improve sampling efficiency and accelerate learning without deteriorating solution quality, techniques for dimensionality reduction, for exploiting low-performing samples, and for contextualization and adaptability to changing situations are proposed. In sum, the reader will find in this comprehensive exposition the relevant knowledge in different areas required to build a complete framework for model-free, compliant, coordinated robot motion learning.
Reinforcement of Rubber: Visualization of Nanofiller and the Reinforcing Mechanism (Springer Series on Polymer and Composite Materials)
by Yuko Ikeda Atsushi Kato Shinzo KohjiyaThis book presents the most recent description of rubber reinforcement, focusing on the network-like structure formation of nanofiller in the rubber matrix under the presence of bound rubber. The resultant filler network is visualized by electron tomography applied to rubber. In the case of natural rubber, the self-reinforcement effect is uniquely functioning, and new template crystallization is suggested. Here, the crystallites are also believed to arrange themselves in a network-like manner. These results are of great use, particularly for engineers, in designing rubber reinforcement.
Reinforcement of the Halal Industry for Global Integration Revival: Proceedings of the 2nd International Conference on Halal Development (ICHaD 2021), Malang, Indonesia, 5 October 2021
by Heri Pratikto Ahmad Munjin Nasih Zawawi Isma’il Adam VoakThe emergence of a Halal industry in the past decade in the fields of food, beverages, and services, emphasizes the importance of providing a more complete understanding of Halal products, current Halal developments and other topics of Halal development. This groundbreaking volume provides theoretical and empirical studies on the Halal industry. This book explores critical issues, best practice examples, and draws on a range of international case studies to demonstrate theory in practice of the Halal industry. Emphasizing the Halal industry, the chapters address a number of important issues such as Halal assurance system, Halal product certification, Halal tourism, Human Resources of Halal Certification, supply chain of Halal products, and other related subjects.This book will be of interest to students, scholars, and practitioners who have a deep concern and interest in the Halal industry. It is futuristic with a lot of practical insights for students, faculty members, and practitioners. Since the contributors are from across the globe, it is fascinating to see the global benchmarks.
Reinforcement of Timber Elements in Existing Structures: State-of-the-Art Report of the RILEM TC 245-RTE (RILEM State-of-the-Art Reports #33)
by Jorge Branco Philipp Dietsch Thomas TannertBy presenting the work of the RILEM Technical Committee 245-RTE, the book provides an overview of the existing techniques for the reinforcement of timber elements, joints and structures. It consists of two parts: part I examines state-of-the-art information on reinforcement techniques, summarizes the current status of standardization, and covers STS, GiR, FRP and nanotechnology. In part II several applications of reinforcement are discussed: these include traditional structures, traditional timber frame walls, light-frame shear walls, roofs, floors, and carpentry joints. The book will benefit academics, practitioners, industry and standardization committees interested in the reinforcement of existing timber elements, joints and structures.
Reinraumtechnik (VDI-Buch)
by Udo Gommel Lothar GailDer Band bietet eine fundierte Darstellung der Reinraumtechnik als branchenübergreifende Disziplin. Dabei verknüpfen die Autoren die Grundlagen der Reinraumtechnik mit deren Anwendungen und mit einer Anleitung zum selbständigen Erarbeiten von Problemlösungen. Für die 3. Auflage wurden Ergebnisse der nationalen und internationalen Reinraumkongresse ebenso berücksichtigt wie neue Regulierungen der Pharmazie, aktuelle Richtlinien und Anwendungen. Die Themen Hygienetechnik und Reinstwassertechnologie werden jetzt ausführlicher behandelt.
Reinraumtechnik
by Hans-Peter Hortig Lothar Gail Udo GommelDer Band bietet eine fundierte Darstellung der Reinraumtechnik als branchenübergreifende Disziplin. Dabei verknüpfen die Autoren die Grundlagen der Reinraumtechnik mit deren Anwendungen und mit einer Anleitung zum selbständigen Erarbeiten von Problemlösungen. Für die 3. Auflage wurden Ergebnisse der nationalen und internationalen Reinraumkongresse ebenso berücksichtigt wie neue Regulierungen der Pharmazie, aktuelle Richtlinien und Anwendungen. Die Themen Hygienetechnik und Reinstwassertechnologie werden jetzt ausführlicher behandelt.
Reinventing Capitalism in the Age of Big Data
by Viktor Mayer-Schönberger Thomas RamgeFrom the New York Times bestselling author of Big Data, a prediction for how data will revolutionize the market economy and make cash, banks, and big companies obsoleteIn modern history, the story of capitalism has been a story of firms and financiers. That's all going to change thanks to the Big Data revolution. As Viktor Mayer-Schönberger, bestselling author of Big Data, and Thomas Ramge, who writes for The Economist, show, data is replacing money as the driver of market behavior. Big finance and big companies will be replaced by small groups and individual actors who make markets instead of making things: think Uber instead of Ford, or Airbnb instead of Hyatt.This is the dawn of the era of data capitalism. Will it be an age of prosperity or of calamity? This book provides the indispensable roadmap for securing a better future.
Reinventing Discovery: The New Era of Networked Science
by Michael NielsenIn Reinventing Discovery, Michael Nielsen argues that we are living at the dawn of the most dramatic change in science in more than 300 years. This change is being driven by powerful new cognitive tools, enabled by the internet, which are greatly accelerating scientific discovery. There are many books about how the internet is changing business or the workplace or government. But this is the first book about something much more fundamental: how the internet is transforming the nature of our collective intelligence and how we understand the world. Reinventing Discovery tells the exciting story of an unprecedented new era of networked science. We learn, for example, how mathematicians in the Polymath Project are spontaneously coming together to collaborate online, tackling and rapidly demolishing previously unsolved problems. We learn how 250,000 amateur astronomers are working together in a project called Galaxy Zoo to understand the large-scale structure of the Universe, and how they are making astonishing discoveries, including an entirely new kind of galaxy. These efforts are just a small part of the larger story told in this book--the story of how scientists are using the internet to dramatically expand our problem-solving ability and increase our combined brainpower. This is a book for anyone who wants to understand how the online world is revolutionizing scientific discovery today--and why the revolution is just beginning.
Reinventing Discovery: The New Era of Networked Science (Princeton Science Library #70)
by Michael NielsenHow the internet and powerful online tools are democratizing and accelerating scientific discoveryReinventing Discovery argues that we are living at the dawn of the most dramatic change in science in more than three hundred years. This change is being driven by powerful cognitive tools, enabled by the internet, which are greatly accelerating scientific discovery. There are many books about how the internet is changing business, the workplace, or government. But this is the first book about something much more fundamental: how the internet is transforming our collective intelligence and our understanding of the world. From the collaborative mathematicians of the Polymath Project to the amateur astronomers of Galaxy Zoo, Reinventing Discovery tells the exciting story of the unprecedented new era in networked science. It will interest anyone who wants to learn about how the online world is revolutionizing scientific discovery—and why the revolution is just beginning.
Reinventing Environmental Regulation: Lessons from Project XL
by Alfred A. Marcus Donald A. Geffen Ken Professor SextonProject XL (eXcellence and Leadership) was the flagship effort by the Clinton administration for 'cleaner, cheaper, and smarter' regulation. Under Project XL, business promised better performance in exchange for a regulatory approach focused more on results than means, with the Environmental Protection Agency (EPA) measuring pollution reduction across rather than at individual sources within a facility. Reinventing Environmental Regulation is a compelling account of the breakdown in negotiations to implement Project XL at a tape manufacturing plant of 3M, a company widely recognized as environmentally progressive. Marcus, Geffen, and Sexton discuss the conflicting goals of participants, the influences of personality and organizational culture, and complications caused by changes in 3M‘s external business environment. They compare the 3M case with EPA negotiations involving Intel, Merck, and Weyerhaeuser, finding similarly contentious, though less fatal disagreements about the meaning of 'superior environmental performance.' In common with other recent proposals, Project XL emphasized cooperative, flexible regulatory approaches. Reinventing Environmental Regulation demonstrates the difficulty of putting these appealing ideas into practice, while offering encouragement for continued innovations.
Reinventing Fire: Bold Business Solutions for the New Energy Era
by Amory B. LovinsImagine fuel without fear. No climate change. No oil spills, no dead coalminers, no dirty air, no devastated lands, no lost wildlife. No energy poverty. No oil-fed wars, tyrannies, or terrorists. No leaking nuclear wastes or spreading nuclear weapons. Nothing to run out. Nothing to cut off. Nothing to worry about. Just energy abundance, benign and affordable, for all, forever. That richer, fairer, cooler, safer world is possible, practical, even profitable-because saving and replacing fossil fuels now works better and costs no more than buying and burning them. Reinventing Fire shows how business-motivated by profit, supported by civil society, sped by smart policy-can get the US completely off oil and coal by 2050, and later beyond natural gas as well. Authored by a world leader on energy and innovation, the book maps a robust path for integrating real, here-and-now, comprehensive energy solutions in four industries-transportation, buildings, electricity, and manufacturing-melding radically efficient energy use with reliable, secure, renewable energy supplies. Popular in tone and rooted in applied hope, Reinventing Fire shows how smart businesses are creating a potent, global, market-driven, and explosively growing movement to defossilize fuels. It points readers to trillions in savings over the next 40 years, and trillions more in new business opportunities. Whether you care most about national security, or jobs and competitive advantage, or climate and environment, this major contribution by world leaders in energy innovation offers startling innovations will support your values, inspire your support, and transform your sense of possibility. Pragmatic citizens today are more interested in outcomes than motives. Reinventing Fire answers this trans-ideological call. Whether you care most about national security, or jobs and competitive advantage, or climate and environment, its startling innovations will support your values, inspire your support, and transform your sense of possibility.
Reinventing Free Labor: Padrones and Immigrant Workers in the North American West, 1880-1930
by Gunther PeckOne of the most infamous villains in North America during the Progressive Era was the padrone, a mafia-like immigrant boss who allegedly enslaved his compatriots and kept them uncivilized, unmanly, and unfree. In this first-ever history of the padrone, Gunther Peck argues that they were not primitive men but rather thoroughly modern entrepreneurs who used corporations, the labor contract, and the right to quit to create far-flung coercive networks. Drawing on Greek, Spanish, and Italian language sources, Peck analyzes how immigrant workers emancipated themselves using the tools of padrone power to their own advantage.
Reinventing Gravity: A Physicist Goes Beyond Einstein
by John W. MoffatEinstein's gravity theory—his general theory of relativity—has served as the basis for a series of astonishing cosmological discoveries. But what if, nonetheless, Einstein got it wrong?Since the 1930s, physicists have noticed an alarming discrepancy between the universe as we see it and the universe that Einstein's theory of relativity predicts. There just doesn't seem to be enough stuff out there for everything to hang together. Galaxies spin so fast that, based on the amount of visible matter in them, they ought to be flung to pieces, the same way a spinning yo-yo can break its string. Cosmologists tried to solve the problem by positing dark matter—a mysterious, invisible substance that surrounds galaxies, holding the visible matter in place—and particle physicists, attempting to identify the nature of the stuff, have undertaken a slew of experiments to detect it. So far, none have.Now, John W. Moffat, a physicist at the Perimeter Institute for Theoretical Physics in Waterloo, Canada, offers a different solution to the problem. The capstone to a storybook career—one that began with a correspondence with Einstein and a conversation with Niels Bohr—Moffat's modified gravity theory, or MOG, can model the movements of the universe without recourse to dark matter, and his work challenging the constancy of the speed of light raises a stark challenge to the usual models of the first half-million years of the universe's existence. This bold new work, presenting the entirety of Moffat's hypothesis to a general readership for the first time, promises to overturn everything we thought we knew about the origins and evolution of the universe.
Reinventing green building
by Jerry YudelsonBuildings and their associated systems are the largest source of greenhouse gases in the world. The 2030 Challenge aims to produce zero net -energy from new North American construction by 2030 while achieving a 50% reduction in carbon emissions from existing buildings. With less than 4% of commercial and residential structures in the U. S. and Canada certified by 2015, we seem destined to fall catastrophically short of this target. Reinventing Green Building combines a unique, insider's critique of the current state of affairs with a potent vision for the future. This highly visual, data-driven analysis brings together the wisdom of today's leading practitioners including: Up-to-date information on green building issues, energy economics and new technology Dramatic new approaches to certification system design and user experience Creative, outside-the-box solutions using the Internet of Things, big data analytics and cloud-based technologies for building management. The green building revolution has failed to fulfill its promise to transform the marketplace in a meaningful way. Smart, simple, and sustainable: Reinventing Green Building presents a new approach to building certification, designed to radically cut costs while dramatically increasing marketplace acceptance integrating true climate mitigation and better building performance.
Reinventing Innovation
by Aaron C. T. Smith Fiona Sutherland David H. GilbertBased on research findings and detailed, original cases, this book charts the new innovation imperative, where organizations must deliver on dual goals: an efficient return on current operations, and a burgeoning pipeline of new products. It argues that the two pursuits cannot be achieved through a bland compromise, or by switching priorities back and forth. Only a 'dual' organization capable of amplifying the tension can optimize efficiency while seeding innovation. Reinventing Innovation examines the nature of dual organizing, presents a series of in-depth cases to reveal its principles, and explains how to fortify organizations with 'ambidexterity' capabilities. Ideal for tertiary students, academics, and practitioners, Reinventing Innovation contains a rich balance of theoretical principles, case insights, and practical guidance.
Reinventing Manufacturing and Business Processes Through Artificial Intelligence (Innovations in Big Data and Machine Learning)
by Geeta Rana Alex Khang Ravindra Sharma Alok Kumar Goel Ashok Kumar DubeyThis edited book describes how newly emerging Artificial Intelligence (AI) technologies will provide unprecedented opportunities to penetrate technology and automation into everything we do, and at the same time, provide a huge playing field for businesses to develop newer models to capture market share. It establishes a milestone in understanding global transformational changes occurring in the manufacturing and corporate world due to AI and tries to find powerful and sophisticated solutions that will improve and streamline operations. Reinventing Manufacturing and Business Processes Through Artificial Intelligence will be of interest to students, researchers, and professionals of the AI community as well as interdisciplinary researchers.
Reinventing Mechatronics: Developing Future Directions for Mechatronics
by David Bradley David Russell Xiu-Tian Yan Philip MooreThis book presents the latest research on mechatronic systems engineering. By bringing together the most important papers from the 2018 Mechatronics Forum Conference ‘Reinventing Mechatronics,’ it outlines key trends in research and applications that will define mechatronics for the next 50 years. Mechatronics was established as an engineering discipline over 50 years ago, as the integration of electronics and information technology with mechanical design. Given major technological advances and the growth of systems-level concepts such as Cyber-Physical Systems and the Internet of Things, along with Cloud Technologies and Big Data, it’s now high time to reconsider the role of mechatronics, particularly within engineering design. Past and ongoing technological changes are impacting how systems are designed and configured in ways that could never have been envisaged when the field of mechatronics was first introduced.
Reinventing Ourselves: Contemporary Concepts of Identity in Virtual Worlds
by Anna Peachey Mark ChildsThe proposed book explores the theme of identity, specifically as applied to its role and development in virtual worlds. Following the introduction, it is divided into four sections: identities, avatars and the relationship between them; factors that support the development of identity in virtual worlds; managing multiple identities across different environments and creating an online identity for a physical world purpose.