This groundbreaking proceedings volume explores the integration of Artificial Intelligence (AI) across key domains—healthcare, finance, education, robotics, industrial and other engineering applications —unveiling its transformative potential and practical implications. With a multidisciplinary lens, it transcends technical aspects, fostering a comprehensive understanding while bridging theory and practice.

This book presents the intersection of two dynamic fields: Reinforcement Learning (RL) and RIS- Assisted Wireless Communications. With an emphasis on both discrete and continuous problems, it introduces a comprehensive overview of RL techniques and their applications in the evolving world of RIS-assisted wireless communications. Chapter 1 introduces the fundamentals of RL and deep RL (DRL), providing a solid foundation for understanding subsequent chapters. It also presents the Q-learning, deep Q-learning, and deep deterministic policy gradient algorithms. Chapter 2 provides a holistic overview of RIS-assisted systems and details several use cases in wireless communications. Then, Chapters 3 and 4 present various applications of the discrete and continuous DRL to RIS-assisted wireless communications. From maximizing the sum-rate to minimizing, the system resources and maximizing the energy efficiency. These chapters showcase the versatility of the DRL algorithms in tackling a range of challenges. This book concludes with Chapter 5, which introduces the challenges and future directions in this field. It explores the particulars of hyperparameter tuning, problem design, and complexity analysis, while also highlighting the potential of hybrid DRL, multi-agent DRL, and transfer learning techniques for advancing wireless communication systems.

This book examines the latest research achievements of these technologies and provides a reference for researchers, engineers, students, and other interested readers. It helps readers understand the opportunities and challenges faced by deep learning and reinforcement learning and how to address them, thus improving the research and application capabilities of these technologies in related fields.

The six volume set LNCS 10634, LNCS 10635, LNCS 10636, LNCS 10637, LNCS 10638, and LNCS 10639 constitues the proceedings of the 24rd International Conference on Neural Information Processing, ICONIP 2017, held in Guangzhou, China, in November 2017. The 563 full papers presented were carefully reviewed and selected from 856 submissions.

Artificial intelligence (AI) applications bring agility and modernity to our lives, and the reinforcement learning technique is at the forefront of this technology. It can outperform human competitors in strategy games, creative compositing, and autonomous movement. Moreover, it is just starting to transform our civilization.

This book provides an introduction to AI, specifies machine learning techniques, and explores various aspects of reinforcement learning, approaching the latest concepts in a didactic and illustrated manner. It is aimed at students who want to be part of technological advances and professors engaged in the development of innovative applications, helping with academic and industrial challenges.

Understanding the Fundamentals of Reinforcement Learning will allow you to:

Understand essential AI concepts
Gain professional experience
Interpret sequential decision problems and solve them with reinforcement learning
Learn how the Q-Learning algorithm works
Practice with commented Python code
Find advantageous directions

This informative text/reference presents a detailed review of the state of the art in fog computing paradigm. In particular, the book examines a broad range of important cooperative and distributed computation algorithms, along with their design objectives and technical challenges.

The six volume set LNCS 10634, LNCS 10635, LNCS 10636, LNCS 10637, LNCS 10638, and LNCS 10639 constitues the proceedings of the 24rd International Conference on Neural Information Processing, ICONIP 2017, held in Guangzhou, China, in November 2017. The 563 full papers presented were carefully reviewed and selected from 856 submissions.
The 6 volumes are organized in topical sections on Machine Learning, Reinforcement Learning, Big Data Analysis, Deep Learning, Brain-Computer Interface, Computational Finance, Computer Vision, Neurodynamics, Sensory Perception and Decision Making, Computational Intelligence, Neural Data Analysis, Biomedical Engineering, Emotion and Bayesian Networks, Data Mining, Time-Series Analysis, Social Networks, Bioinformatics, Information Security and Social Cognition, Robotics and Control, Pattern Recognition, Neuromorphic Hardware and Speech Processing.

All you need to know about Markov Decision processes, value- and policy-iteation as well as about Q learning approach

Build Artificial Intelligence (AI) agents using Deep Reinforcement Learning and PyTorch: A2C, REINFORCE, DQN, etc.

This book brings together papers presented at the 4th International Conference on Artificial Intelligence in China (ChinaAI), Changbaishan, China, on July 23-24, 2022, which provides a venue to disseminate the latest developments and to discuss the interactions and links between these multidisciplinary fields. Spanning topics covering all topics in Artificial Intelligence with new development in China, this book is aimed at undergraduate and graduate students in Electrical Engineering, Computer Science and Mathematics, researchers and engineers from academia and industry as well as government employees (such as NSF, DOD, DOE, etc).

This book comprises select peer-reviewed papers from the International Conference on IoT, Intelligent Computing and Security, IICS 2021. The contents focus on the latest research in artificial intelligence, IoT, intelligent computing, and leading technological convergence security challenges. The book also discusses AI-driven automation of highly connected smart devices across the globe presenting the fast technological shift with the futuristic scenario, bursting perspective of IoT, computational intelligence, and security concerns. This book supports the transfer of vital knowledge to the next generation of researchers, students, and practitioners in academia and industry.

The six volume set LNCS 10634, LNCS 10635, LNCS 10636, LNCS 10637, LNCS 10638, and LNCS 10639 constitues the proceedings of the 24rd International Conference on Neural Information Processing, ICONIP 2017, held in Guangzhou, China, in November 2017. The 563 full papers presented were carefully reviewed and selected from 856 submissions.

This book presents recent research in decision making under uncertainty, in particular reinforcement learning and learning with expert advice. The core elements of decision theory, Markov decision processes and reinforcement learning have not been previously collected in a concise volume. Our aim with this book was to provide a solid theoretical foundation with elementary proofs of the most important theorems in the field, all collected in one place, and not typically found in
introductory textbooks. This book is addressed to graduate students that are interested in statistical decision making under uncertainty and the foundations of reinforcement learning.

Reinforcement learning is a learning paradigm concerned with learning to control a system so as to maximize a numerical performance measure that expresses a long-term objective. What distinguishes reinforcement learning from supervised learning is that only partial feedback is given to the learner about the learner's predictions. Further, the predictions may have long term effects through influencing the future state of the controlled system. Thus, time plays a special role. The goal in reinforcement learning is to develop efficient learning algorithms, as well as to understand the algorithms' merits and limitations. Reinforcement learning is of great interest because of the large number of practical applications that it can be used to address, ranging from problems in artificial intelligence to operations research or control engineering. In this book, we focus on those algorithms of reinforcement learning that build on the powerful theory of dynamic programming. We give a fairly comprehensive catalog of learning problems, describe the core ideas, note a large number of state of the art algorithms, followed by the discussion of their theoretical properties and limitations.