Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 271 - 300 of 3363

Full-Text Articles in Physical Sciences and Mathematics

Simulation Platform For Optimization And Decision Making Of Flexible Manufacturing Process Of Automatic Production Lines, Chao Fu, Dongyue Wang, Xinxin Li, Min Xue May 2023

Simulation Platform For Optimization And Decision Making Of Flexible Manufacturing Process Of Automatic Production Lines, Chao Fu, Dongyue Wang, Xinxin Li, Min Xue

Journal of System Simulation

Abstract: In order to simulate a flexible manufacturing process to verify the correctness of theoretical computation and analysis and find other important factors for optimization and decision making in the manufacturing process, a simulation platform for the optimization and decision making of the flexible manufacturing process of automatic production lines is designed and developed. The framework of the simulation platform is constructed with four hierarchies, including the enterprise production hierarchy, optimization and decision making hierarchy, data resource hierarchy, and function module hierarchy. On this basis, the functional implementation of the modules of production allocation …


Research On Optimal Scheduling Of Microgrid Based On Nbbo Algorithm, Lisheng Wei, Benben Yang, Ruixia Sun May 2023

Research On Optimal Scheduling Of Microgrid Based On Nbbo Algorithm, Lisheng Wei, Benben Yang, Ruixia Sun

Journal of System Simulation

Abstract: In view of the economic and environmental collaborative optimization of a microgrid with a micro gas turbine, power to gas(P2G) system with the ability to abandon wind and light for consumption and capture carbon is introduced, and a microgrid optimal scheduling model with P2G system based on novel biogeography-based optimization(NBBO) algorithm is proposed. The microgrid model with the P2G system is constructed, and the working principle of the main equipment is analyzed. The reserve capacity of a wind turbine is introduced to reduce the influence of the randomness of wind power …


Picking Path Planning Of Container Robots Based On Improved Genetic Algorithm, Yuwen Wu, Zhiyue Niu, Zhenping Li May 2023

Picking Path Planning Of Container Robots Based On Improved Genetic Algorithm, Yuwen Wu, Zhiyue Niu, Zhenping Li

Journal of System Simulation

Abstract: Under the new "container-to-person" picking mode in intelligent warehouses, a new optimization model and its improved genetic algorithm are proposed to solve the picking path planning problem of multiple container robots. According to the picking mode and characteristics of container robots, the picking path planning problem is transformed into an asymmetric vehicle routing problem, and a mixed integer programming model is established with bi-objectives of the shortest total picking path and the least completion time. A hybrid genetic algorithm is designed to solve this model, and the effectiveness and stability of the algorithm are verified …


Deep Reinforcement Learning-Based Control Strategy For Boost Converter, Yuxuan Dai, Chenggang Cui May 2023

Deep Reinforcement Learning-Based Control Strategy For Boost Converter, Yuxuan Dai, Chenggang Cui

Journal of System Simulation

Abstract: In view of the problems of model uncertainty and nonlinearity in bus voltage stability control of Boost converter, an intelligent control strategy based on model-free deep reinforcement learning(RL) is proposed. RL double DQN(DDQN) algorithm and deep deterministic policy gradient(DDPG) algorithm are used, and the Boost converter controller is designed. The state, action space, reward function, and neural network are also designed to improve the dynamic performance of the controller. The joint simulation of the Boost converter model and RL agent is realized by RL modelica(RLM …


Modeling And Simulation Of Spaceborne, Near-Spaceborne, And Airborne Integrated Collaborative Remote Sensing System Based On Dodaf, Lili An, Tian Xia, Wenbin Yang, Xinbo Wu May 2023

Modeling And Simulation Of Spaceborne, Near-Spaceborne, And Airborne Integrated Collaborative Remote Sensing System Based On Dodaf, Lili An, Tian Xia, Wenbin Yang, Xinbo Wu

Journal of System Simulation

Abstract: Spaceborne, near-spaceborne, and airborne integrated collaborative remote sensing system (SNA-ICRSS) makes comprehensive use of modern information technology to aggregate multiple and heterogeneous data in spaceborne, near-spaceborne, and airborne domains, so as to realize accurate emergency service and command decision-making. SNA-ICRSS is huge and complex, and there is a lack of research on its architecture modeling and simulation. According to the architecture characteristics of the SNA-ICRSS, the minimum prototype of the SNA-ICRSS is constructed; through the department of defense architecture framework (DoDAF) and activity based methodology (ABM) methods, the minimal prototype of the SNA-ICRSS is modeled, and the operational resource …


Action Recognition Method Based On Projection Subspace Views Under Single Viewing Angle, Benyue Su, Manzhen Sun, Qing Ma, Min Sheng May 2023

Action Recognition Method Based On Projection Subspace Views Under Single Viewing Angle, Benyue Su, Manzhen Sun, Qing Ma, Min Sheng

Journal of System Simulation

Abstract: In view of the self-occlusion problem of joint action tracking by a depth camera under a single viewing angle, a new human action recognition method based on projection subspace views is proposed. Without adding data acquisition equipment, the method projects the three-dimensional(3D) action sequences obtained under a single viewing angle into multiple two-dimensional subspacesand then seeks the maximum distance between classes in the two-dimensional subspaces, so as to increase the distance between 3D actions based on the fusion of multiple subspace views as much as possible. The recognition rate in the self-built AQNU …


Simulation And Optimization Of Integrated Production Logistics System Of Underground Coal Mining, Dressing, And Backfilling, Xiangqian Wang, Puhao Guo, Xiangrui Meng May 2023

Simulation And Optimization Of Integrated Production Logistics System Of Underground Coal Mining, Dressing, And Backfilling, Xiangqian Wang, Puhao Guo, Xiangrui Meng

Journal of System Simulation

Abstract: In order to study the green mining mode of coal, the bottleneck problem in the integrated production logistics system of underground coal mining, dressing, and backfilling under the goal of achieving the basic production capacity target is explored, so as to promote the coordinated and efficient logistics transportation of underground coal and gangue. A mine in Shanxi is selected as the prototype, and the queuing theory is adopted to analyze the operation process of the integrated coal production logistics system. A discrete event model is established with the help of Anylogic simulation software for related experimental optimization …


Research On Collaborative Task Allocation Method Of Multiple Uavs Based On Blockchain, Shuangcheng Niu, Yuqiang Jin, Kunhu Kou May 2023

Research On Collaborative Task Allocation Method Of Multiple Uavs Based On Blockchain, Shuangcheng Niu, Yuqiang Jin, Kunhu Kou

Journal of System Simulation

Abstract: The autonomous collaborative control of a multi-unmanned aerial vehicle (UAV) system lacks a unified underlying technology platform and faces single point failure and information security threats. In order to solve these problems, an idea to build collaborative task planning platforms based on blockchain technology is proposed. With thecollaborative task allocation of multiple UAVs as research objects, an online, safe, high-efficiency, and real-time task allocation method is designed. The contract network task allocation algorithm is described as a smart contract, and system consensus is reached based on the blockchain consensus algorithm. In addition, …


Research On No-Wait Flow Shop Scheduling Based On Discrete State Transition Algorithm, Jiaying Yu, Hongli Zhang, Yingchao Dong May 2023

Research On No-Wait Flow Shop Scheduling Based On Discrete State Transition Algorithm, Jiaying Yu, Hongli Zhang, Yingchao Dong

Journal of System Simulation

Abstract: In view of the no-wait flow shop problem (NWFSP) widely existing in the manufacturing industry, an improved discrete state transition algorithm (IDSTA) is proposed to solve the problem. The coding mode of the workpiece is designed based on the characteristics of the flow shop scheduling problem (FSSP). The initial solution is constructed by the Nawaz-Enscore-Ham (NEH) method with the standard deviation of the processing time of the workpiece as the priority, and a multi-neighborhood combinatorial search strategy based on insertion and exchange is designed to improve the quality of the initial solution. A discrete state transition algorithm ( …


Two-Stage Distributed Robust Optimal Dispatching For A Combined Heat And Power Virtual Power Plant, Yaqian Fan, Songyuan Yu, Fang Fang May 2023

Two-Stage Distributed Robust Optimal Dispatching For A Combined Heat And Power Virtual Power Plant, Yaqian Fan, Songyuan Yu, Fang Fang

Journal of System Simulation

Abstract: Combined heat and power virtual power plant (CHP-VPP) aggregates various electrical and thermal output units and takes into account the uncertainty of wind and solar output, dynamic electricity prices, thermal comfort of users, and other influences to achieve optimal dispatching of overall output. A two-stage distributed robust optimal dispatching method is proposed. In the first stage, planned dispatching is considered, so as to maximize the benefit of CHP-VPP. In the second stage, a fuzzy set of wind and solar output uncertainties is constructed based on the distributed robust method of moment uncertainty, and …


Multi-Camera Vehicle Recognition Method Based On Feature Robustness Enhancement, Huicheng Luo, Shujuan Wang May 2023

Multi-Camera Vehicle Recognition Method Based On Feature Robustness Enhancement, Huicheng Luo, Shujuan Wang

Journal of System Simulation

Abstract: Due to factors such as viewpoint changes, complex environments, and pose differences under multiple cameras, the images of the same vehicle in different scenes show huge appearance ambiguity, which brings challenges to vehicle identity matching. In order to solve this problem, a feature robustness enhancement method for vehicle recognition is proposed under the transformer framework. Based on the fact that the structural information of the vehicle is invariant under multiple cameras, a module for enhancing structural information guided by contour features is designed, and a structural feature perception loss is proposed to promote the fusion …


Outlier Detection During Thermal Processes Based On Improved Gaussian Mixture Model, Zheng Wu, Yue Zhang, Ze Dong May 2023

Outlier Detection During Thermal Processes Based On Improved Gaussian Mixture Model, Zheng Wu, Yue Zhang, Ze Dong

Journal of System Simulation

Abstract: Abnormal data detection during thermal processes is the basis for performing system modeling, control, and optimization and constitutes an important part of data processing. In this paper, an unsupervised outlier detection algorithm during thermal processes based on an improved Gaussian mixture model is proposed. The algorithm captures a class of data clusters under specific working conditions by using Gaussian components in each dimension, modifies the posterior probability density of the traditional model by adding penalty constraint factors to penalize the false detection and missed detection items, and identifies abnormal data according to the correlation differences with the …


Auxiliary Decision-Making Method For Flight Support Force Allocation Based On Dbn, Junyang Liu, Shisong Zhu May 2023

Auxiliary Decision-Making Method For Flight Support Force Allocation Based On Dbn, Junyang Liu, Shisong Zhu

Journal of System Simulation

Abstract: In order to make up for the deficiency of decision-making methods of full deployment and proportional allocation in airport flight support activities, an auxiliary decision-making model for airport flight support force allocation based on a dynamic Bayesian network (DBN) is constructed.On the basis of quantifying the strength of the support force, thehidden Markov model and Hausdorff distance algorithm are introduced to make auxiliary decisions for flight support activities under different conditions and define relevant decision evaluation indexes as the basis for model verification. Simulation tests are carried out on airport flight support activities under two …


An Algorithm For Obtaining Interception Guidance Routes Weighted By Threat Indexes, Shuyuan Liu May 2023

An Algorithm For Obtaining Interception Guidance Routes Weighted By Threat Indexes, Shuyuan Liu

Journal of System Simulation

Abstract: Interception guidance and threat assessment are two inseparable parts of command and control. The former implements specific command and guidance through guidance solutions, and the latter provides basis for threat assessment and situation advantage to command and control. Taking threat indexes as the weight, a kind of optimal interception route index is proposed to obtain the guidance solution with the least threat. Simulation results show that the proposed algorithm can effectively provide routing solutions for interception with the least threat, and is reliable under different situations, or with different weights of threat indexes. The algorithm provides a new idea …


Point Cloud Registration Method Based On Improved Covariance Matrix Descriptor, Yuan Zhang, Haoyu Han, Xie Han, Jiaxu Fu May 2023

Point Cloud Registration Method Based On Improved Covariance Matrix Descriptor, Yuan Zhang, Haoyu Han, Xie Han, Jiaxu Fu

Journal of System Simulation

Abstract: Point cloud registration is a key part of the digital protection of cultural relics. Improving registration accuracy and noise resistance is the main goal of point cloud registration for cultural relics. In order to solve this problem, a three-dimensional (3D) point cloud registration method based on a covariance matrix descriptor is proposed. The tensor voting method is used to eliminate the noise points, and the internal shape signature method is used to extract the key points from the point cloud after removing the noise. Then, the neighborhood information is constructed for the extracted key points, …


Partial Task Offloading Strategy Of Cloud Robots Based On Game Theory Under Cloud-Edge Coordination, Chunmao Jiang, Zhenxing Yang May 2023

Partial Task Offloading Strategy Of Cloud Robots Based On Game Theory Under Cloud-Edge Coordination, Chunmao Jiang, Zhenxing Yang

Journal of System Simulation

Abstract: How to rationally utilize the resources of central and edge clouds to reduce energy consumption of system equipment and shorten average task completion time is a fundamental challenge for computational task offloading of cloud robots. In this paper, we transform the computational task offloading problem of multiple cloud robots into a multi-actor game model by using the computational task completion time and energy consumption of cloud robots as cost measurement indicators and setting different cost weights according to actual needs. We also develop a game theory-based partial task offloading algorithm (GT-PTO). With the Nash equilibrium state …


Fixed-Wing Uav Detection Based On Simulated Data Transfer Learning, Yu Fu, Yao Zhang, Meng Zhao, Mianzhao Wang, Jiangpeng Zheng, Chen Jia, Shengyong Chen May 2023

Fixed-Wing Uav Detection Based On Simulated Data Transfer Learning, Yu Fu, Yao Zhang, Meng Zhao, Mianzhao Wang, Jiangpeng Zheng, Chen Jia, Shengyong Chen

Journal of System Simulation

Abstract: Data play an important role in visual inspection tasks, but it is difficult to obtain a sufficient amount of real fixed-wing UAV data. Therefore, a data set containing a large number of simulated fixed-wing UAV data and a small number of real fixed-wing UAV data is constructed, and the real fixed-wing UAV data are detected by training simulated fixed-wing UAV data based on the idea of weight transfer. On this basis, a two-stage learning strategy is proposed to further reduce the missed detection rate of UAVs by using multi-scale feature fusion.The simulation results show that …


Research On Modeling And Scheduling Of Virtual Power Plant With Dual Demand Response, Qiang Chen, Yi Wang, Kangshun Li Apr 2023

Research On Modeling And Scheduling Of Virtual Power Plant With Dual Demand Response, Qiang Chen, Yi Wang, Kangshun Li

Journal of System Simulation

Abstract: Virtual power plant technology provides an effective means to aggregate distributed power and user side resources to participate in power scheduling. Most of the existing research focus on the scheduling optimization of distributed energy instead of the demand response of user side. The user side resources are divided into contracted reliable response load and non-contracted random response load, and the load response is regulated through price adjustment mechanism to adapt to the change of distributed. A virtual power plant optimal scheduling model with dual demands response is constructed, in which the maximizing overall profit of the power grid is …


I-Nicemo Enhanced Algorithm Based On Intersection Angel Geometry, Yifan He, Yulin He, Yongda Cai, Zhexue Huang Apr 2023

I-Nicemo Enhanced Algorithm Based On Intersection Angel Geometry, Yifan He, Yulin He, Yongda Cai, Zhexue Huang

Journal of System Simulation

Abstract: To exactly determine the number of cluster centers and correctly identify the candidate cluster centers, an I-niceMO enhanced(I-niceMOEn) algorithm based on intersection angel geometry is proposed. As many distributions of intersection angles and distances as possible between observation points and data points are utilized to recognize the candidate cluster centers to avoid the neglection of cluster centers. The spectral clustering algorithm is used to automatically merge the candidate cluster centers according to the eigenvalues of Laplacian matrices. The number of final cluster centers is determined by the number of merged candidate cluster centers. The number of clusters can be …


Atmospheric Corrosion Simulation Of Air Conditioning Heat Exchanger In Service Under Marine Environment, Huang Peng, Jun Wang, Li Qi, Zhidong Wu Apr 2023

Atmospheric Corrosion Simulation Of Air Conditioning Heat Exchanger In Service Under Marine Environment, Huang Peng, Jun Wang, Li Qi, Zhidong Wu

Journal of System Simulation

Abstract: Aiming at the performance degradation of airconditioner heat exchanger caused by serious corrosion under marine environment, an atmospheric corrosion simulation method is studied to analyze and predict the influence on corrosion conditions of marine environment and working condition of air conditioner heat exchanger. From the acquisition of material parameters, the construction the model and the setting of boundary conditions, the atmospheric corrosion simulation process of air conditioner heat exchanger in service under marine environment is systematically introduced, and a method to verify the accuracy of the simulation model by using an artificially accelerated environmental test chamber is provided. From …


Research On Improvement Of Social Force Model Based On Non-Motor Vehicle Active Overtaking Behavior, Minghui Yang, Rui Zhang, Qiaobing Yan, Jiahe Wang Apr 2023

Research On Improvement Of Social Force Model Based On Non-Motor Vehicle Active Overtaking Behavior, Minghui Yang, Rui Zhang, Qiaobing Yan, Jiahe Wang

Journal of System Simulation

Abstract: Aiming at the social force model not to illustrate the active overtaking behavior of the rear non-motor vehicle to the front vehicle, an improved social force model is proposed. The traffic behavior characteristics of non-motorized vehicles mixed flow during the active overtaking is analyzed. Considering the compressible characteristics of non-motorized vehicle distancing in different density environments, the model is improved by presenting the concept of dynamic perception space and introducing the overtaking force into the social force model. The model is verified by analyzing the active overtaking behavior, active overtaking distance and speed-density basic graphs. The results indicate that …


Research On Modeling And Solution Method Of Operational Tasks Assignment, Yue Ma, Lin Wu, Shengming Guo Apr 2023

Research On Modeling And Solution Method Of Operational Tasks Assignment, Yue Ma, Lin Wu, Shengming Guo

Journal of System Simulation

Abstract: Aiming at the prewar operational tasks assignment in operation task planning, a multi constraint model of operational tasks assignment is constructed to describe the dynamic mapping relationship between operational tasks and operational units. The solution strategy of decision space pruning and constraint condition judgment is proposed, and the methods of decision variable coding, assignment scheme decoding and phased fitness calculation are described. Differential evolution algorithm is used to work out the solution. The experimental results show that the multi constraint assignment model and solution algorithm can effectively reduce the scale of decision space, and can improve the rationality …


Shared Subnet Synthesis And Application Of Object-Oriented Pres Net, Chuanliang Xia, Maibo Guo, Zhuangzhuang Wang, Yan Sun Apr 2023

Shared Subnet Synthesis And Application Of Object-Oriented Pres Net, Chuanliang Xia, Maibo Guo, Zhuangzhuang Wang, Yan Sun

Journal of System Simulation

Abstract: Focus on embedded system modeling, a solution to obtain a synthesized net via the shared subnet of an extended Petri net is proposed. Object-oriented technology and Petri net-based representation for embedded system (PRES net) are merged to obtain an object-oriented PRES net (OOPRES net). A method of synthesized operation of the shared subnet of OOPRES net is proposed, and the preservation of the liveness and boundedness of synthesized net system is studied. Taking the modeling analysis of intelligent transportation system as an example, the effectiveness of the synthesized method is verified. The method can provide an effective way for …


Dynamic Target Assignment Of Multiple Unmanned Aerial Vehicles Based On Clustering Of Network Nodes, Tuo Zhao, Hanqiang Deng, Jialong Gao, Jian Huang Apr 2023

Dynamic Target Assignment Of Multiple Unmanned Aerial Vehicles Based On Clustering Of Network Nodes, Tuo Zhao, Hanqiang Deng, Jialong Gao, Jian Huang

Journal of System Simulation

Abstract: In order to solve the problem that the distributed multi-UAV target assignment algorithm is prone to communication redundancy, which leads to the large communication scale of formation, a multi-UAV dynamic target assignment algorithm (CU-CBBA) based on node clustering in communication network is proposed.The algorithm introduces the communication network node grouping clustering strategy. According to the node's degree centrality, feature vector centrality, intermediate centrality and other attributes, the network node importance ranking model is established. A group of key nodes in the network topology structure are selected and the network topology node clustering is completed according to the shortest …


Adaptive Correction Tracking Algorithm Based On Detector And Locator Fusion, Yecai Guo, Cheng Liu Apr 2023

Adaptive Correction Tracking Algorithm Based On Detector And Locator Fusion, Yecai Guo, Cheng Liu

Journal of System Simulation

Abstract: In order to avoid tracking failure caused by occlusion, rotation and other factors in complex dynamic scenes, an adaptive correction tracking algorithm based on detector and locator fusion is proposed. The locator trains a convolutional neural network (CNN) filter for location estimation by extracting the deep features of target. The CNN filter adds two layers of shallow features to the three layers of the convolution features of original CF2 algorithm, which enhances the extraction of target texture information. The detector calculates the confidence score by extracting histogram of oriented gradient(HOG) feature of target and combining the context information. …


Cross-Domain Text Sentiment Classification Based On Auxiliary Classification Networks, Na Ma, Tingxin Wen, Xu Jia, Xiaohui Li Apr 2023

Cross-Domain Text Sentiment Classification Based On Auxiliary Classification Networks, Na Ma, Tingxin Wen, Xu Jia, Xiaohui Li

Journal of System Simulation

Abstract: To align exactly the texts with same sentiment polarities of source and target domains, and to enlarge the feature difference of different sentiment texts as much as possible, a domain adaptation model with weighted adversarial networks is proposed. A new structured classification network consisting of a main classification network and an auxiliary classification network is proposed, in which the main classification network is used to perform supervised learning on the labeled texts of the source domain, and the auxiliary classification network is used to improve the distinguishability of the text features. A calculation method of multiple adversarial network weights …


Dual Resource Constrained Flexible Job Shop Energy-Saving Scheduling Considering Delivery Time, Hongliang Zhang, Jingru Xu, Bo Tan, Gongjie Xu Apr 2023

Dual Resource Constrained Flexible Job Shop Energy-Saving Scheduling Considering Delivery Time, Hongliang Zhang, Jingru Xu, Bo Tan, Gongjie Xu

Journal of System Simulation

Abstract: To handle the flexible job shop energy-saving scheduling with machines and workers constraints, on the considering of delivery time, the optimization model of dual resource constrained flexible job shop energy-saving scheduling is established with the goal of minimizing the total earliness and tardiness penalties, and total energy consumption. An improved non-dominated sorting genetic algorithm II(INSGA-II) is proposed. Aiming at the optimized objectives, a three-stage decoding method is designed to gain more feasible solutions. The dynamic adaptive crossover and mutation operators are applied to get more excellent individuals. The crowding distance is improved to obtain a population with better …


Bottleneck Drift Fluctuation Analysis Of Discrete Remanufacturing System Under Disturbance, Yongzhang Zhou, Yan Wang, Zhicheng Ji Apr 2023

Bottleneck Drift Fluctuation Analysis Of Discrete Remanufacturing System Under Disturbance, Yongzhang Zhou, Yan Wang, Zhicheng Ji

Journal of System Simulation

Abstract: Considering comprehensively the influence of each production process on the bottleneck degree of discrete remanufacturing system, the interval bottleneck index matrix is established by collecting data repeatedly in the observation stage to obtain the comprehensive bottleneck index of equipment, which is used as the identification basis. Aiming at the volatility of bottleneck drift in the uncertain environment of discrete remanufacturing system, based on the interval bottleneck index matrix and comprehensive bottleneck index, a theoretical method of visual dynamic analysis including system sensitivity coefficient, machine sensitivity coefficient and bottleneck drift judgment model is established. The discrete event simulation case is …


Research On Unmanned Swarm Combat System Adaptive Evolution Model Simulation, Zhiqiang Li, Yuanlong Li, Laixiang Yin, Xiangping Ma Apr 2023

Research On Unmanned Swarm Combat System Adaptive Evolution Model Simulation, Zhiqiang Li, Yuanlong Li, Laixiang Yin, Xiangping Ma

Journal of System Simulation

Abstract: Aiming at the fact that the intelligent unmanned swarm combat system is mainly composed of large-scale combat individuals with limited behavioral capabilities and has limited ability to adapt to the changes of battlefield environment and combat opponents, a learning evolution method combining genetic algorithm and reinforcement learning is proposed to construct an individual-based unmanned bee colony combat system evolution model. To improve the adaptive evolution efficiency of bee colony combat system, an improved genetic algorithm is proposed to improve the learning and evolution speed of bee colony individuals by using individual-specific mutation optimization strategy. Simulation experiment on …


Research Progress Of Opponent Modeling Based On Deep Reinforcement Learning, Haotian Xu, Long Qin, Junjie Zeng, Yue Hu, Qi Zhang Apr 2023

Research Progress Of Opponent Modeling Based On Deep Reinforcement Learning, Haotian Xu, Long Qin, Junjie Zeng, Yue Hu, Qi Zhang

Journal of System Simulation

Abstract: Deep reinforcement learning is an agent modeling method with both deep learning feature extraction ability and reinforcement learning sequence decision-making ability, which can make up for the depleted non-stationary adaptation, complex feature selection and insufficient state-space representation ability of traditional opponent modeling. The deep reinforcement learning-based opponent modeling methods are divided into two categories, explicit modeling and implicit modeling, and the corresponding theories, models, algorithms and applicable scenarios are sorted out according to the categories. The applications of deep reinforcement learning-based opponent modeling techniques on different fields are introduced. The key problems and future development are summarized to provide …