Abstract
Virtual network embedding (VNE) is an essential resource allocation task innetwork virtualization, aiming to map virtual network requests (VNRs) ontophysical infrastructure. Reinforcement learning (RL) has recently emerged as apromising solution to this problem. However, existing RL-based VNE methods arelimited by the unidirectional action design and one-size-fits-all trainingstrategy, resulting in restricted searchability and generalizability. In thispaper, we propose a FLexible And Generalizable RL framework for VNE, namedFlagVNE. Specifically, we design a bidirectional action-based Markov decisionprocess model that enables the joint selection of virtual and physical nodes,thus improving the exploration flexibility of solution space. To tackle theexpansive and dynamic action space, we design a hierarchical decoder togenerate adaptive action probability distributions and ensure high trainingefficiency. Furthermore, to overcome the generalization issue for varying VNRsizes, we propose a meta-RL-based training method with a curriculum schedulingstrategy, facilitating specialized policy training for each VNR size. Finally,extensive experimental results show the effectiveness of FlagVNE acrossmultiple key metrics. Our code is available at GitHub(https://github.com/GeminiLight/flag-vne).