The low correlation of evaluation indices from the current user perception evaluation model and the neglect of the nonlinear relationship between diversified indices and user experience in different duration videos result in low user perception accuracy of long and short videos. To address these issues, we propose a user experience perception algorithm for long and short videos based on multiple nonlinear regression (LSMNR). First, to improve the efficiency and accuracy of modeling, the algorithm involves preprocessing of video data in edge servers and subdivides the videos based on their duration and popularity. Then, we introduce a new multidimensional quantitative evaluation index that fits the user’s subjective experience and further analyze the influence between multiple evaluation indices (video lag, black screen, etc.) and user quality of experience (QoE) for different video types. Moreover, the characteristics of the data in the multiple evaluation indices are extracted; user subjective evaluation experiments are designed using the video quality expert group (VQEG) standard; and sample and test databases were established. Finally, the optimal model parameters were trained by applying the nonlinear least square method and support vector machine (SVM) to fit and cross-verify the sample data. Our simulation results revealed that the Pearson correlation coefficient of the proposed LSMNR algorithm acquires a value of 0.9810. Compared with algorithms based on multinomial linear regression (MLR), linear SVM, and neural network (NN), the perceptual accuracy of the proposed algorithm is improved by at least 4.0%, and it is applicable to a wider range of video types.