This article discusses the use of three regression models (Linear Regression, Decision Tree Regression, and Random Forest Regression) to study the performance of high school students in India across three subjects: Physics, Chemistry, and Mathematics. The study identifies various factors that affect student performance, such as access to good internet connectivity, parental educational background, and lunch quality. The data was obtained from an educational firm and analyzed based on principles and methods that aid decision-making processes. The results showed that all three regression models produced accurate and plausible results, with an overall accuracy of approximately 95%. The study's primary objective was to provide a clear and concise comparative analysis of various Machine Learning techniques and their impact on the dataset and the predictive attributes analyzed. The findings from this study underscore the importance of considering various factors when analyzing student performance and highlight the effectiveness of Machine Learning techniques in this domain.