Heart disease is a leading cause of death globally, claiming approximately 17 million lives each year. Often, these deaths are due to heart failure, a condition where the heart cannot supply enough blood to meet the body’s needs. To improve diagnosis and treatment, healthcare professionals increasingly rely on electronic medical records. These records are invaluable for detecting subtle patterns in symptoms and test results that might otherwise go unnoticed. In the realm of medical data analysis, data mining techniques have shown promise in predicting the outcomes of cardiovascular diseases. However, major challenges can occur—overfitting and managing large dimensions of data—can hinder their effectiveness. To address these issues, this paper proposes a novel method that simplifies the data through feature selection, making this model not only more efficient but also easier to understand. Specifically, we introduce a new framework that combines advanced feature selection algorithms (sequential forward and backward, or CSFB) with a blend of traditional machine learning and cutting-edge deep learning techniques.