Machine Learning Introduction
Machine Learning Introduction
1 2 3 4 5 6 7
• Evaluation: Metrics such as Mean Squared Error (MSE), Root Mean Squared Error (RMSE), Mean Absolute Error
(MAE), 𝑅2R2 score, etc.
Linear Regression
● Linear regression algorithm shows a linear relationship between a dependent (y) and one
or more independent (y) variables.
● y=β0+β1x+ϵ where:
• 𝑦y is the dependent variable.
• 𝑥x is the independent variable.
• 𝛽0β0is the intercept (constant term).
• 𝛽1β1is the coefficient (slope) that represents the relationship between 𝑥x and 𝑦y.
• 𝜖ϵ is the error term (residuals).
Linear Regression-cont
● Dependent Variable (Response Variable):
Definition: The dependent variable is the outcome or the variable you are trying to predict or explain.
Notation: It is usually denoted by 𝑦y.
Role: Its value depends on the independent variables.
Example: In a model predicting house prices, the house price is the dependent variable.
● Independent Variables (Predictors or Features):
Definition: Independent variables are the input variables used to predict the dependent variable.
Notation: They are usually denoted by 𝑥x (in simple linear regression) or 𝑥1,𝑥2,…,𝑥𝑛x1,x2,…,xn(in multiple linear regression).
Role: These variables provide the information needed to make predictions about the dependent variable.
Example: In a model predicting house prices, features like square footage, number of bedrooms, and location are independent
variables.