Mathematics
Mathematics, 14.10.2020 01:01, CSelmon23

It is well-known that ridge regression tends to give similar coefficient values to correlated variables, whereas lasso may give quite different coefficient values to correlated variables. We will now explore this property in a very simple setting. Assume n are the number of training samples, p the number of dimensions, x in the input and y the output. Suppose that n = 2, p = 2, x11 = x12, and x21 = x22. Furthermore, suppose that y1 + y2 = 0 and x11 + x21 = 0 and x12 + x22 = 0, so that the estimate for the intercept in a least squares, ridge regression, or lasso model is zero: βˆ 0 = 0. (a) Write out the ridge regression optimization problem in this setting. (b) Argue that in this setting, the ridge coefficient estimates satisfy βˆ 1 = βˆ 2. (c) Write out the lasso optimization problem in this setting. (d) Argue that in this setting, the lasso coefficients βˆ 1 and βˆ 2 are not unique – in other words, there are many possible solutions to the optimization problem. Describe these solutions

answer
Answers: 2

Other questions on the subject: Mathematics

image
Mathematics, 21.06.2019 15:30, lberman2005p77lfi
Answer question above and explain each step : )
Answers: 3
image
Mathematics, 21.06.2019 19:00, amanda2517
To solve the system of equations below, pedro isolated the variable y in the first equation and then substituted it into the second equation. what was the resulting equation? { 5y=10x {x^2+y^2=36
Answers: 1
image
Mathematics, 21.06.2019 20:00, andrejr0330jr
I’m stuck on this equation, anyone got the answer?
Answers: 1
image
Mathematics, 21.06.2019 20:30, shelbylynn17
The function show two sisters' savings account and the rate at which they plan to deposit money
Answers: 3
Do you know the correct answer?
It is well-known that ridge regression tends to give similar coefficient values to correlated variab...

Questions in other subjects:

Konu
Mathematics, 13.03.2021 01:00
Konu
English, 13.03.2021 01:00