Dear all,
Let A and B be matrices of size NxN.
Let x be a vector of size Nx1.
We all know that the function f(x) = xHAx/ xHBx attains its maximum when x is chosen to be the generalised eigenvector corresponding to the maximum generalised eigenvalue (lambda_max) of the matrix pencil (A,B), i.e.
Ax = (lambda_max)Bx .................. (1)
My question is the following: "In the case where A and B have a common null space, this is not valid anymore since any scalar lambda satisfies equation (1).
Has anybody come across this ? Is there any modification that could be done on matrices A and/or B so that we could regularise the problem?"
Many thanks in advance.
Dear ahamed,
You can go alternative formulation for the PCA rather than SVD,.....both diagonalization is zero,, if it were not very small amount of. Floating -poijnt round of error.Alternative formulation matrix eigen vactor ,eigen vector sommtime row _mode,Column mode .
A
If you know the null-space L, can't you just perform the maximization over the orthogonal complement of L? A and B are non-singular on that space.
One could also maximize x^HAx under the constraint that xB^x=1. Then we will automatically avoid the nullspace of B.
The answer Axel gives makes sense to me, but the right answer depends on exactly what you want to achieve by getting the maximum of x^T A x / x^T B x, I think. So what made you try to find the solution of the problem, Ahmad?
Dear Axel,
Thank you, as Sunghee and I think, your answer is very logical.
Could you provide me an example by solving over the orthogonal complement L ?
Thank you in advance
Yes Sunghee,
I am trying to maximise over the orthogonal complement L.
Thank you for your comment.
Dear Axel,
I should correct my previous comment to you. You can not just say that x belongs to the orthogonal complement of L. You can say that L belongs to the space excluding the null space, i.e. excluding L.
Hi again Ahmad,
yes, I think you are right, it is not as easy as I thought first. I think it is also not enough to consider the (set theoretic) complement of L if you don't make some additional assumptions.
My first concern is: don't we have to assume that the matrices are Hermitian in order to guarantee that the maximizing vectors are generalized eigenvectors?
Also, in order for the maximum to be corresponding to the maximal eigenvalue, does not B have to be positive semidefinite?
And finally, we have to assume that the null space of B is contained in the null space of A in order for the maximization to work at all?
Hello Axel,
Yes that's true. A and B are both Hermitian and positive semi definite (and for sure not positive definite since they have a common null space).
Thanks again
OK, for completeness: IF they are Hermitian and we also assume that the nullspace over B is contained in the nullspace of A, we may perform the maximization over the orthogonal complement of null(B) (in fact, any complementary space will do), not only over R^N \ null(B).
Short explanation: if x is any vector, we may write it as v+n, where Bn=0 (and then also An=0) and v and n are perpendicular, we have
(v+n)^HA(v+n)=v^HAv+n^HAv=v^HAv +(An)^Hv= v^HAv,
and also (v+n)^HB(v+n)=v^HBv. Hence, the maximization may equivalently be performed on the orthogonal complement of null B. On this space, B is positive definite, so the usual theorem about generalized eigenvectors and maximum of the function applies.
- Badges
- Science topic
- Similar topics
- Mathematics