Let us do it though it through Cayley Hamilton's Theorem which states :
Every eigen value of the matrix satisfies its own characteristic equation.
To elaborate , if we have f(M) = 0 , where f(M) is the characteristic equation of matrix then the same will also be for f(λ) i.e. f(λ) = 0 , where λ is a corresponding eigen value of matrix..
So given ,
α M-1 = M2 - α M + 11 I3 where I3 is a 3*3 identity matrix , so for eigen value λ , we can write :
α λ-1 = λ2 - α λ + 11
⇒ α / λ = λ2 - α λ + 11 [ as λ-1 = 1 / λ ] ..........(1)
Now let us substitute the eigen values given one by one in the equation (1) :
a) λ = 1 :
So we have ,
α / λ = λ2 - α λ + 11
⇒ α = 1 - α + 11
⇒ 2 α = 12
⇒ α = 6
a) λ = 2 :
α / λ = λ2 - α λ + 11
⇒ α / 2 = 4 - 2 α + 11
⇒ 5α / 2 = 15
⇒ 5α = 30
⇒ α = 6
So in both cases we have the value of α = 6 . So 6 is the correct answer