Fortunately, there are some simple sufficient conditions for convexity that work well for many functions of interest. See the book "Convex Optimization" by Boyd and Vandenberghe. You can get it for free online:
One sub-question might be whether the problem is always convex in the continuous variables, i.e., when all the binary/integer variables are fixed to arbitrary feasible values. If, for example, you know something about the sign of the expressions associated with the integer/binary variables then you might be able to say that the continuous part of the problem is convex for any fixed feasible integer/binary variable values. Is that possible?
The objective function is convex. I tried to derive the constraints, but it is not easy to derive different sets of constraints with four different vectors. Some of the constraints are of the type '=' and the others are of the type '='. What I have understood is I have to check the definiteness of the whole system.
I am attaching a snapshot of the model to have a look.
The first set of constraints looks non-convex to me, since they are quadratic equations. You might be able to linearise them, though, by introducing additional variables. See, e.g., these papers:
I am very surprised many researcher did not know the simple and important information of LINDO products.
1. Demo version, manuals and Linus textbooks are free. If English speakers read those book, you can understand the Set expression and others. If you can understand Japanese, see my announcement of DEA, Cancer Gene Diagnosis, several translations and original two books.
2. Linus reviewed many papers and books. He made over 500 sample models. I need not survey the papers and develop new approach about DEA model by modification of sample DEA.
3. Linus explains many sample models. Data are defined in Data section. But, you define those data on Excel. You can read it by @OLE function and output Excel. If you must a big data, you choose the DB.
4. I developed “100-fold cross validation for small sample method and Matryoshka Feature Selection method for microarray datasets.” See the Chap.2 and Chap.9 of my Springer book (2016).