For my simulations I get a sum rate of X b/s. If my total energy consumption is Y mW, how should i calculate energy efficiency(EE). Is the following formula correct?
The energy efficiency is the ratio of the useful energy to the total input energy.
So, one would innovate an energy efficiency for your problem. In fact in the rf wireless communication system the energy picked up by the receivers from the transmitted energy is a very small fraction because of the broadcast nature of the the communication channels.
I think you do not intend the this type of energy efficiency.
I may think that you can define an other type of energy efficacy which can be defined as follows:
Energy efficiency = The energy consumed in case of ideal transmission channels to the energy consumed under real channel to transmit the same bit rate with the same bit error rate.
I think it will be a meaningful definition.
However, one can define what is called the energy consumption to transmit one bit and this is not an energy efficiency. It is just an energy consumption rate in joule per bit.