In my experience, neutral answers can be intepreted in different ways, also taking the culture of respondents into consideration:
1) the question is not sufficiently clear, not well-written, can be interpreted ambiguously
Usually in this case informants use neutral answers
2) informants do not want to commit themselves in giving a positive or negative answer, this can be due to cultural reasons
In general a high number of neutral answers should be carefully considered, even though it highly depends on the opics you're exploring.... maybe a little bit of context about your research would have been useful... I'm referring to social sciences here.
Usually researchers do summing for the scores of the items in Likert sale. Thus, the total score for the scale or subscale is used for analysis. The neutral scores will not be calculated separately
A survey is an act of communication. The fact that many different sorts of responses end up in the N category only leads to confusion of mean. Stop doing it now. :)
Nowadays in the corpoeate too they are not using the five point or odd number likert.the use of even number likert is very famous as this atleast gives us the ppsitive or negative opinion of the consumer.