A variable should be a target for elimination under certain conditions. Check both the variables loading(s) on a factor as well as its communality. If the variable loads more than one factor, it may be a target for elimination. However, there are cases when cross-loadings are expected. Now to your question. If the communality is low this suggests that the variable has little in common with the other variables and is likely a target for elimination. Look to the WISC-V as an example. The Cancellation subtest has a low communality, a low general factor loading and struggles to align with a group factor. If one were a psychometric purist then a case can be made that this variable/subtest be eliminated.
While performing EFA using Principal Axis Factoring with Promax rotation, Osborne, Costello, & Kellow (2008) suggests the communalities above 0.4 is acceptable. This is also suggested by James Gaskin on http://statwiki.kolobkreations.com . However, Child. D (2006) suggests that the value of communlaity below 0.2 should be removed.