I guess there should be a washing/equilibrating step (buffer) and an elution step (buffer). I have tried direct elution with warm TE with limited success.
you can try to use 95 degree pre warmed TE buffer. It might work better than just a bit warmed buffer. But before it you need to wash it with wash buffer to eliminate many other conteminants. In addition if that method doesnt help you can add 0.3 M NaCl in your elution buffer. that will disassociate DNA from column.