Your question is interesting and I hope you'll have many different answers.

For myself it depends on the problem.

Often to find a solution I have a look at thesis about the subject on the net.

To find new idea I suggest you read a book whose tittle is "Serendipity"