Actually I am trying to look at a normal time series regression. All the variables are not stationary and my main independent variable is a time dummy. How should I proceed
You can always difference a dummy variable. What it looks like will depend on whether it is a 'step' [ 0 0 0 1 1 1 ] or 'pulse' [ 0 0 0 1 0 0] dummy variable. When you difference a 'step' dummy variable it actually becomes a pulse dummy variable, whereas when you difference a pulse dummy it becomes positive/negative [0 0 0 1 -1 0 0].
Since it is a step dummy , there is no need differencing it .you already know that answer zero. How about differential intercept and differential slope?