You can test if nlme:lme converge with your data with some different optimers. If so, open option is to create wrapper function which calls nlme:lme with a different optimiser and pass other arguments through. Then you need to modify glmmPQL (change mcall[[1L]]