Gwinnett County Police will be moving their permit office to Lawrenceville for the foreseeable future.