Finance Minister AHM Mustafa Kamal says tax offices will be set up in every upazila of the country.