There was an official funeral in the capital, Dodoma, on Monday and since then his funeral cortege has been making its way through the country.
The 61-year-old president is said to have died of heart complications.
President Samia Suluhu Hassan, who succeeds him, will lead the nation during the burial ceremony.
She has tweeted a thank you note to “everyone who has supported comforted and sent us condolence messages during this difficult and trying times for our nation”.
Days ahead of the burial ceremony, police arrested four people for allegedly mocking the death of the former president.
The regional police head of the south-west region of Mbeya, Urlich Matei, said the suspects intended to “cause chaos and breach of peace”.
The country has suspended all public activities during the 21 days that have been set for mourning the president.