Kaze landed in Dar es Salaam two days back from Canada and was welcomed by Yanga officials as well as the outfit's fans.
The Burundian tactician has replaced Serbian coach, Zlatko Krmpotic, who was sacked by the club on October 3 due to what was described as the outfit's failure to put impressive showing in domestic top flight.
By the time Krmpotic left he had headed Yanga's technical bench in five Vodacom Premier League matches, recording victory in four and posting draw in one.
Yanga were held to 1-1 draw by Tanzania Prisons at Benjamin Mkapa Stadium in Dar es Salaam in what was also the former's opening match in this season's top flight.
Yanga later went on to notch wins in games against Mtibwa Sugar, Mbeya City FC, Coastal Union and Kagera Sugar.
Kaze said he is happy to coach Yanga as he has knowledge of the club, noting he needs support from the rest in the club.
The contract will see him work for Yanga until 2022.
Kaze said that he is happy to come to Tanzania and coach Yanga, as he understands they are a great team with ambitions and boast of huge following.
"I am happy to join Yanga, which is a great team and is known all over East and Central African region, so, my presence here will be beneficial to the club,'' he noted.
"I know the team's goals and what they need so I would like to tell them they should not worry about that," he said.
Kaze said: "I can say that I have found great comfort in serving as head coach at Yanga and many have been congratulating me on this, I have received so many congratulatory messages.''
“I have come to work and all I need is seeing others support my work.''
"Yanga are a great team and have a lot of fans, so, all we need now is looking at how we will achieve success and goals that we have set for ourselves," he said.