Joshua was born in the desert in Manyjiljarra country. He came into Jigalong as a young boy and was educated at Jigalong mission, where he also contributed to the work of the linguist Jim Marsh. He worked for many years for the Agricultural Protection Board of WA and also as a teacher at Jigalong School, teaching children to read and write Martu Wangka (language). He later worked as a Central Desert Liaison Officer and now with KJ as a Cultural Awareness Presenter and Liaison Officer. He is also a director of KJ.