Im makin a paper mache castle for geckos/small lizard to live in would it be ok for them?

As long as all the ingredients you use are non-toxic, it should be fine. Though if your lizards need high humidity, you may wish to seal your castle in some way (using something that says it's reptile-safe/non toxic) to keep it from rotting or molding.