Come to think of it, this could work as a manner in Yukkuri society.
Just like how hand shake start from and old tradition, showing that you have no weapon in your hand, lifting the hat show that yu didn't hidden branch or tools under it. It also show that particular yukkuri has enough self control to part with its accessory, a sign of high upbringing.