It's a trap... I shouldn't have agreed to this deal.
I got mad during my first play through and started fighting the Dwarves who locked Geralt in Paperchase quest. But this time decided to show patience and they returned the money along with a sword as gift.
At least he was better at something